Today, I made first successfull call with Nokia N900 running 4.4-rc8 kernel and Debian userland. Latency was cca second, and I was told my voice was not recognizable, but we had no problems understanding each other.
Maybe voice format is not 4kHz, 16bit, stereo after all?