Here is a test file with mono aac audio and two conversion logs. With DirectShowSource you get audio at half speed, with FFMPEGSource everything works fine.
http://www.sendspace.com/file/5wcdi1
Could it have something to do with the uncommon sample rate of 22.05 kHz? Unfortunately files like this are quite common on the internet.
Cheers
manolito