ADTS has a special header so that you can switch channel count mid-stream, which is not supported otherwise. A clear short-coming of libfaad, imho.
Thats also the reason the header was not removed - because with it LAV Audio supports on-the-fly channel layout changes (which happen on live tv). Stupid ffdshow somehow accepted my special ADTS media type...