Well I guess I'll stick with Avisynth anyway just for the ease of use.
After all, I'm already indexing the video and/or trimming it etc, so having everything in one place makes sense, especially now that StainlessS showed me that ResampleAudio() is just as good as SSRC() ever since Ian re-wrote it.