Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > General > Audio encoding

Reply
 
Thread Tools Search this Thread Display Modes
Old 2nd December 2022, 06:58   #1  |  Link
dns
Registered User
 
Join Date: Jan 2022
Posts: 4
AAC encoding and comparison method. So can you compare?

Hi people.

I decided to compare several audio codecs. I want to know what the community thinks about this method of comparison?
I used:
  • faac-1.30
  • fdkaac-0.6.3 (libfdk-aac_3.4.22p3) ("p" version stands for modified by Poikosoft audio laboratories.)
  • fdkaac-1.0.4
  • ffmpeg-N-109149-g459527108a-20221121
  • qaac-2.76
  • sox-14.4.2
  • ImageMagick-7.1.0-48
I took 15 tracks and encoded with different settings.
  • [faac*.m4a] faac ( -b 128, -b 256, -b 384, -b 512, -q 300, -q 500 )
  • [fdk1*.m4a] fdkaac-0.6.3 ( -b 128k, -b 256k, -b 384k, -b 512k, -q 3, -q 5, -q 8 )
  • [fdk2*.m4a] fdkaac-1.0.4 ( -b 128k, -b 256k, -b 384k, -b 512k, -q 3, -q 5 )
  • [fdk3*.m4a] fdkaac-1.0.4 ( -b 128k, -b 256k, -b 384k, -b 512k, -q 3, -q 5 ) --bandwidth 20000
  • [fhg*.m4a] fhgaacenc ( --cbr 128, --cbr 256, --cbr 384, --cbr 512, --vbr 3, --vbr 6)
  • [qaac*.m4a] qaac ( --cbr 128, --cbr 256,--cbr 320, --tvbr 90, --tvbr 127 )
  • [nero*.m4a] nero ( -cbr 128000, -cbr 256000, -cbr 384000, -cbr 512000, -q 0.5, -q 1 )
  • [ff*.mp4] ffmpeg -c:a aac ( -b:a 128k, -b:a 256k, -b:a 384k, -q:a 3, -q:a 5 )

Spectrograms of all received m4a files.
  • sox INPUT_FILE.wav -n spectrogram -x 1024 -z 120 -w Hann -t -h -o *.m4a.png
Then I compared the spectrogram of each file with the original (changing fuzz several times)
  • magick.exe compare -metric AE -fuzz ( 0%, 1%, 2%, 3% ) SPECTROGRAM.png *.m4a.png CMP_FILE.png
Where:
-metric type - measure differences between images with this metric
* AE - absolute error count, number of different pixels (-fuzz affected)
-fuzz distance - colors within this distance are considered equal
For one track I made a collage, for visual comparison (more red - worse). Full resolution here.

Here are all the tracks in m4a, as well as their spectrograms
Code:
|	*.png		- original spectrograms
+-- [TRACK NAME\m4a]
|		*.m4a		- recoded tracks
|		...
+-- [TRACK NAME\m4a]
|		*.png		- spectrograms of all .m4a files
|		n-cmp_*.png	- comparative spectrograms
|		...
L---
And here are the comparative tables of all tracks (in cell D1 you can enter the name of the encoder)
It is difficult to draw conclusions, but for myself I drew conclusions
  • that ffmeg isn't that bad
  • that the old fdkaac-0.6.3 is much better than the new fdkaac-1.0.4
  • that ...
Or is it all nonsense and I just wasted my time and yours?

Thanks to all.

Last edited by dns; 2nd December 2022 at 20:19. Reason: Changed the links to the collages. There were infidels.
dns is offline   Reply With Quote
Old 3rd December 2022, 04:59   #2  |  Link
chainring
Registered User
 
chainring's Avatar
 
Join Date: Sep 2006
Posts: 174
Quote:
Originally Posted by dns View Post
I want to know what the community thinks about this method of comparison?
Do you listen to a spectrogram analysis or do you listen to music? Let your ears, not your eyes, be the guide.

Hate to tell you this, but people before you have done similar and it's almost always shot down in a fiery ball of wasted time.
chainring is offline   Reply With Quote
Old 5th December 2022, 11:37   #3  |  Link
dns
Registered User
 
Join Date: Jan 2022
Posts: 4
Quote:
Originally Posted by chainring View Post
Do you listen to a spectrogram analysis or do you listen to music? Let your ears, not your eyes, be the guide.

Hate to tell you this, but people before you have done similar and it's almost always shot down in a fiery ball of wasted time.
Actually, I rarely hear a difference. Only on certain compositions, but that doesn't mean I wouldn't want to find a better encoding option.

Let me tell you why I came up with this idea.
Since we live in the digital age and there are many programs: Google Assistant, Siri, Shazam, etc...
We are not talking about an analog signal here, but about a digital one, from which I concluded that it is possible to find an audio comparison algorithm without human ears.
And what I suggested, I could not find on here on the forum.

And thank you very much for your answer.
dns is offline   Reply With Quote
Old 5th December 2022, 12:53   #4  |  Link
john33
Registered User
 
Join Date: Apr 2002
Location: UK
Posts: 68
It has been attempted a number of times without any great success. The problem is partly due to the fact that all lossy codecs generate artefacts, to a greater of lesser degree, and our individual sensitivity to those artefacts often colours our opinion as to which is a good encoder and which isn't. You can't program to deal with that. Blind listening tests are the only reliable test. Most public listening tests suggest that 'qaac', which uses the Apple encoder, is the best of the aac codecs.
john33 is offline   Reply With Quote
Old 5th December 2022, 14:52   #5  |  Link
richardpl
Registered User
 
Join Date: Jan 2012
Posts: 271
Using sox and imagetragick in these ages is story for itself.
richardpl is offline   Reply With Quote
Old 5th December 2022, 21:40   #6  |  Link
chainring
Registered User
 
chainring's Avatar
 
Join Date: Sep 2006
Posts: 174
Quote:
Originally Posted by dns View Post
Actually, I rarely hear a difference. Only on certain compositions, but that doesn't mean I wouldn't want to find a better encoding option.

Let me tell you why I came up with this idea.
Since we live in the digital age and there are many programs: Google Assistant, Siri, Shazam, etc...
We are not talking about an analog signal here, but about a digital one, from which I concluded that it is possible to find an audio comparison algorithm without human ears.
And what I suggested, I could not find on here on the forum.

And thank you very much for your answer.
I don't want to squash your enthusiasm, but I'd hate to see you waste time on something that's not going to do much other than satisfy your curiosity. Peruse the forums at Hydrogen Audio (http://hydrogenaud.io) for the testing procedures and lots of tests over the years.
chainring is offline   Reply With Quote
Old 3rd January 2023, 14:52   #7  |  Link
pandy
Registered User
 
Join Date: Mar 2006
Posts: 1,049
For spectral comparison you may try to use https://junkerhq.net/MDFourier/
Different purpose but should work also for this task.
pandy is offline   Reply With Quote
Old 3rd January 2023, 15:48   #8  |  Link
VoodooFX
Banana User
 
VoodooFX's Avatar
 
Join Date: Sep 2008
Posts: 983
I prefer this lil program to quickly look at spectrograms: http://spek.cc

To compare audio codecs you need to use your ears, spectrograms are useless for that.
VoodooFX is offline   Reply With Quote
Reply

Tags
aac, fdkaac, ffmpeg, qaac

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 09:01.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.