Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 22nd September 2018, 02:39   #1001  |  Link
hydra3333
Registered User
 
Join Date: Oct 2009
Location: crow-land
Posts: 540
Quote:
Originally Posted by marcomsousa View Post
Excelent post
And +1
hydra3333 is offline   Reply With Quote
Old 22nd September 2018, 04:00   #1002  |  Link
Tommy Carrot
Registered User
 
Tommy Carrot's Avatar
 
Join Date: Mar 2002
Posts: 863
If anyone is curious how the encoding speed improved in the last half year or so, here's a little comparison between the different versions:
Code:
  version   | enc time  | filesize
0.1.0-9348  |    152    |  183494
0.1.0-9559  |    119    |  182391
0.1.0-9658  |    109    |  182118
1.0.0-6     |     94    |  182856
1.0.0-82    |     86    |  182952
1.0.0-181   |     61    |  184139
1.0.0-245   |     59    |  189154
1.0.0-399   |     51    |  180221
1.0.0-541   |     22    |  184505
1.0.0-629   |     15    |  184616
I used cpu-used=1 in all cases, and tried to match the bitrates as close as possible in constant quality mode. The encoding speed is still very slow, but as you can see, it finally started to improve at a higher pace lately (although the last 2 builds used CONFIG_LOWBITDEPTH=1, so they are not really comparable). Aomenc is still way too slow for any productive purpose, but at least it's possible to test it now.
Tommy Carrot is offline   Reply With Quote
Old 22nd September 2018, 04:46   #1003  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 447
Quote:
Originally Posted by marcomsousa View Post
Excelent post
And +2



Quote:
Originally Posted by SmilingWolf View Post
fight between Rider and Saber for whoever knows what I'm talking about
The original visual novel is better.

(and that's not all all because I've had a hand with some of the media stuff in the latest and upcoming unofficial English PC versions of "Fate/stay night Realta Nua", nope no way what 'choo talkin' bout Willis you crazy)
Nintendo Maniac 64 is offline   Reply With Quote
Old 22nd September 2018, 08:33   #1004  |  Link
NikosD
Registered User
 
Join Date: Aug 2010
Location: Athens, Greece
Posts: 2,901
Quote:
Originally Posted by Tommy Carrot View Post
If anyone is curious how the encoding speed improved in the last half year or so, here's a little comparison between the different versions:
Code:
  version   | enc time  | filesize
0.1.0-9348  |    152    |  183494
.
.
1.0.0-629   |     15    |  184616
It seems it's an order of magnitude faster.

10 times faster is a lot, but obviously it has further big margins to improve.

I wonder how long is going to take for another 10 times improvement.
__________________
Win 10 x64 (19042.572) - Core i5-2400 - Radeon RX 470 (20.10.1)
HEVC decoding benchmarks
H.264 DXVA Benchmarks for all
NikosD is offline   Reply With Quote
Old 22nd September 2018, 09:20   #1005  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by Nintendo Maniac 64 View Post
I'd have you fight me IRL for dissing anything ufotable, but that evened out after you gave me a reason to install FSN again
(And for being on the first line in the works, thanks to y'all for what you do!)

Also, the pre-edit "the original visual novel from 2004" was just fine, I didn't choose FSN just because the clips look good

Quote:
Originally Posted by NikosD View Post
I wonder how long is going to take for another 10 times improvement.
That's an interesting question.
The 0.1.0-9348 build is from April, so that's 146 days between the first and the last tested build. Now, of course these things don't really follow a linear time-optimization correlation, buuuuut I wonder where we'll be in another 4 months
Maybe they'll get cpu-used=4 on par (speed wise) with x265's placebo-and-then-slowed-down-some-more, using the no-wpp etc. etc. settings benwaggoner suggested a few pages ago, which in my limited testing came around at half aomenc's time a week or two ago.
Also rav1e might become a real game changer for av1 encoding in the same timeframe. I surely hope so.

And a small heads up, Video Dev Days have officially begun, and today they're going to showoff dav1d, their very own decoder!

Exciting times ahead!

Last edited by SmilingWolf; 22nd September 2018 at 10:06.
SmilingWolf is offline   Reply With Quote
Old 22nd September 2018, 09:35   #1006  |  Link
Selur
Registered User
 
Selur's Avatar
 
Join Date: Oct 2001
Location: Germany
Posts: 7,259
Quote:
And a small heads up, VideoLAN Developer Days have officially began, and today they're going to showoff dav1d, their very own encoder!
decoder not encoder
according to: https://www.videolan.org/videolan/ev...dd18/#saturday
__________________
Hybrid here in the forum, homepage
Selur is offline   Reply With Quote
Old 22nd September 2018, 09:40   #1007  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Aye, caffeinated typo slipped in. Corrected, thanks!

EDIT: in the meantime, the presentation has finished. Does anyone know if there's a livestream or at least a youtube channel where they upload stuff as they go?
SmilingWolf is offline   Reply With Quote
Old 22nd September 2018, 09:48   #1008  |  Link
nevcairiel
Registered Developer
 
Join Date: Mar 2010
Location: Hamburg/Germany
Posts: 10,344
Quote:
Originally Posted by SmilingWolf View Post
EDIT: in the meantime, the presentation has finished. Does anyone know if there's a livestream or at least a youtube channel where they upload stuff as they go?
Unfortunately, I don't think so. Its rather hilarious that a open-source multimedia conference can't figure out streaming or at least on-demand videos afterwards.
__________________
LAV Filters - open source ffmpeg based media splitter and decoders
nevcairiel is offline   Reply With Quote
Old 22nd September 2018, 14:49   #1009  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 203
dav1d source code
https://code.videolan.org/videolan/dav1d
Mr_Khyron is offline   Reply With Quote
Old 22nd September 2018, 15:14   #1010  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by Mr_Khyron View Post
Uwheee!

dav1d-0.0.1-7-bb521ef9: https://mega.nz/#!w9xlxZpT!_KfDw7rp9...aHkG8eJgoHLwrg
EDIT: botched on Windows because of the usual open(file, "r") bug. Needs to be open(file, "rb") for binary objects, lest files be treated as text and the input mangled.
Will submit a patch ASAP
EDIT2: https://code.videolan.org/videolan/d...uests/12/diffs

Last edited by SmilingWolf; 22nd September 2018 at 16:19.
SmilingWolf is offline   Reply With Quote
Old 22nd September 2018, 15:48   #1011  |  Link
Zebulon84
Registered User
 
Join Date: Apr 2015
Posts: 21
Previous Video Dev Days conferences are available on Vimeo so I guess it will be the same for 2018. But videos for 2017 Video Dev Days were posted last may, so we may have to wait quite a while.
Zebulon84 is offline   Reply With Quote
Old 22nd September 2018, 19:00   #1012  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
Quote:
Originally Posted by Zebulon84 View Post
Previous Video Dev Days conferences are available on Vimeo so I guess it will be the same for 2018. But videos for 2017 Video Dev Days were posted last may, so we may have to wait quite a while.
possibly, the 2016 ones were posted on their youtube channel in a timely manner: https://www.youtube.com/user/VideoLANorg/videos
hajj_3 is offline   Reply With Quote
Old 23rd September 2018, 04:28   #1013  |  Link
Nintendo Maniac 64
Registered User
 
Nintendo Maniac 64's Avatar
 
Join Date: Nov 2009
Location: Northeast Ohio
Posts: 447
Now the wait begins for dav1d to be implemented into LAVfilters and for my low multi-threaded utilization woes to be gone once and for all!

...please tell me I'm not being overly optimistic by saying that? The way I see it, a Xeon x3470 shouldn't be all too different from the likes of an i7-8550U seeing as the Xeon has a ~33% IPC deficit while the i7 has a ~33% clockrate deficit, so the end result should be pretty similar (not counting AVX anyway).

I mean, if its too slow on an i7-8550U, then it'll be too slow for almost all laptops in existence except for maybe those 6core i9 laptops and those crazy gamer/professional laptops that have full-fat desktop CPUs like that Asus with a Ryzen 1700.




Quote:
Originally Posted by SmilingWolf View Post
you gave me a reason to install FSN again
Just as long as it's that upcoming "merge project" mentioned on the last couple of pages at the end of the linked thread, otherwise I'll never forgive you.

(to clarify, the original visual novel only renders at 800x600 while this "merge project" will have HD visuals and high-res text - that alone should make it a no-brainer)


Quote:
Originally Posted by SmilingWolf View Post
Also, the pre-edit "the original visual novel from 2004" was just fine
I only removed the "2004" text because I thought using "original" would be clearer to convey that the visual novel came before any think else Fate-related.
Nintendo Maniac 64 is offline   Reply With Quote
Old 23rd September 2018, 10:02   #1014  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
Quote:
Originally Posted by Nintendo Maniac 64 View Post
Now the wait begins for dav1d to be implemented into LAVfilters and for my low multi-threaded utilization woes to be gone once and for all!

...please tell me I'm not being overly optimistic by saying that? The way I see it, a Xeon x3470 shouldn't be all too different from the likes of an i7-8550U seeing as the Xeon has a ~33% IPC deficit while the i7 has a ~33% clockrate deficit, so the end result should be pretty similar (not counting AVX anyway).

I mean, if its too slow on an i7-8550U, then it'll be too slow for almost all laptops in existence except for maybe those 6core i9 laptops and those crazy gamer/professional laptops that have full-fat desktop CPUs like that Asus with a Ryzen 1700.
I'm afraid we're not quite there yet. Using my most CPU-intensive clip (PresageFlowerFight, 1080 encoded with as many tiles as possible) I have only been able to observe a 45% max utilization with --framethreads 8
My CPU is an i7-4770, with 4/8 cores

Some timings:
Code:
# time ./dav1d.exe --framethreads 8 -o /dev/null --muxer yuv4mpeg2 -i Fight.cq20.1080p.ivf 2> /dev/null

real    0m19,460s
user    0m0,000s
sys     0m0,000s

# time aomdec.exe --threads=8 -o /dev/null Fight.cq20.1080p.ivf

real    0m5,170s
user    0m0,000s
sys     0m0,000s
Right now dav1d is implemented in pure C and of course it shows. It'll be more interesting after ASM optimizations start trickling in.

EDIT: after playing a bit with the numbers I've been able to push the times down a bit further and CPU util higher (50-53% range):
Code:
# time ./dav1d.exe --framethreads 6 --tilethreads 2 -o /dev/null --muxer yuv4mpeg2 -i Fight.cq20.1080p.ivf 2> /dev/null

real    0m17,800s
user    0m0,000s
sys     0m0,000s
Quote:
Originally Posted by Nintendo Maniac 64 View Post
I only removed the "2004" text because I thought using "original" would be clearer to convey that the visual novel came before any think else Fate-related.
I see, I see

Last edited by SmilingWolf; 23rd September 2018 at 10:19.
SmilingWolf is offline   Reply With Quote
Old 23rd September 2018, 10:13   #1015  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,120
MPC-BE 1.5.2.3976 Beta has been released which can play my 1920x800 551kbps bitrate AV1 file that i have smoothly, used up to 46% cpu on core i3-7100U 2.4ghz

Link: https://sourceforge.net/projects/mpc...atest/download

Last edited by hajj_3; 23rd September 2018 at 10:16.
hajj_3 is offline   Reply With Quote
Old 23rd September 2018, 17:41   #1016  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,753
New uploads: (MSYS2; MinGW32: GCC 7.3.0 / MinGW64: GCC 8.2.0)

AOM v1.0.0-643-gaf3e5cc66

rav1e 0.1.0 (d330de0 / 2018-09-23)

dav1d 0.0.1 (5e05e65 / 2018-09-23)
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 24th September 2018, 12:24   #1017  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 80
AV1 already have 3 encoders and/or decoders, it's a good start..
__________________
AV1 win64 VS2019 builds
Last build here
marcomsousa is offline   Reply With Quote
Old 25th September 2018, 04:33   #1018  |  Link
olduser217
Registered User
 
Join Date: Jun 2015
Posts: 21
I heard that Ateme demonstrated 4k60 AV1 decoding on TV (seems like LG TV) during the recent IBC Show.
Anybody attended the show and saw it?
olduser217 is offline   Reply With Quote
Old 25th September 2018, 10:03   #1019  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 80
Quote:
Originally Posted by olduser217 View Post
I heard that Ateme demonstrated 4k60 AV1 decoding on TV (seems like LG TV) during the recent IBC Show.
Anybody attended the show and saw it?
At NAB Conference:

ATEME: Video
Other AOMedia: Video1 Video2 Video3 Video4
__________________
AV1 win64 VS2019 builds
Last build here
marcomsousa is offline   Reply With Quote
Old 25th September 2018, 14:17   #1020  |  Link
SmilingWolf
I am maddo saientisto!
 
SmilingWolf's Avatar
 
Join Date: Aug 2018
Posts: 95
32/64bits binaries:
av1-1.0.0-654-gd0076f507: https://mega.nz/#!kto20KoR!XbcrlXv7Q...lZx3X0tfeVwJx4

64bits binaries only (I don't have a 32bits toolchain in my MSYS2 env):
dav1d-0.0.1-37-9075f0e: https://mega.nz/#!co5wFQyQ!EZhG33K4z...mdYdPPtDJqCWBw

The dav1d build has been patched so that the input/output files are opened in binary mode, for the reasons previously explained. Band-aid solution until the PR is accepted upstream.
SmilingWolf is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 20:46.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2024, vBulletin Solutions Inc.