Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > VP9 and AV1

Reply
 
Thread Tools Search this Thread Display Modes
Old 14th January 2021, 21:14   #2381  |  Link
Blue_MiSfit
Derek Prestegard IRL
 
Blue_MiSfit's Avatar
 
Join Date: Nov 2003
Location: Los Angeles
Posts: 5,816
Another aspect of VR is that when it comes to pre-produced content you're effectively rendering a 360 degree scene and then using equirectangular projection to fit that into a standard video frame size. During playback the player wraps that video inside a sphere and drops your viewport inside of that sphere. This means that you actually look at a small piece of the video. With a ~4K video and a ~2.5K head mounted display / headset with a typical FOV you're going to be looking at maybe 1/4 of the encoded resolution. The player of course has to upscale to hit the native HMD display. All of this means that you're basically watching sub HD video on a very dense screen as close as your eyes can focus

360 video is generally pretty boring, but to really maximize the potential you'd basically want a 16k video. Some companies (Pixvana) tried to get around this by cutting the video into slices and only streaming one or two at a time. This theoretically lets you get higher resolution during playback and lower bandwidth (since you're not streaming / decoding / processing everything you can't see). Ultimately 360 video just does not scale though, and the lack of parallax is disturbing and uncomfortable for many. Here's hoping for lots of neat developments in light field capture, compression, and delivery. The guys at Lytro were doing wild and crazy stuff a few years ago before they ran out of money. I wonder what Google is doing with all that IP...
Blue_MiSfit is offline   Reply With Quote
Old 15th January 2021, 19:24   #2382  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,646
Yeah, I've got ~7 patents on VR encoding and playback, and it's not something I see a way to make work for customers for scripted content. Video games are obviously a good fit for some genres, and some experiences more like museum curation can be great. But VR is mainly a new thing, not a new way to deliver old things.

And video quality is at least 15 years behind what we can do with a 2D flat screen.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 17th January 2021, 14:57   #2383  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,018
Google to require all new android tv device model released after march 31st 2021 must include AV1 decode support: https://www.xda-developers.com/googl...ideo-decoding/

We will therefore see all new android tv box models having support and also some tv's also use android tv so they will support av1 too.
hajj_3 is offline   Reply With Quote
Old 18th January 2021, 10:06   #2384  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 186
Quote:
Originally Posted by Blue_MiSfit View Post
Here's hoping for lots of neat developments in light field capture, compression, and delivery. The guys at Lytro were doing wild and crazy stuff a few years ago before they ran out of money. I wonder what Google is doing with all that IP...
I asked a VFX industry vet who worked on The Jungle Book about lightfield camera tech at a 3D animation and VFX conference held at our uni.

His impression was that it was potentially amazing (especially for potentially rendering green screen filming redundant), but that the processing and storage hardware was reminiscent of the early days of computers size wise, and not at all practical for production film use at that time (this was maybe early 2018).

Google may well be simply concentrating on downsizing the technologies problems at the moment.

Decreasing compute and storage demands to a reasonable level would go a long way towards making it viable for wider use, even if just for the VFX industry to begin with.

OTOH if Lytro's patents are broad enough they may just be sitting back and waiting for a gold mine to mature when some other company does all that R&D heavy lifting for them.

As someone who had to monkey about with messy green screen footage in NUKE I'm definitely excited by the possibilities in lightfield capture - though I would probably settle for just high res depth map data captured for each frame of video.
soresu is offline   Reply With Quote
Old 19th January 2021, 18:11   #2385  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,646
Quote:
Originally Posted by soresu View Post
I asked a VFX industry vet who worked on The Jungle Book about lightfield camera tech at a 3D animation and VFX conference held at our uni.

His impression was that it was potentially amazing (especially for potentially rendering green screen filming redundant), but that the processing and storage hardware was reminiscent of the early days of computers size wise, and not at all practical for production film use at that time (this was maybe early 2018).

Google may well be simply concentrating on downsizing the technologies problems at the moment.
Lytro ramped down all their feature film R&D after they were acquired. Whatever Google is doing with them, it's not trying to create the next Panavision or Arri.

The stuff was really complex on-set. It made early 3-strip Technicolor look simple. And while some components could be shrunk down, fundamentally you need a lot of lenses over a pretty wide area for the tech to work.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 19th January 2021, 21:44   #2386  |  Link
soresu
Registered User
 
Join Date: May 2005
Location: Swansea, Wales, UK
Posts: 186
Quote:
Originally Posted by benwaggoner View Post
The stuff was really complex on-set. It made early 3-strip Technicolor look simple. And while some components could be shrunk down, fundamentally you need a lot of lenses over a pretty wide area for the tech to work.
Metalens tech developments might solve the lens problem.

They not only increase the versatility of lenses (much lighter, thinner, and even achromatic focusing in a single lens element) but make them much easier to manufacture en masse.

Making a metalens is more like manufacturing a computer chip with photolithography processes, rather than the cutting and polishing of conventional curved lenses used today.

It makes sense to make a big change all at once for lightfield capture considering LF itself is a big change from conventional camera technology - might as well make a clean break.
soresu is offline   Reply With Quote
Old 19th January 2021, 22:47   #2387  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,646
We should probably start a "Encoding for VR" thread.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 27th January 2021, 11:32   #2388  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,018
PotPlayer 1.7.21419 released today adds support for DXVA hardware decoding of AV1.
hajj_3 is offline   Reply With Quote
Old 27th January 2021, 21:43   #2389  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,646
Quote:
Originally Posted by hajj_3 View Post
PotPlayer 1.7.21419 released today adds support for DXVA hardware decoding of AV1.
The version on their site is still from September 2020. Where are you finding daily builds?
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 27th January 2021, 21:58   #2390  |  Link
hajj_3
Registered User
 
Join Date: Mar 2004
Posts: 1,018
Quote:
Originally Posted by benwaggoner View Post
The version on their site is still from September 2020. Where are you finding daily builds?
The version on their website is the new version, they just haven't updated the changelog on their website yet.
hajj_3 is offline   Reply With Quote
Old 30th January 2021, 13:20   #2391  |  Link
Yups
Registered User
 
Join Date: Sep 2011
Posts: 291
Quote:
Originally Posted by hajj_3 View Post
PotPlayer 1.7.21419 released today adds support for DXVA hardware decoding of AV1.

They should add D3D11 as well.
Yups is offline   Reply With Quote
Old 17th February 2021, 12:57   #2392  |  Link
LigH
German doom9/Gleitz SuMo
 
LigH's Avatar
 
Join Date: Oct 2001
Location: Germany, rural Altmark
Posts: 6,399
New uploads: (MSYS2; MinGW32 / MinGW64: GCC 10.2.0)

AOM v2.0.1-1254-gdb9ae9d7a

rav1e 0.5.0-alpha (1869a8b2 / 2021-02-15)

dav1d 0.8.1-70 (gb768fdb / 2021-02-15)

avif 0.8.4-ac14571
dav1d [dec]:0.8.1-61-g2e73051, aom [enc/dec]:2.0.1-1224-g89fc93496, rav1e [enc]:0.4.0 (p20210202-11-gbc17f485)
__________________

New German Gleitz board
MediaFire: x264 | x265 | VPx | AOM | Xvid
LigH is offline   Reply With Quote
Old 22nd February 2021, 12:56   #2393  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 79
dav1d 0.8.2 'Eurasian hobby' the fast and lean AV1 decoder

This is a middle-size update of the dav1d decoder, from the 0.8.x branch.This release adds most of the remaining NEON optimizations for ARM, especially for 10/12bit bitdepth, in both ARM32 and ARM64.This release also split the post-filters into their own threads.

This release speeds up quite a bit the desktop version, notably in the coefficient decoding and the MSAC parts. It also introduces the first 10bit optimizations for x86.

Finally, this release improves the speed in numerous parts of the decoder, improves the player shipped and brings other fixes.



Marco Sousa
__________________
AV1 win64 VS2019 builds
Last build here

Last edited by marcomsousa; 22nd February 2021 at 22:18.
marcomsousa is offline   Reply With Quote
Old 23rd February 2021, 12:34   #2394  |  Link
marcomsousa
Registered User
 
Join Date: Jul 2018
Posts: 79
Avif feature in Firefox next release will been delayed because of an important bug.

Marco Sousa
__________________
AV1 win64 VS2019 builds
Last build here

Last edited by marcomsousa; 24th February 2021 at 14:07.
marcomsousa is offline   Reply With Quote
Old 19th March 2021, 03:03   #2395  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 161
NETINT Announces the World’s First Commercially Available Hardware AV1 Encoder for the Data Center
https://netint.ca/netint-announces-t...e-data-center/
Mr_Khyron is offline   Reply With Quote
Old 19th March 2021, 06:00   #2396  |  Link
benwaggoner
Moderator
 
Join Date: Jan 2006
Location: Portland, OR
Posts: 3,646
Quote:
Originally Posted by Mr_Khyron View Post
NETINT Announces the World’s First Commercially Available Hardware AV1 Encoder for the Data Center
https://netint.ca/netint-announces-t...e-data-center/
Wow, their web page seems so atavistic. They're talking about replacing SW for ASIC encoding for advanced encoders. It's like rewinding the last 20 years of compression evolution.

In general, the more complex the codec, the bigger advantage SW encoders have had in quality over HW. AV1 is the most complex video codec, ever. It's hard for me to imagine how an ASIC could deliver competitive quality.

But maybe they've found magic! I look forward to seeing its output.
__________________
Ben Waggoner
Principal Video Specialist, Amazon Prime Video

My Compression Book
benwaggoner is offline   Reply With Quote
Old 23rd March 2021, 21:22   #2397  |  Link
VincAlastor
Registered User
 
Join Date: Sep 2009
Location: Berlin
Posts: 168
Does someone know why there is no SVT-AV1 release since [0.8.6] - 2020-11-28? Also auto builds are no longer published since 2021-02-16.
VincAlastor is offline   Reply With Quote
Old 24th March 2021, 01:26   #2398  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 161
https://aomedia.googlesource.com/aom/+/v3.0.0
Quote:
Release v3.0.0 Braeburn

2021-03-23 v3.0.0 Braeburn

This release includes compression efficiency improvement, speed improvement
for realtime mode, as well as some new APIs.

- Upgrading:

Support for PSNR calculation based on stream bit-depth.

New encoder control IDs added:
- AV1E_SET_ENABLE_RECT_TX
- AV1E_SET_VBR_CORPUS_COMPLEXITY_LAP
- AV1E_GET_BASELINE_GF_INTERVAL
- AV1E_SET_ENABLE_DNL_DENOISING

New decoder control IDs added:
- AOMD_GET_FWD_KF_PRESENT
- AOMD_GET_FRAME_FLAGS
- AOMD_GET_ALTREF_PRESENT
- AOMD_GET_TILE_INFO
- AOMD_GET_SCREEN_CONTENT_TOOLS_INFO
- AOMD_GET_STILL_PICTURE
- AOMD_GET_SB_SIZE
- AOMD_GET_SHOW_EXISTING_FRAME_FLAG
- AOMD_GET_S_FRAME_INFO

New aom_tune_content enum value: AOM_CONTENT_FILM

New aom_tune_metric enum value: AOM_TUNE_VMAF_NEG_MAX_GAIN

Coefficient and mode update can be turned off via
AV1E_SET_{COEFF/MODE}_COST_UPD_FREQ.

New key & value API added, available with aom_codec_set_option() function.
Scaling API expanded to include 1/4, 3/4 and 1/8.

- Enhancements:

Better multithreading performance with realtime mode.

New speed 9 setting for faster realtime encoding.

Smaller binary size with low bitdepth and realtime only build.

Temporal denoiser and its optimizations on x86 and Neon.

Optimizations for scaling.

Faster encoding with speed settings 2 to 6 for good encoding mode.

Improved documentation throughout the library, with function level
documentation, tree view and support for the dot tool.

- Bug fixes:
Aside from those mentioned in v2.0.1 and v2.0.2, this release includes the
following bug fixes:

Issue 2940: Segfault when encoding with --use-16bit-internal and --limit > 1

Issue 2941: Decoder mismatch with --rt --bit-depth=10 and --cpu-used=8

Issue 2895: mingw-w64 i686 gcc fails to build

Issue 2874: Separate ssse3 functions from sse2 file.
Mr_Khyron is offline   Reply With Quote
Old 30th March 2021, 21:20   #2399  |  Link
Mr_Khyron
Member
 
Mr_Khyron's Avatar
 
Join Date: Nov 2002
Posts: 161
http://downloads.aomedia.org/assets/...-%20Q12021.pdf


NETINT Technologies Joins the Alliance for Open Media
https://aomedia.org/press%20releases...or-open-media/

Last edited by Mr_Khyron; 30th March 2021 at 23:50.
Mr_Khyron is offline   Reply With Quote
Old 3rd April 2021, 11:28   #2400  |  Link
Marsu42
Huba Huba
 
Marsu42's Avatar
 
Join Date: Aug 2005
Location: Palumbian Jungle
Posts: 89
Quote:
Originally Posted by VincAlastor View Post
Does someone know why there is no SVT-AV1 release since [0.8.6] - 2020-11-28? Also auto builds are no longer published since 2021-02-16.
Rumor has it that it's due to the bus factor.
__________________
"The innocent have nothing to fear" :stupid:
Marsu42 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 04:36.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, vBulletin Solutions Inc.