JVC GS-TD1 MVC .mp4 stream

[mariner]

Here is a sample of MVC stream recorded by the new JVC GS-TD1 3D camcorder. It seems to be in 1920x1080/59.94i frame-sequential format. Can anyone tell how it differs from the x264 --frame packing 5 SEI format and if it can be played successfully on 3D displays?

Many thanks and best regards.

http://av.watch.impress.co.jp/video/avw/docs/424/208/ez0027_s.jpg
ez0027.mp4
(http://av.watch.impress.co.jp/video/avw/docs/424/208/ez0027.mp4)

【小寺信良の週刊 Electric Zooma!】第500回：新しい潮流を作るか、二眼3DカムコーダJVC「GS-TD1」 -AV Watch (http://av.watch.impress.co.jp/docs/series/zooma/20110202_424208.htm)

[nm]

Can anyone tell how it differs from the x264 --frame packing 5 SEI format and if it can be played successfully on 3D displays.

It's MVC, so plain-old AVC decoders only get one of the views. You need an MVC decoder to view both.

x264 --frame-packing 5 encodes both views sequentially as normal AVC. Therefore an AVC decoder (but preferably one that supports the frame packing SEI) is sufficient for playback.

[mariner]

Thanks nm. Did you analyze the clip?

[nm]

Thanks nm. Did you analyze the clip?

Not really, I don't have tools that support MVC. What more would you like to know about it?

[mariner]

As I said, it looks rather like frame sequential.

The MVC found on 3DBD has two streams, one for each eye.

The JVC clip is only single stream. How does one do MVC with single stream?

[mediator]

How does one do MVC with single stream?

... by implementing the latest version of ISO 14496-15 (File Format spec for AVC) from 2010, which defines how to store MVC into a (single) MP4 track. To a non MVC-aware parser/decoder it appears like a normal 2D AVC stream. It's the beauty of MVC vs. the frame-sequential 3D approach, where special treatment is needed to achieve 2D backward compatibility.

[rica]

... by implementing the latest version of ISO 14496-15 (File Format spec for AVC) from 2010, which defines how to store MVC into a (single) MP4 track. To a non MVC-aware parser/decoder it appears like a normal 2D AVC stream. It's the beauty of MVC vs. the frame-sequential 3D approach, where special treatment is needed to achieve 2D backward compatibility.

For the time being free MVC Decoder is able to decode extracted streams only.
And i don't know how to extract right +left views from an mp4? (btw i'm not sure it's a real 3D?)
Stereoscopic player never recognizes it as 3D.

[nm]

Stereoscopic player never recognizes it as 3D.
Of course not without a suitable MVC decoder.

[mariner]

... by implementing the latest version of ISO 14496-15 (File Format spec for AVC) from 2010, which defines how to store MVC into a (single) MP4 track. To a non MVC-aware parser/decoder it appears like a normal 2D AVC stream. It's the beauty of MVC vs. the frame-sequential 3D approach, where special treatment is needed to achieve 2D backward compatibility.

Thanks for the kind reply, mediator.

1. Does the JVC mp4 clip conform to the ISO 14496-15 format?
2. Can TMT and PDVD software handle such format?
3. Can media player using TMT and PDVD decoders handle such format? Are special splitters needed?

Many thanks and best regards.

[mediator]

1. Does the JVC mp4 clip conform to the ISO 14496-15 format?

Yes.

Are special splitters needed?

Yes. The splitter needs to be able to read the extra MVC configuration, which is stored inside a new atom/box. But it is possible to use the existing AVC DirectShow mediatype for connecting splitter and decoder, as the MVC decoder configuration can just be appended to the AVC decoder configuration. I tried this with the Win 7 system decoder and ffdshow, which both just ignore the MVC part of the configuration, as expected. So it wholly depends on the decoder if it wants to / can do stereo or not.

[mariner]

....So it wholly depends on the decoder if it wants to / can do stereo or not.

So an MVC aware decoder such as TMT or PDVD will decode this and output in stereo format, say in MPC? If so, in what format?

[mediator]

Seems rather unlikely that any existing MVC-capable decoder filter can produce proper 3D output within an "out-of-the-box" MPC. The reason is that afaik there is no (at least not yet) standardized way of decoders talking to (3D) renderers (i.e. mediatype format, sample exchange format; there is a separate thread about this). Most likely any current solution would be a specially customized solution (decoder and renderer dependent on each other).

[mariner]

Perhaps Pete Wimmer's Stereoscopic Player?

[vsv]

Any news about reencoding MVC/mp4 from GS-TD1 ? May be possible to remux into SSIF?
Peter Wimmer released last SP 1.6.9 with support SSIF. Player used SDK from CoreAVC/MVC.

[mariner]

No word from Pete as yet...

[colinhunt]

Would anyone be interested in coding a conversion app which takes the streams from JVC-shot MP4/MVC files and outputs them into two separate files? I can pay something for it.

[kieranrk]

Would anyone be interested in coding a conversion app which takes the streams from JVC-shot MP4/MVC files and outputs them into two separate files? I can pay something for it.

Post this on the ffmpeg or libav mailing lists.

[colinhunt]

Post this on the ffmpeg or libav mailing lists.
Thanks, I'll look into it.

[Ghitulescu]

.... if it can be played successfully on 3D displays?

I assume only using the camcorder as a 3D player ...

[mariner]

Sony's version of 3D MVC video.

http://dl.dropbox.com/u/28877157/00004.MTS
http://memepuffs.com/indoor.MTS
http://memepuffs.com/outdoor.MTS

[kieranrk]

Sony seem to have botched MVC implementations. Lots of the syntax elements aren't allowed in MVC.

[mariner]

Revision 3105 - Directory Listing
Modified Sat May 14 13:17:13 2011 UTC (3 days, 15 hours ago) by casimir666

Add MVC parsing support


Two different MVC implementations?

Latest MPC identifies two video streams in the Sony sample, but only one in the JVC sample.


May 17th, 2011

Stereoscopic Player version 1.7.2 is now available for download. It supports the Sony HDR-TD10 and JVC GS-TD1 3D camcorders.


SSP claims support for both.

[samfednik]

Sony's version of 3D MVC video.

http://dl.dropbox.com/u/28877157/00004.MTS

I tried to make this movie a half overunder video with 60 frames/second separated the field AviSynth script.
Also a little parallax corrected to reduce ghosting.
The result is super smooth in 3D, compare with the original:
http://narod.ru/disk/42509090001.da25bab49089c4ba6010f5194c882d1d/00004_Shift-abq.mkv.html

P.S.: this is the Google Translator. I myself am from Russia.