Guide to convert BD 3D to 3D Left+Right Stereoscopic and Anaglyph

[Neisklar]

did a little test
combined raw bitstream opened in graphstudio
http://i.imgur.com/R4cae.jpg

Where did you get that DirectShowFilter?

OK, nice explanation. BUT, IMO, it's too much work and a too long process to be a practical solution.

Yeah, it's not meant to be a general solution, since it needs space und time. It's just an alternative for some really problematic movies.
It's also not optimized for speed, it uses code from ldecod converted to delphi. Was just for playing around with bitstream interleaving, i'm even not sure if the combined bitstream is absolutly spec conform in the order of that NALUs.

For Good news it's very very good news :D nice nice nice
Remux stereo to one AVC+MVC stream "combined.h264"

I suggest
- Possible to use "CombineMVC.exe" in cmd
- Add Export to mts, m2ts, ts, mkv, mp4, avi
- Complile to "CombineMVC_x64.exe"
- Increase speed optimization if not include (mmx,sse,3D Now, etc...)
- Remaning time

PS: Very Very good news, thank you for your work ;)

Most of that things aren't won't gonna happen, sorry, i'm lacking the skills.
Commandline version, ok no problem. Creating different containers, if at all then only by calling external tools. For 64bit i would need to shift to c++ and i'm bad at c, or buy a newer delphi with 64bit support, ...

We need coders, so we can start the big 'free' decoder thing, which i mentioned earlier, where this stuff is part of.
(BTW: that combined bitstream could even be fed through ldecod, after fixing a small bug in ldecod's source)
Maybe madshi could also be convinced to give out the demuxing code, ...

[frencher]

@Neisklar

What minimal version of Delphi do you need for these optimizations ?

[Neisklar]

@Neisklar

What minimal version of Delphi do you need for these optimizations ?

With XE2 at least i can create 32bit OSX and 32 and 64bit Windows executables. You don't need to search, i have an XE2 at hand, but just not officially. It's planned to upgrade to XE3 in the next time (if my boss pays the upgrade), but Embarcadero still isn't able to provide some details about some needed features.
And I'm not sure if 64bit really speeds things up. I think the way the "Annex B" bytestream-parser is done in ldecod is the speedlimit.
The processorspecific optimisations are hopefully done by the compiler, since i don't have a clue of that stuff;-)

So, it should be relativly easy to create an quick'n'dirty commandline version, since i could reuse most of the code. Maybe that version is then already quicker. Dunno if i got time today, to much projects at work for to few hours.

[Wolfy59]

hello all and thanks for all the work you do here.
I have a little problème with the new DirectShowMVCSource.dll
I want to use it to create 2 raw mkv and use them to cinevision.
So I created this 2 script

left eye

loadPlugin("DirectShowMVCSource.dll")
video=DirectShowMVCSource("G:\BDMV\STREAM\00800.m2ts", decodeleft=true)
AssumeFPS(video,"ntsc_film")
return video

and right eye

LoadPlugin("DirectShowMVCSource.dll")
video=DirectShowMVCSource("G:\BDMV\STREAM\00800.m2ts")
AssumeFPS(video,"ntsc_film")
return video

When i load them I have a violation access error in line 2 and I can do nothing.
So i want to know where s my error

Thanks for the answers

[frencher]

@Neisklar
Strongly update ;)

@Wolfy59
Before extract Left.h264 and Right.h264 tracks of you mpls with eac3to

Combine the result with "CombineMVC.exe"
Remux "combinedMVC.h264" to "combinedMVC.ts" with TsMuxer and after

Script AVS
loadPlugin(".\DirectShowMVCSource.dll")
left = DirectShowMVCSource(".\combinedMVC.ts", decodeleft=true)
right = DirectShowMVCSource(".\combinedMVC.ts")
video = StackHorizontal(left, right).BicubicResize(1920,1080).AssumeFPS(24000, 1001)
return video

[Neisklar]

left eye

loadPlugin("DirectShowMVCSource.dll")
video=DirectShowMVCSource("G:\BDMV\STREAM\00800.m2ts", decodeleft=true)
AssumeFPS(video,"ntsc_film")
return video

and right eye

LoadPlugin("DirectShowMVCSource.dll")
video=DirectShowMVCSource("G:\BDMV\STREAM\00800.m2ts")
AssumeFPS(video,"ntsc_film")
return video


From the BDMV\STREAM\ part of the sourcefile part, i assume you want to open an 3D BluRay?
Then you need to open the SSIF File.

The bitstream combining thing is only for certain rare cases of multi-ssif movies, and other sources which provide seperated streams.

[r0lZ]

I'm also interested in a CLI version of CombineMVC.

And it would be nice if it could work with named pipes. That way, at least the disc size will be less important. (I don't know if eac3to can demux to named pipes, and if tsMuxeR can get its input streams from named pipes, but it it's the case, I can write a GUI to output directly the combined TS file from the BD, without having to launch several apps and write large temp files to disc.)

[frencher]

@r0lZ
Same Idea lol ;)

@Neisklar
"CombineMVC.exe" uses the same standard as SONY 3D Camcorder (mts) ?

[Neisklar]

I'm also interested in a CLI version of CombineMVC.

And it would be nice if it could work with named pipes. That way, at least the disc size will be less important. (I don't know if eac3to can demux to named pipes, and if tsMuxeR can get its input streams from named pipes, but it it's the case, I can write a GUI to output directly the combined TS file from the BD, without having to launch several apps and write large temp files to disc.)

Should be possible, afaik EVERY program that uses standard windows api file handling can read and write to a named pipe, if the other process opened it. So only one side must be pipe aware and create it and voila it works. It should even work over the network.

So it should possible to pipe all 3 steps together eac3to, combine, and tsmuxer

@r0lZ
Same Idea lol ;)

@Neisklar
"CombineMVC.exe" uses the same standard as SONY 3D Camcorder (mts) ?

No it only uses and produces raw .264 bytestreams, no container format support

[r0lZ]

Should be possible, afaik EVERY program that uses standard windows api file handling can read and write to a named pipe, if the other process opened it. So only one side must be pipe aware and create it and voila it works. It should even work over the network.

So it should possible to pipe all 3 steps together eac3to, combine, and tsmuxer
Great! Honestly, I know nothing about named pipes, but if you can do the hard job, that would be very nice! ;)

[Eseninzhiv]

Neisklar
Where did you get that DirectShowFilter?
MainConcept H.264 v.9.5.7.1886 * (DirectShow with DXVA2; AVC-Intra & MVC Blu-Ray 3D support)
here http://codec.kiev.ua/mpeg4.html section MPEG-4 AVC / H.264 Software DEcoders

[frencher]

No it only uses and produces raw .264 bytestreams, no container format support

I mean in the output file (combinedMVC.h264) :p

[Neisklar]

I mean in the output file (combinedMVC.h264) :p

I don't have a clue waht sony produces, do you have a sample file to download and inspect?

The order of that NALUs from the two streams is mainly the same as the one Intel Media SDK MVC Encoder produces, so for each picture: first all NALUs from main stream, then all NALUs from dependent stream.
It may that i have misunderstood the MVC spec, but thats not 100% conformant, but ldecod, corecodec, intel media sdk decoder and so on, can decode it.

[frencher]

SONY MVC 3D Samples (http://forum.doom9.org/showpost.php?p=1501677&postcount=20)

[Neisklar]

SONY MVC 3D Samples (http://forum.doom9.org/showpost.php?p=1501677&postcount=20)

OK thanks.

That are normal MPEG-Transportstreams with a full AVC base view stream and a MVC-Subset stream, just like a 3D BluRay (except this time in one m2ts container) (.mts is the shortform of m2ts) So you can and could already open that files with ssifSource2 and/or SirectShowMVCSource.

[frencher]

OK it's Same

[Wolfy59]

From the BDMV\STREAM\ part of the sourcefile part, i assume you want to open an 3D BluRay?
Then you need to open the SSIF File.

The bitstream combining thing is only for certain rare cases of multi-ssif movies, and other sources which provide seperated streams.

Thanks Neisklar and Frencher for your answers

[Eseninzhiv]

tell me please
why filter MainConcept MVC/AVC/H.264 Video Decoder not decode the MVC file ?
just a black screen http://i.imgur.com/GcMFY.png

how to build filters to graphstudio so as to obtain a separate (left eye, right eye) input with combinedMVC.h264?
http://i.imgur.com/Gx0KH.jpg

[Neisklar]

tell me please
why filter MainConcept MVC/AVC/H.264 Video Decoder not decode the MVC file ?
just a black screen http://i.imgur.com/GcMFY.png

how to build filters to graphstudio so as to obtain a separate (left eye, right eye) input with combinedMVC.h264?
http://i.imgur.com/Gx0KH.jpg

The right eye, or MVC Subset stream can't be decoded without the base view (stream), since it depends on that.

Edit:

There are two different types of MVC bitstreams. The combined one where the base and the dependent view are in the same bitstream, and then a seperate bitstream in which only the NALUs from the second view are present. Both types share that the second view is ALWAYS dependent of the base view, and can't bereconstructed without it, since the dependent view only stores the differences to the base view.

The combined stream is even backwards compatible, cause a non-MVC capable decoder just ignores the MVC part, and only 'sees' a normal H.264 stream.

[frencher]

@Wolfy59
You are welcome ;)

[samfednik]

People, I think I realized what was missing in the graph, to extract the "raw h264 Left and right raw h264". And it works! (Tested on 2 different 3DBD)
Look at the following graph, it adds MVC-Muxer and everything works, and how it can help us? (I register these dll manually, and Sonic = Mainconcept :-)

http://i48.fastpic.ru/big/2012/1112/20/a752ef1cb2f7d5ecaee2bb1788d70020.png

Maybe even be able to do on such a graph of raw h264/MVC?

http://i48.fastpic.ru/big/2012/1112/44/db3c7e36258aa2d7fdb3fc7f06dad844.png

should try Neisklar

[Eseninzhiv]

tell us how to manually register dll (Sonic = Maintsontsept)
and where can take Sonic MVC decoder?

[Neisklar]

should try Neisklar

I can and will try.

Could you please upload a small smaple of the created combinedMVC.h264 stream? I'm interested in in what order exactly this muxer puts the NALUs in the bitstream.

It all has one drawback:

It's all DirectShow, and DirectShow as source for Avisynth isn't the best combination.
The next question is, is that MainConcept codec free? Free to download, and free to use?

Thank you!

[frencher]

Mainconcept MVC (http://www.mainconcept.com/products/sdks/3d/mvc-sdk.html)

[frencher]

Stereoscopic Player don't play combinedMVC (Black Screen) into contenair:
- .mts

We just hear the audio track

[r0lZ]

There is a lot of changes in this version, and it may still have some bugs, but the known bugs in v0.11 have been fixed.

I've also modified the "Convert Subtitles to 3D" tool to work in batch mode. (Note that when you click the Abort button and Suppe3D is busy converting with BDSup2Sub, it doesn't show you immediately that the abort will happen, but it works.)

# v0.12 (November 12, 2012)
# - "Join SSIF files of current MPLS" tool is finished.
# - Batch mode for "Convert Subtitles to 3D"
# - Added timeout=60000*<number of SSIF files> in DirectShowMVCSource commands to try to avoid the DirectShow timeout problem.
# - Fix: Wrong part numbers in AVS script when using ssifSource2 with multi-story MPLS.
# - Fix: Multi-angle MPLS bug due to the (angle N) string in the eac3to output.
# - Fix: Added KillAudio() in AVS script with blank intro (without background image or text).
# - Fix: Better method to retrieve the number of frames of multi-story/angle MPLS.
# - Added the "Select All/None" button in tab 2 to select or deselect all audio & subtitle streams.
# - Added the "--fullscan" CLI argument to "Scan Full BD" when a BD folder is provided in the command line.
# - Added the hidden option ::config(TrueHD_ext) in the config file (for expert users only!) The option to keep only the core of the DTS audio tracks is now used also to control the True-HD AC3 tracks (when ::config(TrueHD_ext) is not ac3).
# - Wrapped with FreeWrap v6.4.2.4 instead of 6.4.2.5 as a workaround for the crash when changing the output folder to another drive in an Open File dialog.
# - Updated DirectShowMVCSource.dll to v0.7 in the toolset.

As you can see, I had to go back to FreeWrap v6.4.2.4 due to the file dialog crash when changing the drive in v6.4.2.5. AFAIK, v6.4.2.4 works well, but it has some drawbacks. For example, the Select Directory dialog is very small and cannot be resized, and it lacks the "New folder" button. Not a big deal imo.

Download BD3D2MK3D.7z (http://download.videohelp.com/r0lZ/BD3D2AVS/BD3D2MK3D.7z)

[Eseninzhiv]

Neisklar
The next question is, is that MainConcept codec free? Free to download, and free to use?
http://forum.doom9.org/showthread.php?p=1600324#post1600324

r0lZ
thanks for the release!

[Neisklar]

Stereoscopic Player don't play combinedMVC (Black Screen) into contenair:
- .mts

We just hear the audio track

Yeah, thats some problem in conjuction with the stf.dll Stereoplayer always uses. Thats why it also only work in DirectShowMCVSource without using stf,



http://forum.doom9.org/showthread.php?p=1600324#post1600324


I just need to ask again, since on the Mainconcept page i don't see any free codecs or SDKs for download:
(And the installer doesn't have any licence screen)

Are these Codecs build by a licensed mainconcept SDK which allow distribution? Where did that installer come from?

Thanks

@samfednik:

I also would like to know where you got your codecs, and are they free?

Thanks

[Eseninzhiv]

Where did that installer come from?
I do not know
Alf FreeWare VideoCODECs Collection

[frencher]

Yeah, thats some problem in conjuction with the stf.dll Stereoplayer always uses. Thats why it also only work in DirectShowMCVSource without using stf

OK Thank's ;)

[samfednik]

@samfednik:

I also would like to know where you got your codecs, and are they free?

Thanks

Hi, sorry for the delay... I do not remember what software I unpacked these filters seem TotalCode Professional.
Link to filter that uses software, they are free (may be wrong):
http://sendfile.su/708332
Register them manually.

PS: For the convenience of the register/unregister the dll and ax files from right click, create a text file with the following content:
Windows Registry Editor Version 5.00

[HKEY_CLASSES_ROOT\.dll]
"Content Type"="application/x-msdownload"
@="dllfile"
[HKEY_CLASSES_ROOT\dllfile]
@="Application Extension"
[HKEY_CLASSES_ROOT\dllfile\Shell\Register\command]
@="regsvr32.exe \"%1\""
[HKEY_CLASSES_ROOT\dllfile\Shell\UnRegister\command]
@="regsvr32.exe /u \"%1\""

[HKEY_CLASSES_ROOT\.ocx]
@="ocxfile"
[HKEY_CLASSES_ROOT\ocxfile]
@="OCX"
[HKEY_CLASSES_ROOT\ocxfile\Shell\Register\command]
@="regsvr32.exe \"%1\""
[HKEY_CLASSES_ROOT\ocxfile\Shell\UnRegister\command]
@="regsvr32.exe /u \"%1\""

[HKEY_CLASSES_ROOT\.ax]
@="axfile"
[HKEY_CLASSES_ROOT\axfile]
@="AX"
[HKEY_CLASSES_ROOT\axfile\Shell\Register\command]
@="regsvr32.exe \"%1\""
[HKEY_CLASSES_ROOT\axfile\Shell\UnRegister\command]
@="regsvr32.exe /u \"%1\""
Then rename it to file.reg and run. (tested on 32bit windows)

[Eseninzhiv]

Thanks, tested on win7 64bit, all filters registered.

[slavanap]

Should be possible, afaik EVERY program that uses standard windows api file handling can read and write to a named pipe, if the other process opened it. So only one side must be pipe aware and create it and voila it works. It should even work over the network.

No. Not every program can use pipes perfectly. With ldecod & eac3to I had problems to make them support pipes. Because, by default eac3to does not support pipes, and old version of ldecod crashes at the end of pipe, because ReadFile function returns different codes if pipe is closed and file is ended. See WinSDK for more info. You should fix ldecod code to make it support pipes (see at the end of file processing code).
The eac3to that support pipes you can grab from old ssifSource package.

P.S. I'm rather busy now. No time to support ssifSource rapidly.

[Wolfy59]

People, I think I realized what was missing in the graph, to extract the "raw h264 Left and right raw h264". And it works! (Tested on 2 different 3DBD)
Look at the following graph, it adds MVC-Muxer and everything works, and how it can help us? (I register these dll manually, and Sonic = Mainconcept :-)

Should try Neisklar

Hi samfednik How do you load the right.h264 in graphstudio
I have a Can t open file error here
Thanks

[samfednik]

2Wolfy59

Use "File Source(Async)" in GraphEdit(GraphStudio) and construct Graph manualy.

Graphedit works not only with raw h264 streams, as well as the files of the left/right m2ts and read directly from the disk image (ISO).
Somehow it does not work with ssif.
http://i47.fastpic.ru/big/2012/1114/e1/a0d38eb58fa03de992d253a9662b9de1.png

[Eseninzhiv]

how he managed to register this filter?
3dtv.at AVC/MVC Decoder (by CoreCodec)
http://forum.doom9.org/showthread.php?p=1509845#post1509845

he said to me in PM
I think new version doesn't allow to register the filter, sorry

http://i.imgur.com/qnbth.png

[samfednik]

2Eseninzhiv
He is not registered 3dtv.at AVC/MVC Decoder (by CoreCodec)
He is peeped and changed graph, used spy dll and remote connect in graphstudio.
RUS: Он не зарегестрировал его, а использовал фильтры-шпионы (длл-ки). Потом изменил Граф. Вот как строит Граф стереоскопик плеер используя свои фильтры.

http://forum.doom9.org/showthread.php?p=1588927#post1588927

[Wolfy59]

2samfednik

thanks for your answer i tried to make a graph to export raw right h264 stream by using the monoscopic stream right eye
output in the 3dtv.at stereo transformation, but i can't use the graph in my avs for megui

[frencher]

No division by 0 with "Prometheus" with "CombineMVC.exe" and last update of "DirectShowMVCSource.dll" :D

[Eseninzhiv]

how to use a plugin to create the raw video streams (left, right) in the format YUY2?
ldecod
BioMvc

[frencher]

how to use a plugin to create the raw video streams (left, right) in the format YUY2?
ldecod
BioMvc

It's old now and paying (BioMvc) ;)

[frencher]

Jeeez other soft Huuuuuu (http://www.pavtube.com/mts-converter)

[Eseninzhiv]

the best option (www.3dtv.at/Products/MvcConverter/Index_en.aspx)

BioMvc paying?

Left_EYE.avs
DirectshowSource("C:\left.m2ts", fps=23.976, framecount=181762, audio=false)
ConvertToYUY2().AssumeFPS(24000,1001)

Right_EYE.avs
LoadPlugin("C:\bioMVC.dll")
right=bioMVCH264Plugin("C:\bioMVC.set",xxxxxx).assumefps(24000, 1001)
comb=right
return comb

bioMVC.set
InputFile = "C:\left.h264"
InputFile2 = "C:\right.h264"
FileFormat = 0
POCScale = 1
DisplayDecParams = 1
ConcealMode = 0
RefPOCGap = 2
POCGap = 2
IntraProfileDeblocking = 1
DecFrmNum = 0

create the raw video streams (left, right)
one problem, I do not like
bioMVC.dll creates the right raw stream format YV12, i can not change that
I need YUY2 or .yuv
BioMvc (http://depositfiles.com/files/kr66u80py?redirect)
anybody can help to change the output format of the right stream?

[r0lZ]

Can you upload BioMvc.rar elsewhere?

[Eseninzhiv]

Now see what filters using MVC to AVI Converter

http://i.imgur.com/KBYku.png

post Betaboy from CoreCodec Founder from 2nd May 2012
And whar about CoreMVC? I know it will be a different product but what's the reason for the delay? Is it technical or licensing issues?

CoreMVC 3D has been available for OEM/Developer licensing for over a year now. As far as a consumer decoder however we felt it was more important to get the last remaining features in CoreAVC before releasing it since its 99% based on it.

So we'll continue our non consumer CoreMVC 3D licensing for now and revisit the consumer directshow filter after 4:2:2 is added in v3.5 (Noting my previous post that we are jumping to v3.5 after v3.1 when we add 4:2:2.).
will wait

[frencher]

the best option (www.3dtv.at/Products/MvcConverter/Index_en.aspx)

BioMvc paying?

Left_EYE.avs


Right_EYE.avs


bioMVC.set


create the raw video streams (left, right)
one problem, I do not like
bioMVC.dll creates the right raw stream format YV12, i can not change that
I need YUY2 or .yuv
BioMvc (http://depositfiles.com/files/kr66u80py?redirect)
anybody can help to change the output format of the right stream?

3DBDBuster from http://www.biohemmet.se is the owner of bioMVC.dll

[frencher]

@Neisklar

Is it possible to add the "Decombine" in your program "CombineMVC.exe" ?

[Eseninzhiv]

Is it possible to add the "Decombine" in your program "CombineMVC.exe" ?
why do you need it?

[frencher]

@Eseninzhiv
why do you need it?

Just to get the flow in case of need and in case of future upgrade of SSIFSOURCE, DirectShowMVCSource, etc...

[samfednik]

2Neisklar
2slavanap
Hi, is there any work on your own plugin MVC?
Maybe you can do until the plugin based on DirectShow filters from Sonic (Mainconcept)?
I tried to extract using graphedit raw YUV stream (or lossles compression), and it is interesting that the right thread, too, like CoreMVC.dll extracted by 1 frame less than the present in it. This similarity - rather strange...
But plus DirectShow filters from Sonic (Mainconcept) that they understand raw .h264
Ie we can extract eac3to continuous left/right h264 stream of the film mpls, when the film is divided into several SSIF.

Tested on MiB3 - results:
eac3to v3.24
command line: eac3to.exe p:\BDMV\PLAYLIST\00800.mpls 2:Left1.h264 3:Right1.h264
------------------------------------------------------------------------------
M2TS, 2 video tracks, 7 audio tracks, 6 subtitle tracks, 1:45:49, 24p /1.001
1: Chapters, 16 chapters
2: h264/AVC (left eye), 1080p24 /1.001 (16:9)
3: h264/AVC (right eye), 1080p24 /1.001 (16:9)
4: DTS Master Audio, English, 5.1 channels, 16 bits, 48kHz
(core: DTS, 5.1 channels, 16 bits, 1509kbps, 48kHz)
5: AC3, Hindi, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
6: AC3, Kazakh, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
7: AC3, Russian, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
8: AC3, Tamil, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
9: AC3, Telugu, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
10: AC3, Ukrainian, 5.1 channels, 640kbps, 48kHz, dialnorm: -27dB
11: Subtitle (PGS), English
12: Subtitle (PGS), Estonian
13: Subtitle (PGS), Hindi
14: Subtitle (PGS), Latvian
15: Subtitle (PGS), Lithuanian
16: Subtitle (PGS), Russian
[v02] Extracting video track number 2...
[v03] Extracting video track number 3...
[v03] Creating file "Right1.h264"...
[v02] Creating file "Left1.h264"...
Video track 2 contains 152232 frames.
Video track 3 contains 152232 frames.
eac3to processing took 21 minutes, 50 seconds.
Done.

Extracted (right eye) just like that, because the filters protections from the AVI mux:
http://i48.fastpic.ru/big/2012/1125/db/3bdda9c6ade3ce94f785ac4c663b39db.png

The final video for the right eye turned by 1 frame less = 152231 frames, which is not so bad.
The left eye can be indexed DGindex, shorter use the old methods for AVC encoding.