EVOB De/Multiplexers [Archive] - Page 4

drmpeg

20th January 2007, 12:38

@drmpeg, thanks a lot for your evob_demux tool.
No problemo. I had actually written this utility long ago. It just needed a little work to do .evo files.

A feature request, is it possible to show how many audio tracks(and their format) in EVO, or, at least, a wildcard audio format can be used for <audio format> parameter?
I had the same thought myself, so I'll probably add that feature (of reporting all the available audio streams).

A couple of notes for Version 0.1:

1) LPCM audio extraction is not finished. Not a big issue, since there are no (or very few) HD-DVD's with LPCM tracks.

2) The same tool works with regular SD DVD .vob files.

Ron

honai

20th January 2007, 12:51

A feature request, is it possible to show how many audio tracks(and their format) in EVO

I'm also working on a similar feature, but my implementation will extract the information from the XPL document. I'll probably include an invokation of demux.exe (if present) to demux the streams.

@drmpeg

Do you mind if I package your tool with mine for that purpose?

SeeMoreDigital

20th January 2007, 13:18

No problemo. I had actually written this utility long ago. It just needed a little work to do .evo files.I wonder if there's somebody here who could make a user-friendly GUI

drmpeg

20th January 2007, 14:09

@drmpeg

Do you mind if I package your tool with mine for that purpose?

Not at all. That's why I include the source code in the .zip file. It's there for others to use as the core for their own package.

However, I almost have stream reporting and LPCM finished, so there will be a new release soon.

Ron

drmpeg

20th January 2007, 14:21

I wonder if there's somebody here who could make a user-friendly GUI
Sorry about that. It's just that I've never done much GUI work professionally, so it's a bit beyond my programming skills. I'm much more of an embedded systems programmer (where a serial port is the main user interface). Also, I'm way more comfortable with Unix, so command line is familiar territory. BTW, for you Linux folks out there, dumux.c should compile no problem with the GNU C compiler.

Ron

BigBoss

20th January 2007, 15:14

I have tried the method outlined here and have the same problem that Daodan has. The mux step in graph edit produces a mkv file that's a few bytes long only.

I have some further comments though. I have no problems getting DirectShowSource("file.evo", audio=false) to open in AVS. On small samples, it is easy to load and even convert the EVO without issues. But there are problems doing full movies. I am testing with Superman Returns. Here are the observations I have:

1) I can use Sonic's filters and get true 24 fps progressive frames without duplicates. This is based on the length of the film based on the number of frames returned.
2) I can load the directshowsource with the EVO directly into AVS - or use the graph edit .grf file method. In either case, the frame rate returned is 29.97. I have been using fps=23.976 to correct this.
3) If I do not use convertfps parameter to directshowsource, the frame count returned is wrong. Therefore, I am also using framecount= to correct this.

Here is my full script:
DirectShowSource("SupermanReturns1.evo", framecount=111265, audio=false, fps=23.976) + DirectShowSource("SupermanReturns2.evo", framecount=110723, audio=false, fps=23.976)
ConvertToYv12()

When I run this and encode, I get a video file with perfectly smooth video that runs at 24fps as expected. However, when I mux in the 24fps audio track from the DVD, it is out of sync gradually in various places. It starts out fine but sync loss is gradual until the second segment, then it syncs fine again and there is more gruadual sync loss until the end.

If I add convertfps=true to the script, the sync is not better and the video is extremely jumpy. If I remove the fps= and decimate the video, it is extremely jumpy and I lose a lot of footage at the end of the movie because the source is really 24fps.

I have tried fps=24, fps=23.976, fps=24.0/1.001 all are out of sync after several minutes of video footage pass.

It seems the purpose of Isochromas steps were because he indicated that he could not load the EVO with directshowsource directly, that using directshowsource with the .grf files did not work for him, and that the sonic output was not 24fps but instead 29.97fps. None of these are the case for me. Therefore, loading the EVO directly or using the grf seems equivalent.

Am I missing something here? Could it be perhaps that no one here has tested using a full 2 1/2 hour movie?

MrDVD

20th January 2007, 15:45

BTW, for you Linux folks out there, dumux.c should compile no problem with the GNU C compiler.

Ron

Hallo, tested and it works:

./demux
usage: demux <-p> <infile> <video outfile> <audio outfile> <audio format> <audio track>

# ./demux wvc1.dd+plus.evo wvc1.dd+plus.mpv wvc1.dd+plus.dd+ 1 0

# ll
-rwxr-xr-x 1 root root 11664 Jan 20 15:33 demux
-rw-r--r-- 1 root root 8760 Jan 20 15:31 demux.c
-rw-r--r-- 1 root root 615456 Jan 20 15:38 wvc1.dd+plus.dd+
-rwxrw-rw- 1 root root 15792128 Jan 18 15:56 wvc1.dd+plus.evo
-rw-r--r-- 1 root root 14905875 Jan 20 15:38 wvc1.dd+plus.mpv

Zero1

20th January 2007, 16:31

Hey guys, interesting stuff.

Sorry if this is a "repost" of someone elses findings (to be honest I just skimmed through and was eager to test and report back), but I've found a little quicker method.

This is for owners of InterVideo WinDVD 8, and the filewriters are still using HDTVdump.

http://img99.imageshack.us/img99/984/evodemux0wl.th.png (http://img99.imageshack.us/my.php?image=evodemux0wl.png)

orbitlee

20th January 2007, 17:21

For NTSC video, I don't believe every video stream(either AVC or VC1) are always CFR encoded(23.976, 24, 29,97, or whatever), even in HD DVD. Just like MPEG2, both AVC and VC1 support hard telecine and soft telecine. We have tff/rff flag in MPEG2, pic_timing SEI in AVC, and I see tff/rff flag in VC1 video stream(somebody have VC1 spec please confirm). Why we should believe AVC or VC1 encoder will always handle film source and generate 100% soft telecine stream? According to murphy's law, Anything that can go wrong, will go wrong.

If there are very small percentage of hard telecine encoding in somewhere, in nature this stream is VFR encoded. Any attempts to use CFR container(AVI) or directshowsource, will meet AV sync trouble sooner or later, especially when handle full length movie.

vsv

20th January 2007, 17:31

@drmpeg
Ron, thanks for a nice demuxer! I hope you can implement new feature for BD's m2ts demultiplexing in future releases:)

chros

20th January 2007, 18:42

@orbitlee: are you sure that vc-1 video on HD-DVD can be vfr ?
If is this the case (like in wmv), we need another util to extract the timecodes from evo ... :(

@BigBoss: It happened to me also with Serenity movie (audio problem)...
1) I can use Sonic's filters and get true 24 fps progressive frames without duplicates.
How? I'm getting 29.97 too ...
Have you got the whole application or just the filters?
Is there some registry hack to for the sonic filters to not produce 29.97 instead of 24 fps?

@drmpeg: we don't need the gui now ... :) maybe later :)
Can you extract the subtitles from the evo? (Is it plaintext or picture?)

@honai: it's a very good idea! Congratulation! (XPL)
Though there can be problems with that:
- what if this file is missing?
- what if this file is corrupted or includes invalid data?
So the direct mode (within the util) is always the best method.

holzi

20th January 2007, 18:58

@ Isochroma
I too have problem with the elcard mpeg demuxxer.
When I connect it with Graphedit to the VC-1 stream it just crashes. I can demux it though if I use the sonic demuxxer.
But I don't know if that produces a good stream :)

Isochroma

20th January 2007, 19:17

@holzi: What version of the Elecard streaming pack are you using? I'm using the latest - Elecard MPEG-2 Decoder & Streaming Pack 3.0. Previous versions probably don't support VC-1.

Please check your private messages for a more detailed description of the correct installation method.

Also, today I will be testing the Sonic HD Demuxer's ability to substitute for the Elecard, and will report back on whether it works.

Isochroma

20th January 2007, 19:23

@madshi: I'm 'not happy' with the MKV file because, while it plays OK in MPC, it hangs directshowsource().

Isochroma

20th January 2007, 19:25

@Daodan: Are you using the exact filters and steps? In particular, the regular Matroska Muxer DOES NOT WORK: it produces an almost-empty MKV just as you describe.

You MUST use the Haali Matroska Muxer, and the latest (3.0) Elecard MPEG Demultiplexer.

Daodan

20th January 2007, 19:59

Unfortunately..yes. I tried both Haali and matroska muxer with same insucces. I had the elecard demultiplexer from before from some other elecard product, but installed the one you said just to be sure, and still nothing. However, i was finally able to demux something using the sonic demuxer and haali muxer, but it stopped at less then half way, but at least te result was indeed a working vc1 in mkv.
From what I tried things are VERY dependat on the track you are woking with, especially if they are the big files. For example one of my tries left me with a demuxed video stream that had 20% less frames (but te ending was there) so the decoder for some reason just skips some frames, because I think the demuxer couldn't have just removed them.

Isochroma

20th January 2007, 20:03

I tested the Sonic HD Demuxer very carefully. It appears to work, but both the MKV and AVI file produced at the end of my process have far in excess of 25% extra frames, and seem to be missing frames from the beginning.

Isochroma

20th January 2007, 20:31

OK, just found out the problem! I tested the process on my server downstairs, and installed the version I had. It crashed!

So I checked the version against mine upstairs, and found it was older than the working version!

The BAD version is 1.0.19, the GOOD version is 1.0.47 build 60321. The newer version file is larger by about 100k; they added VC-1 support, obviously. There is an even newer build that I haven't tested yet: 60526.

So I overwrote the older file with my newer one from upstairs, popped up GraphEdit, and she works like a charm!

Here is the CORRECT version (make an empty graph, insert the filter by itself, right-click, Filter Properties...

http://isochroma.com/Testfiles/Misc/doom9/ele_demux_good_version.png

The previous version of the Elecard MPEG Demultiplexer will always crash.

Anyone who's had the crashing problem, please Private Message (http://forum.doom9.org/private.php?do=newpm&u=73458) me for technical assistance.

Finally, I'd like to add that the Elecard Demultiplexer is really powerful: it can properly recognize and demux both VC-1 and H264. Its output pin actually says "VC-1" and "H264" when its input is connected to the respective sources, which means its internal code is actually recognizing the formats and handling them correctly.

holzi

20th January 2007, 21:52

ok elcard works now for me.
But muxing a big file with hali mkv muxxer files. Just like someone else reported.

drmpeg

21st January 2007, 00:05

@drmpeg
Ron, thanks for a nice demuxer! I hope you can implement new feature for BD's m2ts demultiplexing in future releases:)
I already have a BD .m2ts demuxer. See:

http://www.w6rz.net/xport.zip

Use the -h option for BD files.

(from the readme file)
h = input file is in HDMV (AVCHD) format (192 byte packets)

BD = HDMV = AVCHD.

Ron

ape

21st January 2007, 00:16

here's what i used as a test for reencoding an .evo to x264/HE-AAC. you can also do AC3 using the FFMPEG encoder megui comes with.
some problems i had are you have to specify the number of frames manually (you can determine this using virtualdub) and seeking with large files takes ages (hence disabling the preview in megui). to get 5.1 output you need to set your speakers to 5.1 in windows audio properties and then set it to 5.1 in the intervideo decoder in the graph.
there might be some avisynth settings to fix this, or maybe a better demuxer.
http://img211.imageshack.us/img211/2826/hddvdencoding4du.png

Rufus210

21st January 2007, 00:58

Anyone tried the FFMPEG patches that add EVBO and E-AC3 (DD+) support?
http://lists.mplayerhq.hu/pipermail/ffmpeg-devel/2007-January/051024.html
http://lists.mplayerhq.hu/pipermail/ffmpeg-devel/2007-January/051073.html

honai

21st January 2007, 01:12

Nope, but wow! That is great news.

@Isochroma

See, it didn't take "months or years". ;-)

Zero1

21st January 2007, 02:05

This is so awesome, it's all finally coming together

Isochroma

21st January 2007, 02:56

@ape: Thanks for the graphs! Unfortunately, your video graph just hangs vdub with 100% CPU usage on my machine, then closes after about 30 seconds.

woah!

21st January 2007, 03:29

drmpeg

21st January 2007, 03:30

I've updated my demuxer to add LPCM extraction and stream detection and reporting.

http://www.w6rz.net/evob_demux.zip

EVOB Demuxer = Version 0.2

Changes for Version 0.2

1) Added correct LPCM extraction
2) Added audio and video stream detection and reporting

Usage:

demux <-p> <infile> <video outfile> <audio outfile> <audio format> <audio track>

Typically:

demux movie.evo bits.mpv bits.mpa 1 0

Audio formats:

0 = DD
1 = DD+
2 = DTS-HD
3 = LPCM
4 = MLP

-p option dumps both audio and video PTS values

LPCM extraction was tested with an SD DVD, "The Cure Trilogy".

C:\xfer>demux d:\video_ts\vts_01_5.vob bits.mpv bits.mpa 3 0
MPEG-2 Video Stream found!
LPCM Audio Stream number 0 found!
DD Audio Stream number 1 found!
C:\xfer>

BTW, the extracted LPCM format for this title is PCM signed 16 bit, big endian, stereo, 48000 Hz.

Ron

Isochroma

21st January 2007, 03:53

@drmpeg: Thanks so much for the continued work on demux.exe, it is an invaluable tool.

Here's a useful link (http://www.freepatentsonline.com/search.pl?p=1&srch=xprtsrch&sf=1&query=evob&uspat=on&usapp=on&eu=on&date_range=all&stemming=on&sort=chron) to a series of patents on EVOBs, full of nice technical details.

Badness

21st January 2007, 04:14

Whenever I try to drop the vc1 file into graphedit, graphedit just hangs and does nothing. I am using the current version of elecard.

Isochroma

21st January 2007, 09:01

@Badness: When you drop a media file into GraphEdit, it tries to do a full render using the default chain. Instead, you have to build it yourself, to avoid GraphEdit hanging because it is 'automatically' selecting incompatible filters.

First, startup graphedit with an empty graph. Next, add a filter: expand the DirectShow Filters Section, and select File Source (Async.). It will pop up a window so you can select your .vc1 file.

Then, hit ok on that window and you will see the filename in a new box in the main window.

Now, scroll down the filter list and add the Elecard demuxer, then add the Haali Matroska Muxer, then close the Add Filter window.

Now you can manually connect the pins and you're done!

If it crashes anywhere during this process, please reply with your results in detail.

BigBoss

21st January 2007, 09:17

The commercial HD-DVD rips I have here use 0xc0 .. 0xc2.

However, two unsolved problems remain:

* we can't mux VC-1 elementary streams because the tech spec is payware
* we can't mux/decode DD+ (other than proprietary playback/downmixing inside PowerDVD) because there's no DirectShow decoder for it

How much is the tech spec and what do you have to do to get it?

plonk420

21st January 2007, 10:43

is anyone else getting 2GB files when feeding a large EVO thru evo_demux? (2.07 GB to be exact) someone else i'm talking with is getting the same as well...

edit: well, now i have a decent sized VC1 file (courtesy of TMPGEnc), and Elecard will output VC1, but Haali seems to be outputting a file just a few dozen MB... :/

at least i can now PLAY the file (audio and video) in PowerDVD 7.2 (used to crash unless i was playing SD MPEG2 material...

foxyshadis

21st January 2007, 11:11

How much is the tech spec and what do you have to do to get it?

$300: http://www.smpte.org/shopping_cart/cart.cfm?function=add&productid=1767

3ngel

21st January 2007, 11:27

@Isochroma
I've lost some posts, i saw in the past you used Sonic Demuxer. Now you're using Elecard demuxer. What are the differences? The sonic has problems and the Elecard not?

Okraml

21st January 2007, 11:30

@drmpeg
I got problems with your demuxer. The videofile that is demultiplexed is too short. I tryed 2 different files both around 10gig and the resulting vc1-videofiles are too short (the second is 4,35 gig and there is a huge segment missing in the middle of the file)

When i demux it with graphedit
file source async -> sonic hd demuxer -> dump
it works and plays in mpc.

@Isochroma
i can't mux the vc1 to mkv too.
I have Elecard Mpeg Demultiplexer Version 1.0.77 Build 60823 and Haali Matroska Muxer Version 1.6.400.11 and my harddrive stops working after some seconds. When i stop graphedit then, i got a file thats only 1.06 MB. When i open it in MPC it shows me in preferences, that it is video WVC1 with 1920x1080. But it doesn't process the whole file.

Maybe i need a programm like h264tsto.exe but for vc1 to mkv instead of ts to mkv, cause that works sometimes, when graphedit won't.

:-) Okraml

Fels

21st January 2007, 12:08

here's what i used as a test for reencoding an .evo to x264/HE-AAC. you can also do AC3 using the FFMPEG encoder megui comes with.
some problems i had are you have to specify the number of frames manually (you can determine this using virtualdub) and seeking with large files takes ages (hence disabling the preview in megui). to get 5.1 output you need to set your speakers to 5.1 in windows audio properties and then set it to 5.1 in the intervideo decoder in the graph.
there might be some avisynth settings to fix this, or maybe a better demuxer.

I can't get it to work at all.
Video crashes while starting encoding (the sonic filter plays fine in mpc)
Audio is totally silent.
Which exact WinDVD version have you used? The hd dvd one? I just downloaded the trial version from Intervideo website.

orbitlee

21st January 2007, 14:37

drmpeg

21st January 2007, 16:06

@drmpeg,
I tried demux 0.2, the result

D:\>demux.exe FEATURE_1.EVO NUL a0.ddp 1 0
VC-1 Video Stream found!
DD+ Audio Stream number 4 found!
DD+ Audio Stream number 3 found!
DD+ Audio Stream number 2 found!
DTSHD Audio Stream number 1 found!
DD+ Audio Stream number 0 found!
MLP Audio Stream number 5 found!
MLP Audio Stream number 3 found!
MLP Audio Stream number 7 found!
MLP Audio Stream number 1 found!

The result makes me confused. Anything wrong with the MLP stuff?

Yes. There was a bug in the MLP stream detection. I've created version 0.3 which fixes this bug and also attempts to fix the problems reported by plonk420 and Okraml (although I can't really be sure). I've also changed the audio format selection from a number (which I could never remember) to a text string.

http://www.w6rz.net/evob_demux.zip

EVOB Demuxer = Version 0.3

Changes for Version 0.3

1) Change audio format entry to text instead of number (can't remember numbers!)
2) Fixed bug with short audio packets
3) Fixed MLP stream reporting

Changes for Version 0.2

1) Added correct LPCM extraction
2) Added audio and video stream detection and reporting

Usage:

demux <-p> <infile> <video outfile> <audio outfile> <audio format> <audio track>

Typically:

demux movie.evo bits.mpv bits.mpa dd+ 0 <----------- Note audio format change!

Supported audio format strings:

DD, DD+, DTS, DTSHD, LPCM, MLP
dd, dd+, dts, dtshd, lpcm, mlp

Note: dts and dtshd are equivilent

-p option dumps both audio and video PTS values

Ron

kolak

21st January 2007, 16:34

Nice tool Ron.
Audio works perfectly: I've tried DD+ and DDTrueHD. Scenarist imports them properly.

I have problem with demuxed video track (VC1). I can't import it into Scenarist.
Scenarist complain that GOP size are eg. 2000 frames.

It plays properly with Sonic decoder, but not with PowerDVD ultra.
I've tried to import VC1 demuxed with Sonic Hd demuxer and
saved with DVBP. Everything fine, but video played to fast when I muxed new evo file with Scenarist and play it with PowerDVD Ultra.
There seams to be missing information about pulldown.
There is something wrong with demuxed files (or with Scenarist). You can't make from demuxed files exactly the same new evo file. Scenarist shows that bitrate is to high or video plays to fast (instead of 23.976fps it plays 29.97). It seams to that this disck hasn't been made with Scenarist.

Any idea how to fix that?

Zerofool

21st January 2007, 17:31

@Isochroma
i can't mux the vc1 to mkv too.
I have Elecard Mpeg Demultiplexer Version 1.0.77 Build 60823 and Haali Matroska Muxer Version 1.6.400.11 and my harddrive stops working after some seconds. When i stop graphedit then, i got a file thats only 1.06 MB. When i open it in MPC it shows me in preferences, that it is video WVC1 with 1920x1080. But it doesn't process the whole file.
Exactly the same versions and problem. I tested 120 mb .vc1 (from one of the mainintro.evo files) and the resulting mkv (stopped the process after 20 mins of waiting) was 20kb. Am I doing something wrong? After building the graph I just push the "play" button and wait until it finishes (the stop button would be grey, and the play button would be pushable again). But that doesn't happen, as if it is still playing/working. Then I left it for the night, and that morning (after more than 10 hours of muxing) it wasn't finished yet, I stopped it, and the resulting file was 62MB, still not playable of course. Ideas?

I can't get it to work at all.
Video crashes while starting encoding (the sonic filter plays fine in mpc)
Audio is totally silent.
Which exact WinDVD version have you used? The hd dvd one? I just downloaded the trial version from Intervideo website.
I get the same. When I build the graph for the video and try to play it a black window opens (not even 1920x1080, but something like 640x480) and I get only black frames for 3-4 seconds and than finishes, the same result if I try to play the files (the demuxed .vc1 or the original .evo) in WinDVD. I'll try the BD HD edition now.

Okraml

21st January 2007, 18:05

@Ron
Version 0.3 works! THX.
The demultiplexed file with demux.exe is 7.949.260KB
The file demuxed with graphedit (sonic hd demuxer) is 7.950.147KB
Both play fine and show a length of 46.37 minutes (don't know whats the difference between them.

But even with this file muxing in graphedit with Haali Matroska Muxer doesn't work.

:-) Okraml

kolak

21st January 2007, 19:59

Ron,

maybe it will be interesting (or not) for you, but I compared VC1 demuxed files with Elecard Stream Analyzer.
One file is from your's demuxer and second from Sonic HD Demuxer.
There are big differents in these two files.
Types of the frames doesn't much each other. Your file seams to have much more P frames.
In Sonic file all the frames have Progressive flag, but in yours there are sometimes progressive sometimes interlaced.
These two files look totally different.

I'm not sure what does it mean, but you may know.

Orkam,

what do you use to play these files?

Okraml

21st January 2007, 20:11

Orkam,

what do you use to play these files?
I think, you mean me.
I use Media Player Classic (that uses Elecard Mpeg Demultiplexer and Sonic Cinemaster Video Decoder).

:-) Okraml

kolak

21st January 2007, 20:22

Okraml

Sorry I've totally changed your nick:)

Ron,

I found unswer.
I've done test with different file (xxx.evo, which plays fine with PowerDVD). Both metods gave me exactly the same result.

This problematic file is a main feature file and I can't play it with PowerDVD (IME problem?). It seams to that your demuxer doesn't like these kind of files.

I have still problem with to fast playing evo files created with SCenarist.

chros

21st January 2007, 23:11

...
some problems i had are you have to specify the number of frames manually (you can determine this using virtualdub)
Thanks for this post!
1 question: how can you determine the correct number of frames in VirtualDub? Which file must be opened?

The audio part is working here !!!! :) (apart from the framecount)

3ngel

22nd January 2007, 00:17

I'm trying to test the evob_demux.
With the command "demux.exe test.evo test.vc1" it simply doesnt' start returning the prompt. The evo runs fine with sonic hd demuxer
What's the problem?

desta

22nd January 2007, 01:54

From what I gather you have to specify an audio stream to demux, as well as video.

plonk420

22nd January 2007, 08:17

Yes. There was a bug in the MLP stream detection. I've created version 0.3 which fixes this bug and also attempts to fix the problems reported by plonk420 and Okraml (although I can't really be sure). I've also changed the audio format selection from a number (which I could never remember) to a text string.

thanks! looks good. it's size-identical to what TMPGEnc output (not sure about bit identical). now if only i could get a useful .MKV out of Graphedit... (i'm stuck like at the 2nd step before even getting an AVI out of the MKV)

3ngel

22nd January 2007, 10:19

From what I gather you have to specify an audio stream to demux, as well as video
I see. Can't be added an option to demux only the video?
Thanks

mixanobios

22nd January 2007, 12:22

i've got a problem with a movie called Equilibrium i just backed up. Its a H264 DD+ HD DVD. I have been able to demux the video track and remux it into a mkv following Isochroma's guide. I have also managed to demux Audio tracks 2 and 3, which are directors comments, and they play and mux into mkv correctly.

The problem is that i cannot correctly demux the main movie audio track, or the second audio track. although demux.exe finds 4 audio tracks, and demuxes all of them, only the last two are playable (the directors comments ones).the 2 first ones (900+mb and 200mb, from a 10G .evo), seem to be video tracks, and when imported into graphedit, sonic demuxer comes in, connects with ffdshow and outputs direct show audio, which doesnt play anything.

furthermore, i have been unable to demux main audio by using Intervideo Demultiplexer, because it is unable to connect with intervideo audio decoder, and if i connect it to HDTV dump it spits out the directors comments audio.

Edit: i can upload samples if you want, just pm me