Could you test my dvd2avi & with your transport streams?

[Nic]

Hi,

http://nic.dnsalias.com/dvd2avi.zip
(its just one exe file about 80k)

Heres a version of my dvd2avi that im working on, ive disabled everything & not included any of the dlls for this test.

Could anyone test the loading of transport streams & demuxing of the audio.

1) Load dvd2avi.exe
2) goto options->transport stream mode
3) select your PIDs (I assume you know the video & audio PIDs)
4) Then select options->transport stream mode->transport stream mode to transport mode on.
5) then go file->open to load your file(s)
(use the scroller or f5/preview to make sure the video is ok)

To demux a track goto audio and select any track number then select the audio type (mpa or ac3). then go back to the file menu & click demux to save the audio.

This version is very crippled (ive turned off avi saving as well), all the features you see work perfectly on mine, but I only have one low res transport stream to try on.

Thanks to anyone who gives any feedback or suggestions, this is early alpha code at present (although everything appears to work ok).

Cheers,
-Nic

ps
try anything else with it at your own risk :)

[trbarry]

Hi Nic -

I tried it on a 1920x1080 cap. It worked, but with a couple glitches.

I'm doing this on my HTPC, which has only a 960x544 resolution. So when I opened the file it zoomed so large I could no longer access any of the controls and I didn't know how to get it back.

But the left & right arrow keys could step through the picture. The image had extreme vertical chroma delay of some sort. The chroma was many pixels lower than the luma for some reason.

I had to use ctl-break to exit.

- Tom

PS - I tried it a couple more times and now it just crashes on open.

[trbarry]

Nic (or everybody) -

For some sample ATSC HDTV stream test materials see the downloads by Heuris Corp (http://www.heuris.com/MPEGProducts/HD_samples/index.htm). (esp. the Crawford sample)

- Tom

[Nic]

How Strange, but thanks for the feedback :)

What do you think the solution to this is? Should I limit the amount allowed to be displayed (adding scrollbars would be difficult)?

The displacement, was probably caused by the huge size of the window, (at present the drawing is done using the GDI rather than directdraw)

any feedback on a resolution would be great, how did pcdvdguy's version handle it?
(& does your mpeg2dec3.dll handle these well? & is that how your encoding them (if at all) at present?)

Cheers,
-Nic

ps
Hmmm, would it be better to resize to a viewable size or just crop the right and bottom handside off to get the same effect... ?

[trbarry]

Most of them handle it by coming up with the default resize values set so it fits. Then if you go into resize and click reset you will maybe lose the view of the bottom and right but the top left corner and the menus will stay on screen.

I would personally love to have it so it just displays at 1/4 rez whenever it wouldn't fit. But I've never wanted that bad enough to go change it myself. ;)

- Tom

[neo_sapien]

When I try to open my transport stream file, DVD2AVI crashes. I'm performing steps 1-5 exactly. This also happens with DVD2AVIT3. HDTVtoMPEG2 is able to convert the stream, however, and the resulting file can then be processed with DVD2AVI

I'm using a MyHD card, which captures transport streams to .tp files. The only utility I've found so far which can read them is HDTVtoMPEG2.

[Nic]

@neo_sapian: Thanks for testing, Id love to know why it crashes. Ill have to get hold of some of these files somehow so I can debug them (the only transport streams I can use are the ones we create at work, and there all FD1 rez 5mbit & boring ;) )

@Tom: Ill add that 1/4 rez today & try and fix the crashes and color corruption and put up a new version later.

Thanks for all the input.

Cheers,
-Nic

ps
Feel free anyone to look at the menu's or use it on regular mpeg-2 files to see if you like the (auto) cropping, resizing, decss support, etc. Im not too far from releasing it (just adding support for yv12 and more filters really, so any suggestions welcome) :)

[trbarry]

Any chance of cutting out multiple sections (commercials?).

I rememember someone on the dev forum was working on a version to do this, but don't remember what ever happened to it?

DVD ripping folks don't have to worry about it much but HDTV captures tend to be about 1/3 commercials and (apart from being annoying) this takes a huge amount of space at HDTV bit rates. And a huge amount of time to encode.

But we either have to encode the entire clip with sound or worry about possible sound sync problems when cutting out commercials in Vdub before encoding.

So it would be sort of extremely nifty to just do this (keeping sound sync) as the d2v and ac3 files were created. But I don't really know how to do that.

- Tom

[Mikename]

I also have dvd2avi crash when I open up pretty much any ts I open. But don't feel bad nic the same happens with trbarrys version;) The error message says that a error log has been created but I can't seem find it. I'd be happy to send these .ts's and the log if you tell me where.

Mike

[Nic]

Yes unfortunatly TransportStreams rarely are that compatible, im yet to find a fully working TS Muxer yet, all the ones ive tried mess something up. The new version which resizes automatically will be up later...

[neo_sapien]

Nic, you have a PM.

[OUTPinged_]

So it would be sort of extremely nifty to just do this (keeping sound sync) as the d2v and ac3 files were created. But I don't really know how to do that.

Pause/resume button? (if you need it realtime)

[Nic]

Strangely mpeg2dec2.dll cant decode my TransportStreams correctly (it comes up with mainly garbage (but you can see the basic picture). However, dvd2avit3 decodes them fine...

how very weird, well ill put up a new build for now in a while & leave till January when I can download the test streams people have been offering me :)

Thanks alot,
-Nic

[trbarry]

Strangely mpeg2dec2.dll cant decode my TransportStreams correctly

Are you using a recent version? I fixed a bug a couple months ago that affected files with multiple program streams. But otherwise MPEG2DEC2 & DVD2AVIT3 usually seem to fail on the same clips.

www.trbarry.com/MPEG2DEC2.zip

- Tom

[cofferscuffs]

works fine with pal full d1 streams captured with a dvb-t card.

[ChristianHJW]

my Pinnacle DVB-S card is not installed curently ( had no time to connect my PC to my sat dish here in the new house yet ... plus i recently lost all my recorded streams when i changed partition size of my video partition and Partition Magic hung :( ....

[unixfs]

Hi Nic,

with my samples (captured in Linux) preview works fine, but everytime I try to save the project the program crashes.

Bye,

Nico

[cofferscuffs]

Originally posted by unixfs
Hi Nic,

with my samples (captured in Linux) preview works fine, but everytime I try to save the project the program crashes.

Bye,

Nico

and what format are your samples? you cannot expect help when you give no information whatsoever.

[unixfs]

they are 544x576 (quite strange, eh?) DVB streams with mpeg2 video and mp2 audio, but I guess there shouldn't be problems related to a different resolution than HDTV's.

[unixfs]

Sorry I forgot to mention that they are in TS format.

[trbarry]

unixfs -

Sorry if OT but do you know if there there ATSC capture cards for Linux now?

- Tom

[unixfs]

If my memory doesn't deceive me not yet, but it should be a matter of tuner support in the back-end of the driver.
I read of some people trying to add this functionality some days ago.

If you are interested your best source of information is the dvb-forum on www.linuxtv.org

[Nic]

Yes I noticed recently that my saving of d2v files wasnt correct with Transport streams, ive corrected that in the soon to be released beta. I dont know why it should crash though. Come the 2nd ill be able to download all the test streams & fix it. Then ive just got to test everything & then il be done & can release it (finally ;) )

-Nic

[unixfs]

I know it's OT, but I can't keep my curiosity.

I read that you discontinued your MPEG encoder, but I wonder if:
1) you are going to revise your decision
2) if it encodes MPEG1.

I ask it because I see much more use (at present) for MPEG1 than MPEG2/4, as every dvd player can play MPEG1, and MPEG2 is good only at high bitrates.

Of the currently available encoders TMPG is surely the best, but it's too slow, and ffmpeg isn't always on par (quality-wise) with the others; I don't know of any other good MPEG1 encoder (any suggestion is welcome).

I hope you will offer another candidate :)

Thanks.

[Stereodude]

Originally posted by unixfs
Of the currently available encoders TMPG is surely the best, but it's too slow, and ffmpeg isn't always on par (quality-wise) with the others; I don't know of any other good MPEG1 encoder (any suggestion is welcome).

I hope you will offer another candidate :)

Thanks. I wouldn't be so sure of that. At high bitrates (DVD) CCE will clearly run away from TMPGEnc in image quality. It's sharper and has far less noise/artifacts in flat areas.

Stereodude

[Stereodude]

Originally posted by Nic
Hi,

http://nic.dnsalias.com/dvd2avi.zip
(its just one exe file about 80k)

Heres a version of my dvd2avi that im working on, ive disabled everything & not included any of the dlls for this test.

Could anyone test the loading of transport streams & demuxing of the audio.

1) Load dvd2avi.exe
2) goto options->transport stream mode
3) select your PIDs (I assume you know the video & audio PIDs)
4) Then select options->transport stream mode->transport stream mode to transport mode on.
5) then go file->open to load your file(s)
(use the scroller or f5/preview to make sure the video is ok)

To demux a track goto audio and select any track number then select the audio type (mpa or ac3). then go back to the file menu & click demux to save the audio.

This version is very crippled (ive turned off avi saving as well), all the features you see work perfectly on mine, but I only have one low res transport stream to try on.

Thanks to anyone who gives any feedback or suggestions, this is early alpha code at present (although everything appears to work ok).

Cheers,
-Nic

ps
try anything else with it at your own risk :) Nic it does load .ts files from our local NBC affiliate (after they were processed by HDTVtoMPEG2 1.10. I've not tried any files straight as they come from the MyHD card. I'll try it with a .tp file straight from the MyHD card later today as well as with some .tp files from other channels.

Stereodude

[Nic]

Hi, Thanks for all the links to TS files. Ive only got neo_sapien's so far, but ive tested it with mpeg2dec & it worked (maxed out my cpu ;) cant think why my rage128 card doesn't like 1920x1088x29.997 ;) )

So it should be easy (I hope) to get MyHD files straight into my dvd2avi, ill work on it tonight :)

@trbarry: I was using the latest downloads from your site, and the transport stream files I had just didnt work correctly in mpeg2dec2.dll I could upload a bit of them to my site if you wish to have a look.
Cutting bits out is difficult...d2v files don't work that way, but I could make it so you could easily set markers that are trimmed out of the avs file...That should do it....

-Nic

[neo_sapien]

It worked with mpeg2dec? Odd, I wasn't able to get it to work over here :confused:

[Nic]

Just for you ;) http://nic.dnsalias.com/mpeg2dec.exe
(this version is hardcoded pid 0x21 just for you)

The command I gave to run it was:
mpeg2dec -o dxrgb d:\snl_clip.tp

:)

-Nic

ps
When you refer to mpeg2dec I assume you mean the libmpeg2 version... :)

[neo_sapien]

My clip, she runs! :)
Thank you for that :)

No, I didn't know about a libmpeg2 version...I was just trying to use MPEGDecoder with avisynth.

[trbarry]

@trbarry: I was using the latest downloads from your site, and the transport stream files I had just didnt work correctly in mpeg2dec2.dll I could upload a bit of them to my site if you wish to have a look.

Yes, indeed, if you could post a few seconds of the file on your site I'd like to see it. But I guess first make sure that it's not the hardcoded PID problem. My DVD2AVI writes the PID to the d2v file for MPEG2DEC2. Does yours to the same thing?


Cutting bits out is difficult...d2v files don't work that way, but I could make it so you could easily set markers that are trimmed out of the avs file...That should do it....

Yes! That would certainly be a good thing. ;)

- Tom

[Nic]

LoL, I saw the PID thing in the d2v file. Im doing it fine (as its obviously getting the video, just corrupted)...my dvd2avi should do it fine (although at first I forget to raise the stream_type to 2 :) )

Ive PM'd you a link to a 2.5mb file.

-Nic

[trbarry]

Nic -

I've got the file. Thanks.

It is a PAL transport stream, which I haven't played with before. My (save-oe) DVD2AVI seems to be able to handle it just fine but MPEG2DEC2 can not for some reason. Vdub hangs whenever I try to read it with an AVS file.

DVD2AVI and MPEG2DEC have much the same code for transport streams but obviously something is different. I'll try to figure out what.

Is that a DVB file?

- Tom

[Nic]

Hi Tom, those are exactly the results I got (if you play the avs in media player you'll see the garbage I got). The file came straight off a hardware MPEG-2 Encoder so it should be just a plain old transport stream (it was created by a dvd authoring company, so the hardware should be good).
(if you need any more of the file, just let me know, its around 300mb in total)

I fixed my bug, at least with neo_sapien's clip :) I was being a bit stingy in looking for a sequence header. If it couldn't find it in about the first few megabytes, it crashed (due to trying to calculate the fps from a uninitialised variable). That no longer happens :) New test build will be up tomorrow.

Cheers,
-Nic

[Stereodude]

Nic,

I've got all sorts of samples for you. I got a sample that doesn't decode properly. In one the Chroma is 30 pixels low on the image. In another the program crashes when trying to load the .tp file.

They're from our CBS HD station here in Detroit.

Do you want me to PM you a link to them on a web server?

Stereodude

[Nic]

New test build up at: http://nic.dnsalias.com/DVD2AVI.exe
This should work a bit better (& hopefully not just work on neo_sapien's clip ;) )

If you could test it I'd be grateful, its actually quite slow on large res clips at present. But it works none the less :)

Cheers,
-Nic

ps
@stereodude:
If you could give me a link to any smallish files that would be great :) (preferably smaller than 50mb if you can)

[CavalloPazzo]

Maybe I misunderstood something, but.. Transport stream is different from .pva (The format of WinTV DVB-s recorded files)? Because DVD2AVI crashes when I try to open these files (I've actived Transport stream option).

[Nic]

I could add PVA support (its easy to demux). But I dont quite understand how pva works....PVA is v. different to transport stream.

Cheers,
-Nic

[unixfs]

As far as I know PVA has an ES stream for video, a MP2 PES stream for audio and a different signature ('AV..'0x55) in the multiplex header.

In the last Mplayer there's a working demultiplexer for it.

As a side note, do you know for sure that HDTV is real a TS?
I never succeded to read a DVB (which for sure is a real TS) capture with
save-oe neither with Nic's MpegDecoder.dll.

Thanks,

Nico

[Nic]

HDTV appears to be a somewhat mangled (sometimes) TS. libmpeg2 recently had a PVA demultiplexor added to it. So adding support would be easy.

I know nothing of DVB, but I always thought it was a stream containing Transport Streams, but not necessarily a transport stream itself... ??? But I could (& probably am) completely wrong :)

Cheers,
-Nic

[Leolo]

Hi Nic,

Please check this link,

http://www.technotrend.de/download/av_format_v1.pdf

It's the official description of the PVA file format. Also, if you need any PVA samples, I can upload them to a web site if you want.

All of my PVA files have MPEG1 audio streams. There are some TV channels (like ProSieben) that broadcast audio also in Dolby AC3, but unfortunately I don't know how to record an AC3 stream into a PVA file.

The software I'm using (ProgDVB) refuses to write AC3 streams into PVA files. But I don't really know why. Maybe it's forbidden in the PVA specifications?

Thank you.
Cheers.

[Stereodude]

Nic,

The new built doesn't crash on either of the two test files. The 30 pixel chroma shift down is present on both. Then smaller file is a "cropped" version of the first on (using HDTVtoMPEG2 1.10).

Stereodude

[kindred]

Originally posted by Nic
New test build up at: http://nic.dnsalias.com/DVD2AVI.exe
This should work a bit better (& hopefully not just work on neo_sapien's clip ;) )

If you could test it I'd be grateful, its actually quite slow on large res clips at present. But it works none the less :)

Cheers,
-Nic



FYI this version seems to hang on large TS files (either that or its taking a REALLY long time to process them). No picture is shown, not even a frame - just hangs and the program cannot be focused again (need to kill it from the task manager).

The file in question is 1.7GB, has exactly two pids (which I entered), and is taken from a DVB card. Every other program I use has no problems with this stream, but like I said this version of DVD2AVI seemed to hung on me. I'll try a smaller file when I get home, just thought I'd let you know the outcome of a big file.

On a side note, not sure how you'd implement this but with DVB every card I've come across, and every software implementation (mainly linux) uses decimal PIDs - not hex. Its a PITA to convert them everytime, so another box next to the hex for decimal would be appreciated.

[bb]

Originally posted by Leolo
All of my PVA files have MPEG1 audio streams. There are some TV channels (like ProSieben) that broadcast audio also in Dolby AC3, but unfortunately I don't know how to record an AC3 stream into a PVA file.

The software I'm using (ProgDVB) refuses to write AC3 streams into PVA files. But I don't really know why. Maybe it's forbidden in the PVA specifications?
I think the software needs to support AC3. WinDVBLive does it (but unfortunately I don't get Pro7 on DVB-C).

bb

[Zhnujm]

progdvb can write ac3 if you use mpeg-2 for capture.
i think the mpeg-2 capture is not less stable than the pva capture.

[Nic]

Cheers kindred, could you let me know if it worked on small ts files. ill add a way of entering the pids in decimal too :)

Cheers,
-Nic

ps
Ive almost finished the new version mpegdecoder.dll which I hope will be useful too...

[Mikename]

Nic,
Just a little problem here but I can't seem to be able to get the audio delay on the ac3 file it demuxes :( It just saves it to the filename I specify... Any ideas?

Mike

[Nic]

Oh yeah, doh, sorry it calculates it, then ive forgotten to write it out. Thats real easy to fix (Id only put in the delay code recently, I hope it works ok on transport streams). Ill add that in soon, I hope you guys will like mpegdecoder_yv12 when its released, got to make sure thats ok.

Sorry for not posting more here I'm very busy at work, finally got chance to download 30megs of one of stereodudes files. I can see the chroma problem and now I can try & fix it :)
(Thanks stereodude :) )

Cheers,
-Nic

[unixfs]

Nic,
your new version works for me, and saves the project without crashing, but mpeg2dec3 doesn't read it (it seems to loop forever).

If you want I can send you one of my samples.

Do you plan to add support for mpeg1 ES and PS streams?

Thanks,

Nico

[kindred]

Originally posted by Nic
Cheers kindred, could you let me know if it worked on small ts files. ill add a way of entering the pids in decimal too :)


With a small file it loaded okay, but the entire clip was just "green", as if it couldn't read the file. Bit hard to describe :(

[Nic]

@kindred: It cant demux the stream, normally that would occur if the PID entered was wrong, but I cant think what it would be with yours. Could you send a small section to me? or upload it somewhere?

unixfs: have you tried tom's version?
http://www.trbarry.com/MPEG2DEC2.zip

Cheers,
-Nic

[kindred]

heh I feel a bit of an idiot.. :)

I just noticed that you've listed the PIDs to enter with audio first, then video. I'm so used to putting video, then audio that I didn't even read the labels that closely and just assumed thats what it was asking for. Do US systems broadcast the audio pid before the video pid?

Putting audio PID first and video last as it should be worked correctly, even for my huge 3GB TS stream :)

Can't wait for this new dvd2avi to be completely done - this will save me so much time.

On a side note, the normal DVD2AVI I use (1.76 that comes with DVD2SVCD) always incorrectly calculates the audio offset by 0.080ms - is this a known bug? A friend has tried it too with some of his UK DVB streams and he too always has to adjust by 0.080ms.

[unixfs]

Originally posted by Nic

unixfs: have you tried tom's version?
http://www.trbarry.com/MPEG2DEC2.zip



No, it shows a box of the right domensions but no video.

[jrmann1999]

Nic,

After frustratingly figuring out that I was putting the wrong PID's in place, your dvd2avi is working fine with MyHD capture files. That being said I've had random crashes on XP if the TP has more than two streams(our local affil likes to put the weather map on the second PID set).

Also when loaded the video displays a green bar across the top, this doesn't carry through to an external compression program(vdub, ndub, cce, etc..), and File->Exit doesn't work.

As a feature request, is there any way to get your crop to work on the 1/4th res display? Cropping/Resizing 1920x1088 video on a 1024x768 display is a bit tough.

[sjchmura]

Nic,

After also figuring out the PIDs it works GREAT.

Crashes occasionally but otherwise works well. Would be nice if it would remember TRANSPORT STREAM and PID :)

Do you have a new release?

[sjchmura]

Nic,

Is the ac3 demuxing busted? How do you get it to rip an AC3 track consistantly?

Also the AC3 track (when it works) does not have the audio offset.

So I have been using TRBarry's version to rip the ac3 and yours to get the dv2 created.

[jrmann1999]

TRbarry has a dvd2avi? want to post a link to the thread/site for this? I can use nic's to demux ac3 and it seems to work fine tho of course it doesn't print the offset so it's useless to me.

[trbarry]

"TRbarry has a dvd2avi?"

Mine are just test binaries of the save-oe Sourceforge project. They do have support for HDTV streams but the video and audio pid's must first be specified in the DVD2AVI.ini file.

www.trbarry.com/DVD2AVIT3.zip and
www.trbarry.com/MPEG2DEC2.zip (no support for YV12 or Avisynth 2.5alpha)

- Tom

[patja]

I'm a little unclear on what the purpose of this new DVD2AVI is? the trbarry version already handles HDTV transport streams, outputs ac3 with the delay in the filename, and although editing the ini file seems a bit inelegant at first, I find it handier to have an assortment of ini files to copy in for each broadcast source I use as opposed to doing it through the UI with no persistence from session to session.

Is there some advantage or new development I'm missing here?

[Nic]

Well, er, yeah, what do you think all the other features are for, (filters, resizing, twopass, etc). obviously when I finish it, it will save all the settings (actually the most recent version gets the PIDs for you :) )

@sjchmura: what problems were you having with AC3, did it sound right when demuxed?

-Nic

[sjchmura]

Thanks for the reply nic. I was NOT complaining - just letting you know

The AC3 sounds fine. However, there is no OFFSET. Also, you have to (at least it seems) save the DV2 file THEN go back and save the AC3 file. In the other version but the D2V file and Ac3 are saved at the same time.

TRBarry's version saves the audio offset so I know what to use in AC3Fix.exe :)

[Nic]

Oh good glad it sounds ok :) Like an idiot I added the delay finding code and then forgot to output it.doh. Ive stopped working on it at the minute but ill finish it off soon. trying to take a break from coding for a while :)

-Nic

[sjchmura]

If I sent you $5 or I promised to answer any cancer related question you might have would you finish it :)

Best

STeve