TsRemux v0.21.2: Transport Stream De/Re-muxer

[madshi]

I have a file "chop" utility.

http://www.w6rz.net/head.zip

Usage is:

head <infile> <outfile> <length>

For example:

head movie.m2ts clip.m2ts 10000000

Ron
Does it "respect" the m2ts file structure? I mean, does it cut off properly after full transport packets? Probably not, right? I'm asking because I'd like to get a chunk from the middle of a m2ts movie. Of course that works only if at least the beginning of the chunk properly begins on a m2ts packet header. Thanks!

[drmpeg]

Does it "respect" the m2ts file structure? I mean, does it cut off properly after full transport packets? Probably not, right? I'm asking because I'd like to get a chunk from the middle of a m2ts movie. Of course that works only if at least the beginning of the chunk properly begins on a m2ts packet header. Thanks!
You are correct. It's a very simple piece of code that just counts bytes from the beginning of the input file.

Ron

[dmz01]

Does it "respect" the m2ts file structure? I mean, does it cut off properly after full transport packets? Probably not, right? I'm asking because I'd like to get a chunk from the middle of a m2ts movie. Of course that works only if at least the beginning of the chunk properly begins on a m2ts packet header. Thanks!
You are correct. It's a very simple piece of code that just counts bytes from the beginning of the input file.

Ron

You can still use Ron's utility with a little simple math. Since M2TS packets are 192 bytes long, all you have to do is ensure that the number you specify on the command line is evenly divisible by 192. Same goes for TS files with 188 byte packets.

[madshi]

You can still use Ron's utility with a little simple math. Since M2TS packets are 192 bytes long, all you have to do is ensure that the number you specify on the command line is evenly divisible by 192. Same goes for TS files with 188 byte packets.
Cool - thanks!

[dmz01]

Has anyone remuxed/demuxed Flyboys BD? The only multi-channel English track is DTS-HD. It doesn't have a DDP or LPCM track to demux. I can use Tsremux to remux the track, but xport 0.96 cannot demux it. I have demuxed other DTS-HD tracks, (Ghost Rider), but this one doesn't seem to work. I even tried from the source m2ts with xport, but could not make it work.

I am happy to post a sample of the DTS-HD track in an m2ts container, but I don't know how to chop a usable section of it. Can someone give me an idea on how to do that? Thanks.

What happens if you try to demux the DTS-HD track in TsRemux (by right-clicking on the stream and selecting demux to elementary stream)?

[madshi]

Blu-ray DD+ standard is different from HD-DVD. In blu-ray the stream has a regular DD base where all the frames have bsid set to standard syntax and a DD+ extension where the frames have bsid set to enhanced syntax. In HD-DVD DD+ all the frames are set to the enhanced syntax. Can eac3to cope with that?
Can any AC3 decoder decode the AC3 part of such a DD+ stream? What purpose does the DD+ extension have then? Just to allow higher bitrate? Do you happen to have some code which is able to find out whether a file is simple AC3 or whether it's AC3 with DD+ extensions in it?

Here's a 10mb sample
I've found a bug in eac3to. Now my latest version detects this file as a normal AC3 file. Are you sure that this is not simply an AC3 file? The AC3Filter can directly play it, btw.

[dmz01]

Can any AC3 decoder decode the AC3 part of such a DD+ stream? What purpose does the DD+ extension have then? Just to allow higher bitrate? Do you happen to have some code which is able to find out whether a file is simple AC3 or whether it's AC3 with DD+ extensions in it?


I've found a bug in eac3to. Now my latest version detects this file as a normal AC3 file. Are you sure that this is not simply an AC3 file? The AC3Filter can directly play it, btw.

DD+ extension has the purpose of increasing bit rate correct. There is no easy way of telling whether a file is simple AC3 or AC3 with extensions other than the following: If all frames in a file are standard/alternate syntax frame then the file is AC3 only. If at least one frame in the file has enhanced syntax, then the file has DD+ extensions in it. The reason this was done in blu-ray is to allow DD only decoders (like ac3filter etc) to work without having to edit the stream.

[madshi]

DD+ extension has the purpose of increasing bit rate correct. There is no easy way of telling whether a file is simple AC3 or AC3 with extensions other than the following: If all frames in a file are standard/alternate syntax frame then the file is AC3 only. If at least one frame in the file has enhanced syntax, then the file has DD+ extensions in it. The reason this was done in blu-ray is to allow DD only decoders (like ac3filter etc) to work without having to edit the stream.
Shouldn't it be possible to find out whether a file has DD+ in it by checking the file size in comparison to the run length?

But I'm wondering: Would a conventional AC3 splitter even be able to find out the correct run length? Normally a splitter probably devides the file size through the bitrate to find out the run length, right? So having additional frames in the stream would confuse the run length calculation, or not?

Thanks!

[dmz01]

Shouldn't it be possible to find out whether a file has DD+ in it by checking the file size in comparison to the run length?

But I'm wondering: Would a conventional AC3 splitter even be able to find out the correct run length? Normally a splitter probably devides the file size through the bitrate to find out the run length, right? So having additional frames in the stream would confuse the run length calculation, or not?

Thanks!

Yes it would confuse it, especially since the DD+ frames will be of different length than the DD frames.

[madshi]

Yes it would confuse it, especially since the DD+ frames will be of different length than the DD frames.
Argh, that's ugly.

[dmz01]

However it would be very simple to extract DD stream out of it. Just parse the file to drop any enhanced frames and only keep standard/alternate syntax ones and voila - you have a fully working correct length etc. DD stream.

[madshi]

Ok, thanks.

[Pheon]

Hi, here are two 10 second samples of .ts files with aac audio that aren't working properly with TsRemux:

http://www.sendspace.com/file/pq6j4n

http://www.sendspace.com/file/mhx4qp

[dade49]

Shouldn't it be possible to find out whether a file has DD+ in it by checking the file size in comparison to the run length?

This is exactly what I have run into. Most of the audio streams from BD's that are listed as DDP in TSremux are really just DD AC3 streams. I use xport 0.96 to extract the elem streams, and it outputs the bitrate. Most times, it's a 640k bitrate, but I've even seen a 448k bitrate from a BD movie. AC3Filter can decode it fine, and delaycut reads it as a normal AC3 file with the correct length and bitrate.

The only real DDP tracks I've seen so far are on HDDVD's. I have yet to encounter a true DDP stream at a 1536k bitrate on a BD.

[dade49]

What happens if you try to demux the DTS-HD track in TsRemux (by right-clicking on the stream and selecting demux to elementary stream)?

You rock. Seems to work. I had no idea that TSremux could demux streams. It was not obvious to me to right click at all. Think we can get a main button that says demux, next to the remux? Kinda like EVOdemux? Maybe I don't need xport.exe anymore...

[mrazzido]

Hello i saw that TSREMUX has an Option to generate Automatic M2TS for Bluray ( BDMV Structure ) is it possible for Next version BDAV ? then i hope i can playback the movies from BD-R on my PS3.

Great Tool thx!

[dmz01]

Hello i saw that TSREMUX has an Option to generate Automatic M2TS for Bluray ( BDMV Structure ) is it possible for Next version BDAV ? then i hope i can playback the movies from BD-R on my PS3.

Great Tool thx!

Sure as long as you can make BDAV specs available to me. :D:D

[dmz01]

This is exactly what I have run into. Most of the audio streams from BD's that are listed as DDP in TSremux are really just DD AC3 streams. I use xport 0.96 to extract the elem streams, and it outputs the bitrate. Most times, it's a 640k bitrate, but I've even seen a 448k bitrate from a BD movie. AC3Filter can decode it fine, and delaycut reads it as a normal AC3 file with the correct length and bitrate.

The only real DDP tracks I've seen so far are on HDDVD's. I have yet to encounter a true DDP stream at a 1536k bitrate on a BD.

As per my posts, they're not really just DD AC3 streams. Any true BD DDP will have the standard DD main stream and a DDP substream. Since most packets, especially the first ones, are DD packets, most tools will tell you the stream is DD with the rate listed for the DD main stream. For a great example examine the DDP stream for Planet Earth, even the DVDHD version is this way.

[dade49]

As per my posts, they're not really just DD AC3 streams. Any true BD DDP will have the standard DD main stream and a DDP substream. Since most packets, especially the first ones, are DD packets, most tools will tell you the stream is DD with the rate listed for the DD main stream. For a great example examine the DDP stream for Planet Earth, even the DVDHD version is this way.

So, is there a way to strip the DDP packets out of it so that you're left with a regular DD stream? Your previous posts are unclear about how to actually do that. And if their bitrate is 640k or 448k, and their filesize is respectable, and AC3Filter can decode them, I don't really see how that's a problem if you're building them into an MKV. Suggestions?

[dmz01]

Wait for madshi to update eac3to if you want an automated way to remove DDP packets from the stream.

[madshi]

As per my posts, they're not really just DD AC3 streams. Any true BD DDP will have the standard DD main stream and a DDP substream.
Yes, any true BD DDP. But where to find a Blu-Ray disc with a true BD DDP stream? To my best knowledge most (or even all?) Blu-Ray discs do not have true BD DDP streams, but straight AC3 streams, only.

Check out this post by Roger Dressler (Dolby) :

http://www.avsforum.com/avs-vb/showthread.php?p=8345879&&#post8345879

As far as I understand it, if DD+ is used in Blu-Ray, it's never 5.1, but actually 7.1.

For a great example examine the DDP stream for Planet Earth
Are you sure that Planet Earth Blu-Ray is a true BD DDP stream? Because all the reviews state it's straight AC3. And the back packaging sais: "Dolby Digital Surround". Furthermore it's only 448kbit/s and I believe for it to be a true DDP track it would have to be 640kbit/s.

[mrazzido]

Sure as long as you can make BDAV specs available to me. :D:D

i dont know if this help

Information on directory structure of Blu-ray Disc can be found at
- White paper: BD-RE logical and AV application format, section 3.1.5 (page 18)

http://www.blu-raydisc.com/assets/downloadablefile/2a_bdre_logicalaudiovisual-12838.pdf

[dmz01]

i dont know if this help

Information on directory structure of Blu-ray Disc can be found at
- White paper: BD-RE logical and AV application format, section 3.1.5 (page 18)

http://www.blu-raydisc.com/assets/downloadablefile/2a_bdre_logicalaudiovisual-12838.pdf

This paper mentions what I would need - "Blu-ray Disc Rewritable Format Version 2, Part 3 : Audio Visual Basic Specifications." Last time I checked, even for only studying (renting) the spec, the price was $2500: http://www.blu-raydisc.info/spec_books/only_study.shtml

[dmz01]

Yes, any true BD DDP. But where to find a Blu-Ray disc with a true BD DDP stream? To my best knowledge most (or even all?) Blu-Ray discs do not have true BD DDP streams, but straight AC3 streams, only.

Check out this post by Roger Dressler (Dolby) :

http://www.avsforum.com/avs-vb/showthread.php?p=8345879&&#post8345879

As far as I understand it, if DD+ is used in Blu-Ray, it's never 5.1, but actually 7.1.


Are you sure that Planet Earth Blu-Ray is a true BD DDP stream? Because all the reviews state it's straight AC3. And the back packaging sais: "Dolby Digital Surround". Furthermore it's only 448kbit/s and I believe for it to be a true DDP track it would have to be 640kbit/s. I'm not sure 100% about Planet Earth since I don't have it. I'm passing along what I heard about it. I guess, I'll have to check my sources. :) But I do stand with what I said before - DDP on Blu-Ray consists of at least two substreams: Independent substream 0 which shall be decodable by standard DD decoders and be sent using standad/alternate syntax and one or more dependent streams which expad on the DD stream with additional channels. This allows plain old DD decoders (it doesn't matter whether hardware or software) to decode BD DDP streams, by simply ignoring the non DD frames.

[madshi]

But I do stand with what I said before - DDP on Blu-Ray consists of at least two substreams: Independent substream 0 which shall be decodable by standard DD decoders and be sent using standad/alternate syntax and one or more dependent streams which expad on the DD stream with additional channels. This allows plain old DD decoders (it doesn't matter whether hardware or software) to decode BD DDP streams, by simply ignoring the non DD frames.
Yes, you're right with that, I double checked that. It's just that I think that DDP is currently simply not used at all (or at least very vary rarely) with Blu-Ray. Most tracks are just plain AC3. At least as far as I know.

[olivierdb]

Dear dmz, First of all, many thanks for your TSRemux tool. I have been looking for a way to stream HD movies from my PC to an XBox (which I haven't bought yet!). My first approach was to rip, demux and encode HD-DVD EVO contents to WMV HD, but that process takes forever! Then, I went looking for a way to stream my .avs, i.e. AviSynth, files using VLC360. Unfortunately, it seems that VLC360 is designed for Windows XP and doesn't support .avs! This is where TSRemux comes into play. I have successfully played the video of a .ts file created with TSRemux using SMPlayer, but not the audio. It doesn't play in VLC though. However, strangely enough, the audio plays in TSConverter, but not the video! Also, I was not able to select DVR-MS output in TSConverter.

I am fairly new to all this and must be missing something! I thought you'd be able to guide me in the right direction.

Just in case, please find below the EVO sample I used:
http://www.mydatabus.com/public/aeonflux/part0001.evo

Thanks again!

[Usul]

I converted a TS file to blu-ray (h264 AVC dd 5,1) with tsremux..

From this point, I tried to burn the file structure with nero 7 using dvd-rom UDF mode, and manually selecting Primary UDF 2.5..

I burnt the file to dvd-r, and tried them on a sony blu-ray player, and a pioneer player.. The 2 players state the dvd is AVCHD and tried to play,but just hangs..

What am I doing wrong??

Thanx much..

[dmz01]

I converted a TS file to blu-ray (h264 AVC dd 5,1) with tsremux..

From this point, I tried to burn the file structure with nero 7 using dvd-rom UDF mode, and manually selecting Primary UDF 2.5..

I burnt the file to dvd-r, and tried them on a sony blu-ray player, and a pioneer player.. The 2 players state the dvd is AVCHD and tried to play,but just hangs..

What am I doing wrong??

Thanx much..

Does it play correctly in a Software Blu-Ray player such as WinDVD or PowerDVD? I would need a sample of the original to investigate further.

[Usul]

Does it play correctly in a Software Blu-Ray player such as WinDVD or PowerDVD? I would need a sample of the original to investigate further.

Thanx for the quick responce..:)

I have only nero, and it always crashes on most video files I play..:mad:

I will try windvd and report back my findings..


The format that your awesome program makes for blu-ray, is this the standard structure that should work on most blu-ray players??

Can one add a TS file with h264 and DTS and output in the blu-ray format, burn to dvd-r then play on a blu-ray player?? or does the player have to support AVCHD camcorder files..

Thanx again..

[dmz01]

Dear dmz, First of all, many thanks for your TSRemux tool. I have been looking for a way to stream HD movies from my PC to an XBox (which I haven't bought yet!). My first approach was to rip, demux and encode HD-DVD EVO contents to WMV HD, but that process takes forever! Then, I went looking for a way to stream my .avs, i.e. AviSynth, files using VLC360. Unfortunately, it seems that VLC360 is designed for Windows XP and doesn't support .avs! This is where TSRemux comes into play. I have successfully played the video of a .ts file created with TSRemux using SMPlayer, but not the audio. It doesn't play in VLC though. However, strangely enough, the audio plays in TSConverter, but not the video! Also, I was not able to select DVR-MS output in TSConverter.

I am fairly new to all this and must be missing something! I thought you'd be able to guide me in the right direction.

Just in case, please find below the EVO sample I used:
http://www.mydatabus.com/public/aeonflux/part0001.evo

Thanks again!

Which audio track were you trying to keep? DDP or DTS-HD?

[dmz01]

Thanx for the quick responce..:)

I have only nero, and it always crashes on most video files I play..:mad:

I will try windvd and report back my findings..


The format that your awesome program makes for blu-ray, is this the standard structure that should work on most blu-ray players??

Can one add a TS file with h264 and DTS and output in the blu-ray format, burn to dvd-r then play on a blu-ray player?? or does the player have to support AVCHD camcorder files..

Thanx again..

It should play fine on blu-ray players, but there could be either bugs in the program, or incompatible input, hence the need for a sample :)

[dade49]

What happens if you try to demux the DTS-HD track in TsRemux (by right-clicking on the stream and selecting demux to elementary stream)?

Looks like Flyboys BD only has a DTS-HD Master stream in English, and a 2 chan AC3 stream. So if I want to use a multichannel audio stream, I somehow have to demux this DTS-HD Master stream.

xport.exe gives me about 1k of data. Can't read it. TSremux can demux about 2.8GB of data, but it doesn't appear to be doing it right. Flyboys length is 2:18, and the DTS track I get is 1:02 in length.

dmz/drmpeg, Can you help me? All I want is the demuxed stream so I can pull the DTS core from it, and compile it into an AC3 stream.

It is definately a DTS-HD Master stream, not a regular DTS-HD stream. I am able to demux a DTS-HD stream from a different source.

I'm sure you want a sample. Would you like the DTS-HD Master in an m2ts, or do you want a sample of the demuxed stream?

Edited:
Sample m2ts file located here (http://www.sendspace.com/file/gplsxr).

[dmz01]

For me m2ts sample would be preferabe in case there is a bug in the demux code.

[Usul]

It should play fine on blu-ray players, but there could be either bugs in the program, or incompatible input, hence the need for a sample :)

Well, I tried windvd, and power dvd with the dvd-r I made with the blu-ray structure that tsremuxer made..

With these programs, was not able to play the dvd..

Not sure since these versions are only trial, they may not support the blu-ray..

I do not have an acutal blu-ray burner or rom.. only dvd

ARe there any trial programs out there than I can use to test with..??

After I atleast test this, I then can send a sample if it does not work..

Thanx again..

[neoteo]

HI. dmz01
I tried Tsremux0.0.16 to remux my .m2ts from original BD movie (muli-audio and subtitle) to Blu-ray and played with PowerDVD 7.3, using the "Open movie file on HDD",
PowerDVD can play video and first audio stream but no Subtitle and can't choose other audio track. why?

[dade49]

For me m2ts sample would be preferabe in case there is a bug in the demux code.

Please look at the sample m2ts located here (http://www.sendspace.com/file/gplsxr). It's a 20 meg file, but is divisable by 192, so shouldn't have any partial frames. Thanks.

[dorati]

When I remux some *.m2ts Files from Blu-Ray it plays fine on my PS3.

When I remux some *.ts to *.m2ts - the PS3 says "corrupt Data". With PowerDVD they work fine.
TSRemux remux without Error-Message. So everything looks fine.
The TS are recordings from TV (1920 x 1080i h.264, ac3).
What can be the reason, that it won't play?

[olivierdb]

Which audio track were you trying to keep? DDP or DTS-HD?

I kept the DD+ stream at the bottom of the list in TSRemux. Unfortunately, it seems that, in TSRemux, one cannot tell which audio channel is which, i.e. the bit rate and number of channels are missing!

[dmz01]

When I remux some *.m2ts Files from Blu-Ray it plays fine on my PS3.

When I remux some *.ts to *.m2ts - the PS3 says "corrupt Data". With PowerDVD they work fine.
TSRemux remux without Error-Message. So everything looks fine.
The TS are recordings from TV (1920 x 1080i h.264, ac3).
What can be the reason, that it won't play?

Either an incompatibility or a bug. Are you sure your TV recordings are 1920x1080i and not 1440x1080i? Can you provide a sample?

[dmz01]

HI. dmz01
I tried Tsremux0.0.16 to remux my .m2ts from original BD movie (muli-audio and subtitle) to Blu-ray and played with PowerDVD 7.3, using the "Open movie file on HDD",
PowerDVD can play video and first audio stream but no Subtitle and can't choose other audio track. why?

Most likely a bug.

[dmz01]

I kept the DD+ stream at the bottom of the list in TSRemux. Unfortunately, it seems that, in TSRemux, one cannot tell which audio channel is which, i.e. the bit rate and number of channels are missing!

Check your PM.

[dorati]

Either an incompatibility or a bug. Are you sure your TV recordings are 1920x1080i and not 1440x1080i? Can you provide a sample?

Here is a 15 Sek Sample of the record:

http://www.sendspace.com/file/p1my5n

[K40]

Is Ts Remuxer also working if Net Framework 3.0 is installled ?

[drmpeg]

Please look at the sample m2ts located here (http://www.sendspace.com/file/gplsxr). It's a 20 meg file, but is divisable by 192, so shouldn't have any partial frames. Thanks.
xport has no problem with that file. However, it's not the original is it? It has no video.

Ron

[drmpeg]

Here is a 15 Sek Sample of the record:

http://www.sendspace.com/file/p1my5n
It's 1920x1088, but it's 25 fps.

Ron

[dorati]

It's 1920x1088, but it's 25 fps.

Ron

Is this a problem for ps3 - or m2ts can not be 25fps?

[dade49]

xport has no problem with that file. However, it's not the original is it? It has no video.

Ron

Here's a sample of the full original with all streams in it.
http://www.sendspace.com/file/udyzd9

[dade49]

Is Ts Remuxer also working if Net Framework 3.0 is installled ?

Yes. It requires .NET 2.0, but .NET 3.0 works with it as well. I have tested it on Vista and XP with .NET 2.0 plus .NET 3.0 installed.

[drmpeg]

Here's a sample of the full original with all streams in it.
http://www.sendspace.com/file/udyzd9

Seems to work okay here.

E:\atsc>xport -h sample.m2ts 1 1 1
xport Transport Stream Demuxer 0.96
program = 1, video channel = 1, audio channel = 1
Program Number = 0 (0x0000), Program Map PID = 31 (0x001f)
Program Number = 1 (0x0001), Program Map PID = 256 (0x0100)
program descriptor = 0x05, 0x04, 0x48, 0x44, 0x4d, 0x56
program descriptor = 0x88, 0x04, 0x0f, 0xff, 0xff, 0xfc
Video PID = 4113 <0x1011>, type = 0x02
ES descriptor for stream type 0x02 = 0x05, 0x08, 0x48, 0x44, 0x4d, 0x56, 0xff, 0x02, 0x61, 0x3f
ES descriptor for stream type 0x02 = 0x86, 0x07, 0xe1, 0x65, 0x6e, 0x67, 0x7e, 0x7f, 0xff
Audio PID = 4352 <0x1100>, type = 0x86
ES descriptor for stream type 0x81 = 0x05, 0x04, 0x41, 0x43, 0x2d, 0x33
ES descriptor for stream type 0x81 = 0x81, 0x04, 0x08, 0x3c, 0x0e, 0x00
ES descriptor for stream type 0x81 = 0x05, 0x04, 0x41, 0x43, 0x2d, 0x33
ES descriptor for stream type 0x81 = 0x81, 0x04, 0x08, 0x3c, 0x0e, 0x00
ES descriptor for stream type 0x81 = 0x05, 0x04, 0x41, 0x43, 0x2d, 0x33
ES descriptor for stream type 0x81 = 0x81, 0x04, 0x08, 0x2d, 0xa4, 0x00
Sequence Header found
0 frames before first Sequence Header
Horizontal size = 1920
Vertical size = 1080
Aspect ratio = 16:9
Frame rate = 23.976
Sequence header bitrate = 38000000 bps
Progressive Sequence = 1
First Video PTS = 0x000ffff0
ts rate = unspecified
packets for pid 0 <0x0000> = 59, first = 1, last = 42892
packets for pid 31 <0x001f> = 7, first = 3, last = 42237
packets for pid 256 <0x0100> = 59, first = 2, last = 42893
packets for pid 4097 <0x1001> = 62, first = 4, last = 43338
packets for pid 4113 <0x1011> = 32564, first = 5, last = 43633
packets for pid 4352 <0x1100> = 7043, first = 246, last = 43690
packets for pid 4353 <0x1101> = 1538, first = 248, last = 43691
packets for pid 4354 <0x1102> = 1537, first = 251, last = 43686
packets for pid 4355 <0x1103> = 822, first = 253, last = 43688
coded frames = 127, video frames = 127

E:\atsc>dir /od
.
.
06/26/2007 12:01 AM 20,160,000 sample.m2ts
06/26/2007 12:03 AM <DIR> ..
06/26/2007 12:03 AM <DIR> .
06/26/2007 12:03 AM 1,156,679 bits0001.mpa
06/26/2007 12:03 AM 5,979,401 bits0001.mpv
.
.

Ron

[drmpeg]

Is this a problem for ps3 - or m2ts can not be 25fps?
25 fps is legal in .m2ts, but it's optional for players.

Ron