TSPE 0.700 Public Beta out now!

[Ventolin]

Hi folks,

After a couple years of quiet development in the darkest corners of the Internet, another public beta of TSPE is now available!

http://www.bitstreamtools.com

For those that don't know, TSPE (Transport Stream Packet Editor) is a non-linear Editor / Analyser.

So, what's new...

Supported Formats:
MPEG2 / H.264 / VC-1 / AC-3 / DDP / MLP / DTS / DTS-HD / DTS-HD MA / AAC / MPEG1 Audio / MPEG2 Audio / PCM (everything?

.TS and .M2TS support including stripping the m2ts header to make normal 188 byte .TS files.

No re-encoding of the stream to preserve maximum quality, I frame to P frame accurate, clean video/audio editing, timestamp and table correction.

You can cut commercials from captured sources, detect commercials using format changes, scan for errors, import TSPE and M2R logs, fix broken streams including timestamp wraparounds, continuity errors, timestamp gaps, realign to start codes and resync audio.

Stream stripping with table correction, PCR remapping, Demuxing, Core Audio from HD audio extraction.

Video preview is much more accurate, uses your own directshow filters, test and full edits are previewable with TSPE's own internal viewer, multi-part ts file joining with autosorting EDL (Edit decision List). Marker List to enable bookmarking of positions.

Packet Header Decode for analysis. Resizable interface.

Plenty more too, visit the website for details.

TSPE is now shareware, free trial period is 45 days. I wanted to release TSPE once I was sure it performed well enough to justify payment. It is still in beta testing, but most of the major bugs have been ironed out (I hope!). Still plenty more work to be done, eg. m2ts and vc1 support is still sketchy, but it does do the job just about.

Please let me know how you get along; of course I would like to know your feedback good or bad and especially if you have some streams which don't work properly.

Have fun,

Regards,

Vent

[Atak_Snajpera]

Those two ts samples do not work (no preview)
http://www.mediafire.com/?sharekey=f...db6fb9a8902bda

One more thing. Instead of small 'loading' window I would use window with graphic (splash screen)

[Ventolin]

Originally Posted by Atak_Snajpera

Those two ts samples do not work (no preview)
http://www.mediafire.com/?sharekey=f...db6fb9a8902bda

One more thing. Instead of small 'loading' window I would use window with graphic (splash screen)

Hi,

This is a snippit of the status log when you try to load either of the two .ts files:

Opening: X:\tmp\Batman-5.TSSplit.1-57.ts
Opening File...
Auto Finding PIDs
Unable To Find PAT

Both streams do not have a PAT. The PAT is essential for a Transport stream and there should be one every half second or so. A transport stream should have at least 1 PAT with PID 0, 1 PMT and 1 stream (which can be video or audio).

Try loading the full source into TSPE instead.

Thanks for the note about the splash screen, I haven't gotten around to doing one yet, same with an icon. These will be added in due course, once I've learnt a bit about graphic design

Cheers,

Vent

[mediator]

many real life streams don't come with PAT (e.g. captures from DVB, seems often the PAT is just stripped during the recording process). Maybe you should consider supporting them anyway, even if they don't strictly comply with ISO.

[Ventolin]

Originally Posted by mediator

many real life streams don't come with PAT (e.g. captures from DVB, seems often the PAT is just stripped during the recording process). Maybe you should consider supporting them anyway, even if they don't strictly comply with ISO.

PAT and PMT really are essential to a Transport stream. If a capture program strips them out of a stream, then the capture program is at fault. TSPE would then need to repair the stream to fix the poor design of the capture program. What real life streams have you come across without PAT and PMTs? If a specific capture program is stripping out the PAT and PMT perhaps the authors could fix their software?

The PAT and PMT tell the decoder what is in the transport stream. The PAT gives a list of the Programmes available in the form of PIDs for PMTs. Once the PID of the PMT is known, the PMT can be read to find out the what PIDs, types and timing information (PCR) are of the streams that make up that programme. When capturing a complete mux you may have *hundreds* of streams in the transport stream. How is anything supposed to know what streams belong to what programme if you dont have the PAT and PMTs?

Nevertheless, in the most basic mode TSPE *still* works even without the PAT and PMT. If you are able to find a working directshow filter setup (i.e. one that works in graphedit) you can then have video preview. TSPE will still allow you to set start and end points and make an edit if you turn the fix options off with or without the video preview.

Since I couldn't get any filter combination to work in graphedit, I couldn't test what happens with TSPE completely, but I did edit a section out successfully nonetheless.

Full table editing (for PAT and PMT) is already on the TODO list however. Once that is implemented it will allow TSPE to repair streams without PAT or PMTs. Perhaps I could get TSPE to launch an external viewer like MPC instead of it's internal viewer for test edits in the mean time. I could code that in if there was enough demand...

To edit these streams "blind" switch to the decode window (using the View) button. Then use the decoded PTS/DTS timestamps as a guide to the real timecode of the stream. Then you can navigate to test out positions. Make sure you turn off Fix Tables and Fix Timecodes and turn off the internal viewer from the menu options. You can then make test and full edits and preview the filename.test.ts or filename.edit.ts files generated with something like MPC. Scanning the file revealed a timestamp gap of 49 seconds or so at the start in the Batman sample; the scan dropped a marker at the end of the gap so you can navigate there easily.

Hope that helps,

Regards,

Vent

[canTsTop]

hello,
i have this sample http://www.megaupload.com/?d=5A68THW9 is it possible to fix it so i have audio / video synch after encode, and how?

[DreckSoft]

Originally Posted by Ventolin

PAT and PMT really are essential to a Transport stream. If a capture program strips them out of a stream, then the capture program is at fault. TSPE would then need to repair the stream to fix the poor design of the capture program. What real life streams have you come across without PAT and PMTs? If a specific capture program is stripping out the PAT and PMT perhaps the authors could fix their software?

Offline Descrambler produces strange output. Till now I haven't found a program which can handle the output. The output of OD seems to be ok for the few pre-defined CAIDs but decrypting for example ORF1HD with Cryptoworks (0x0D05) creates a completely unusable file.

So a "fix my stream" would be a nice function.

[Atak_Snajpera]

once I've learnt a bit about graphic design

I can create something for you for free.

Another thoughts:
1) Main form should appear in center of the screen
2) Movie slider should start at first decodable key frame instead of P or B frame

I forgot to say. Excellent job!

i have this sample http://www.megaupload.com/?d=5A68THW9

Are you joking ? This sample is like wooden wall destroyed by Minigun. Too many holes ...

[Flaarn]

Thanks for this ventolin, checking it out on a couple of h264 transport streams now, bbc hd and channel 4 hd.
The big issue for me has always been frame accurate cutting so that no extra 2.0 audio frames are present if the main broadcast is 5.1 but adverts are 2.0, many conversion tools tend to throw a wobbly when there are audio changes, more so when the transport stream contains some 2.0 ac3 frames at the start, sure it can be patched when parsing, but it adds another step in the process which in my opinion is a nuisance, with this new release I'm hoping that I can bypass this step and have a clean ts to play with, thanks again for your ongoing work.

[Ventolin]

Originally Posted by Flaarn

Thanks for this ventolin, checking it out on a couple of h264 transport streams now, bbc hd and channel 4 hd.
The big issue for me has always been frame accurate cutting so that no extra 2.0 audio frames are present if the main broadcast is 5.1 but adverts are 2.0, many conversion tools tend to throw a wobbly when there are audio changes, more so when the transport stream contains some 2.0 ac3 frames at the start, sure it can be patched when parsing, but it adds another step in the process which in my opinion is a nuisance, with this new release I'm hoping that I can bypass this step and have a clean ts to play with, thanks again for your ongoing work.

Hi,
I've found the audio switchover point to be less than accurate on the broadcaster's end which means that you might chop off the start of the audio at the start of a segment. I hate this alot as my offboard processor will mute for a second at the switchover point. I did complain to the BBC some time ago, they tried to fix it but screwed things up alot and promptly gave up.

Hope you find TSPE useful though, look forward to your feedback.

Regards,

Vent

[Ventolin]

Originally Posted by Atak_Snajpera

I can create something for you for free.

Seriously? Thanks! I can create one for free too :P but if you really want to have a go, we'd be happy to look at it

Originally Posted by Atak_Snajpera

Another thoughts:
1) Main form should appear in center of the screen
2) Movie slider should start at first decodable key frame instead of P or B frame

Thanks for your suggestions, I'll think about 1) but might be confusing with multiple instances. 2) Slider should be at the very start of the stream as this is a *packet* level editor and analyser - the PAT usually is at the first packet!

Originally Posted by Atak_Snajpera

I forgot to say. Excellent job!

Thank you kindly!

Originally Posted by Atak_Snajpera

Are you joking ? This sample is like wooden wall destroyed by Minigun. Too many holes ...

LOL, but still possible to get something out, see above

Cheers,

Vent

[Atak_Snajpera]

2) Slider should be at the very start of the stream as this is a *packet* level editor and analyser - the PAT usually is at the first packet!

I'm not saying about discarding everything before first keyframe.
Slider should be rewinded to first key-frame by default. See screenshot


I see no reason to cut stream at P or B frame. Only cutting at key frame maintains audio synchronization if we want to transcode file further. This is main reason why I use this tool.

[Ventolin]

Originally Posted by Atak_Snajpera

I'm not saying about discarding everything before first keyframe.
Slider should be rewinded to first key-frame by default. See screenshot


I see no reason to cut stream at P or B frame. Only cutting at key frame maintains audio synchronization if we want to transcode file further. This is main reason why I use this tool.

Lets take the following two scenarios:

TV capture:
When I capture a TV programme I like to start capturing a few minutes before the start of the actual programme itself - that way I won't miss the very start if it's broadcast early. Then when I load the captured .ts file into TSPE I look for the start of the programme. This almost never is at the first I frame, but usually a minute or two into the file. So I dont really need to look at the first I frame. However, I might be interested at looking at the PAT and PMTs which could be at the very start of the stream.

BD analysis:
Suppose I want to look at a stream from a BD. Again the first few packets are the PAT/PMT, followed by an I-Frame for the start of the video. In this situation, I am already at the point I want to edit with.

So, I think in most situations starting from the very beginning of the stream is correct?

I guess the only time I'd want the very first I frame is if I have missed the start of the captured programme, in which case it's a simple case of navigating to the first I frame.

In any event, it's certainly possible to make sure the edit always starts with an I frame so you don't have to look for it manually. I'll look into that possiblity further, thanks

Regards,

Vent

[JonRead]

Thanks, I will test out with UK satellite broadcast HD h.264 streams and let you know if I find any bugs.

[Ventolin]

Originally Posted by JonRead

Thanks, I will test out with UK satellite broadcast HD h.264 streams and let you know if I find any bugs.

Hi, Please do let me know how you are getting on!

Vent

[robinsj]

In your editor is there a way to manually enter a time you want to go to in a video?

[Ventolin]

Originally Posted by robinsj

In your editor is there a way to manually enter a time you want to go to in a video?

I'm just going to add that in right now, this very minute! Well OK, maybe the next minute or two as I'm still typing

Cheers,

Vent

[robinsj]

Okay another question.... I am trying to edit a few movies that I have that my wife really likes, but she really hates hearing the F-word in movies.... So I am trying to use your software to edit them out. (not really interested in getting into an arguement about editing a movie to take out language, so please leave that alone to whomever is interested in arguing)

So what is the best way to do it..... Here is what I have tried to do... I try playing the movie in the preview window, and then I just hit pause right before he says it and mark that as the end, then add that to the edits. Then I play it again until it has passed that he said it, usually only is like half a second or so... and then mark that as the beginning, and then go all the way to the end of the movie and mark that as the end and then add that to the edits. So basically I have a very small portion that is maybe 15-25 frames long that is being cut out. Well, then when I edit it and go to play it, it seems it totally misses the swear word and cuts something else out within frames from where i was trying to cut. Does this have to do with the PID's? Or the I-Frames? I tried unselecting Fix tables and timecodes, and that seemed to work, but then all I got was digital snow instead of just a clean cut...??

Any Help?

[Ventolin]

Originally Posted by robinsj

Okay another question.... I am trying to edit a few movies that I have that my wife really likes, but she really hates hearing the F-word in movies.... So I am trying to use your software to edit them out. (not really interested in getting into an arguement about editing a movie to take out language, so please leave that alone to whomever is interested in arguing)

So what is the best way to do it..... Here is what I have tried to do... I try playing the movie in the preview window, and then I just hit pause right before he says it and mark that as the end, then add that to the edits. Then I play it again until it has passed that he said it, usually only is like half a second or so... and then mark that as the beginning, and then go all the way to the end of the movie and mark that as the end and then add that to the edits. So basically I have a very small portion that is maybe 15-25 frames long that is being cut out. Well, then when I edit it and go to play it, it seems it totally misses the swear word and cuts something else out within frames from where i was trying to cut. Does this have to do with the PID's? Or the I-Frames? I tried unselecting Fix tables and timecodes, and that seemed to work, but then all I got was digital snow instead of just a clean cut...??

Any Help?

Small edits are hard to deal with as what you really want is frame accurate video. TSPE can only do I frame for the start point and P frame for the end point, so you may find your edits do not line up exactly where you want them.

However, as TSPE can process at the packet level, there is a way to edit just the audio out but leave the video intact.

This isn't so easy to do however, and will take some experimentation to get to know how to do it easily. Level of difficulty for this is 5/10.

Lets take 1 swear word as an example. You will have 3 edits:

1. The start of the movie to the beginning of the swear point (section A)
2. The swear point (section B)
3. The end of the swear point to the end of the movie (section C)

To do audio editing, set the "Frame Step" mode to be audio instead of Video (bottom left hand corner). This makes the F+ and F- buttons jump to audio frames instead of video frames.

Now do the following:
Setup section A:
1. Set the start point to the start of the movie.
2.Set the end point to the start of the swear word.
3. Click Add to add this section to the EDL.

Setup section B (the swear word):
4. Set the start point to be the start of the swear word.
5. Set the end point to the be end of the swear word.
6. In the PID list, uncheck the audio stream. (This strips out the audio stream for section B)
7. Click Add to add this section to the EDL.

Setup section C (from the end of the swear word to the end of the file)
8. Set the start point to the end of the swear word.
9. Set the end point to the end of the file.
10. In the PID list, re-check the audio stream.
11. Click Add to add this section to the EDL.

To complete the edit:
12. Turn off "Clean Video" and "Clean Audio" under "Clean Edits" from the menus.
13. Click the Edit button.

This should now copy everything up to the swear word intact, then strip the audio only for the swear word itself, then copy everything after the swear word intact.

As long as you play

[rebkell]

I'm trying to understand the PTS stamps, I have a common problem I'm encountering with the Hauppauge HDPVR unit, it has audio dropouts and then it resets and basically just starts a new recording at that spot in the stream, unfortunately the video usually continues for a half a dozen frames or so, before it restarts. I can pretty much cut out the bad place and maintain sync, I know exactly what I want to cut out, but I can't seem to match up the timestamps(PTS) in xport(which are exact matches for what are exactly in the ts file) with the ones you show.

For example the first PTS of the ts file is always
43843, but according to TSPE the first PTS is:
00:00:00:14 (29) 487 .. how to I match these two PTS stamps up? I'm not seeing a correlation between the two, I tried changing from PCR to PTS based in the Options->Timestamp Mode, but I didn't see any difference.

Upon looking I do see how they correlate, 487 is the ms value of 43843, is there anyway I can get the raw 43843 to show in TSPE