noob question trying to demux TS with ProjectX

[mr.duck]

Utterly noob question but trying to demux TS file from DVB-T. I've managed to demux with ProjectX to give .m2v and .mpa files, but the audio and video are totally out of sync :( Same is true when you demux with VideoReDo. I thought these programs were supposed to take care of these offsets and sync issues :confused:

I'm sure I've used ProjectX months ago and managed to demux OK. I've been searching but cannot find out how to do it... How can I demux TS file with ProjectX and have the audio stay in sync?

[stax76]

I had the same problem recently, I think it's because I've stopped the recording 2 times shorty by accident so had 3 parts at the end, most record as single file. I never had problems before with ProjectX, you can try tsmuxer instead.

[mr.duck]

It's very annoying because I remember getting it working months ago. Demux with ProjectX --> mux to mkv with mkvmerge. The only reason I stopped using it was because I didn't get the right audio track one time (my batch file needed some more work or whatever).

As for tsmuxer, unfortunately there seems to be only 2 programs that can demux TS files from TV properly. ProjectX and VideoReDo. I'm using eac3to at the moment. That does a great job at least 9 times out of 10 but it's not perfect. I will persist...

[Ghitulescu]

I would also suggest PVAstromento and dvr studio pro, the latter being payware.

[stax76]

I've not used PVAstrumento since ProjectX was created, apparently it's still maintained, before ProjectX was created it was rather buggy, do you know if it's more reliable now and if it supports AVC?

[mr.duck]

I would also suggest PVAstromento and dvr studio pro, the latter being payware.

PVAstromento just flat out doesn't work at all. It completely fails to demux and I don't know why. It starts demuxing then just aborts. No settings I changed could make any difference.

I tried dvr studio. Remux TS to MPG and it goes out of sync :(

But that doesn't matter now because I figured out ProjectX. The problem was that after demux the audio was out of sync. But once you run the audio and video though mkvmerge, it is perfectly in sync again :) Using only ProjectX and mkvmerge, I just converted TS to MKV. A file that gave eac3to a real headache and could never get right even after multiple passes.

[Ghitulescu]

I've not used PVAstrumento since ProjectX was created, apparently it's still maintained, before ProjectX was created it was rather buggy, do you know if it's more reliable now and if it supports AVC?

I have no idea, probably no. I used it only once or twice, it worked. And I changed the SAT receiver and this one does the corrections to the stream on-the-fly, I haven't seen a single error in the stream. I use now TS doctor to check the streams.

[netmask]

PVAstromento just flat out doesn't work at all. It completely fails to demux and I don't know why. It starts demuxing then just aborts. No settings I changed could make any difference.

I tried dvr studio. Remux TS to MPG and it goes out of sync :(

But that doesn't matter now because I figured out ProjectX. The problem was that after demux the audio was out of sync. But once you run the audio and video though mkvmerge, it is perfectly in sync again :) Using only ProjectX and mkvmerge, I just converted TS to MKV. A file that gave eac3to a real headache and could never get right even after multiple passes.

I maintain a Wiki on ProjectX http://www.openwiz.org/wiki/ProjectX for Beyonwiz PVR users and I must update with newer images to reflect the latest version of PX.

Out of curiosity would you mind posting the ProjectX log for your troublesome file?

[mr.duck]

Out of curiosity would you mind posting the ProjectX log for your troublesome file?

I don't have it now but I have another troublesome file that eac3to would not be able to keep in sync.

[netmask]

Mr Duck you attachment is awaiting approval fro some reason - maybe you could just copy and paste into a code window?

[mr.duck]

Thursday, 7 October 2010 03:19:44 o'clock BST
ProjectX 0.90.04.00.b32 (31.10.2009)

-> working with collection 0

-> save normal log file
-> log 'packets out of sequence' / bit errors
-> log 'missing startcodes'
-> log 'PES header found in ES'
-> log WSS
-> log VPS
-> log RDS
-> log max. 500 warnings/errors
-> write all video data
-> write all other data
-> patch c.d.flagged infos of pictures
-> add sequence end code
-> set resolution in SDE
-> PES stream type disabled: LPCM Audio
-> PES stream type disabled: Teletext
-> PES stream type disabled: Generic_VBI
-> PVA: strictly specs. for audio streams
-> VOB: determine diff. Cell timelines
-> TS: ignore scrambled packets
-> TS: enhanced search for open packets
-> TS: join file segments (of Dreambox®)
-> TS: generate PMT stream dependent
-> get only enclosed PES/TS packets
-> concatenate different recordings
-> ensure 1st PES-packet start with video
-> generate PCR/SCR from PTS

-> write output files to: 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads'

-> main I/O-Buffersize in bytes 4096000 bytes

FileSegments:
* (0) T:\TV\River Cottage Bites\2010-09-20 Mon 12-03 C4 -- ock breads.ts
second. Files:
* ---

+> Input File 0: 'T:\TV\River Cottage Bites\2010-09-20 Mon 12-03 C4 -- ock breads.ts' (404,406,108 bytes)
-> Filetype is TS (generic PES Container)
-> demux
-> Service ID 0x20C0
-> PMT 0x012C refers to these usable streams:
Video:
PID: 0x0230(#3)
Audio:
PID: 0x0231(#138){eng}
PID: 0x0232(#148){eng}
Teletext:
n/a
Subpict.:
PID: 0x0233(eng_0x10_p2_a2 )

!> PID 0x0012 (EIT) (564 #4) -> ignored
ok> PID 0x0231 has PES-ID 0xC0 (MPEG Audio) (5264 #29)
ok> PID 0x0230 has PES-ID 0xE0 (MPEG Video) (6580 #36)
!> PID 0x012C (PMT) (24628 #132) -> ignored
!> PID 0x0000 (PAT) (25004 #134) -> ignored
!> PID 0x0014 (TDS) (44556 #238) -> ignored
!> PID 0x0011 (SDT) (225412 #1200) -> ignored
-> video basics: 704*576 @ 25fps @ 0.7031 (16:9) @ 15000000bps, vbvBuffer 98
-> starting export of video data @ GOP# 0
!> dropping useless B-Frames @ GOP# 0 / new Timecode 00:00:00.000
!> PID 0x0010 (NIT) (1446472 #7695) -> ignored
ok> PID 0x0233 has PES-ID 0xBD (private stream 1) (SubID 0x20) (49247540 #261956)
!> PID 0x0230 -> TS bit error in packet 301800 @ pos. 56738212, dropping.. (0 / false)
!> PID 0x0230 -> packet 301801 @ pos. 56738400 out of sequence (2/12) (shifting counter..) (~00:01:49.360)
!> PID 0x0231 -> packet 301803 @ pos. 56738776 out of sequence (14/11) (shifting counter..) (~00:01:49.360)
!> packet writing: length index out of bounds, shortened.. (231 / c0 / c0 / 915 -- 2344 / 16 / 2880) @ PTS 12:50:45.859
!> PID 0x0233 -> packet 301853 @ pos. 56748176 out of sequence (0/15) (shifting counter..) (~00:01:49.360)
!> incomplete ts packet at EOF detected @ 404406048
packs: 1860423 100% 404406108

++> Mpg Video: PID 0x0230 / PesID 0xE0 / SubID 0x00 :
-> Video: fr-ct-1p-cg-og-dg -> 20628-1-0-1715-0-0
-> Video length: 20628 frames @ 00:13:45.120
-> GOP summary: min. 8, max. 36 fields; contains interlaced frames
-> avg. nom. bitrate 3080150bps (min/max: 1348000/5661600)
-> set first sequenceheader bitrate to 5661600bps
---> new File: S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.m2v

++> Mpg Audio: PID 0x0231 / PesID 0xC0 / SubID 0x00 :
-> check CRC of AC-3 / MPEG-Audio L1,2
-> remove CRC in MPEG-Audio L1,2
-> add frames
-> Audio PTS: first packet 12:48:56.059, last packet 13:02:41.779
-> Video PTS: start 1.GOP 12:48:56.789, end last GOP 13:02:41.949
-> adjusting audio at video-timeline
-> src_audio: MPEG-1, Layer2, 48000Hz, stereo, 192kbps, CRC @ 00:00:00.000
!> missing syncword @ 2636929, @ 00:01:49.152
!> found syncword @ 2637528
!> 2 frame(s) (48ms) inserted @ 00:01:49.152
!> 2 frame(s) (48ms) inserted @ 00:01:49.272
!> 2 frame(s) (48ms) added @ 00:13:45.072
audio frames: wri-pre-skip-ins-add 34380-0-0-4-2 @ 00:13:45.120 done...
---> new File: 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.mp2'

++> Subpicture: PID 0x0233 / PesID 0xBD / SubID 0x20 :
Multicolor OFF / switches 00000000
-> selected DVB subpicture color model: (0) 4 colors ; fixed to page id:
-> export format: sup
-> temp. file: ProjectX DeMux.sp (566842 bytes)
-> Subpicture PTS: first packet 12:50:33.468, last packet 13:01:25.404
-> Video PTS: start 1.GOP 12:48:56.789, end last GOP 13:02:41.949
-> adjusting subpicture at video-timeline
-> source is DVB Subtitle...
130 subpictures written...
---> new File: S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.sup

-> create VobSub Files (idx + sub) : S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.sup.sub

summary of created media files:
.Video (m2v): 20628 Frames 00:13:45.120 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.m2v'
Audio 00 (mp2): 34380 Frames 00:13:45.120 0-0-4-2 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.mp2'
SubPicture 00: 130 subpictures 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.sup'
=> 337,923,035 bytes written...
-> we have 18 warnings/errors.

[Ghitulescu]

++> Mpg Audio: PID 0x0231 / PesID 0xC0 / SubID 0x00 :
-> check CRC of AC-3 / MPEG-Audio L1,2
-> remove CRC in MPEG-Audio L1,2
-> add frames
-> Audio PTS: first packet 12:48:56.059, last packet 13:02:41.779
-> Video PTS: start 1.GOP 12:48:56.789, end last GOP 13:02:41.949
-> adjusting audio at video-timeline
-> src_audio: MPEG-1, Layer2, 48000Hz, stereo, 192kbps, CRC @ 00:00:00.000
!> missing syncword @ 2636929, @ 00:01:49.152
!> found syncword @ 2637528
!> 2 frame(s) (48ms) inserted @ 00:01:49.152
!> 2 frame(s) (48ms) inserted @ 00:01:49.272
!> 2 frame(s) (48ms) added @ 00:13:45.072
audio frames: wri-pre-skip-ins-add 34380-0-0-4-2 @ 00:13:45.120 done...
---> new File: 'S:\DeMux\River Cottage Bites - 2010-09-20 Mon 12-03 C4 -- ock breads\ProjectX DeMux.mp2'


see above :)

[netmask]

Mr Duck I have logged a file I transferred using the settings shown in my wiki (signature below) although 26 errors were reported all was in sync and ok. Not sure what settings in ProjectX you are using but take a look at mine and see if that helps.

[00:07:01.835] Saturday, October 9, 2010 11:07:01 AM EST
[00:07:01.836] ProjectX 0.90.04.00.b29 (21.02.2009)
[00:07:01.882]
[00:07:01.882] -> working with collection 0
[00:07:01.883]
[00:07:01.883] -> save normal log file
[00:07:01.883] -> log 'packets out of sequence' / bit errors
[00:07:01.884] -> log 'missing startcodes'
[00:07:01.884] -> log 'PES header found in ES'
[00:07:01.884] -> log WSS
[00:07:01.884] -> log VPS
[00:07:01.884] -> log RDS
[00:07:01.885] -> log max. 500 warnings/errors
[00:07:01.885] -> write all video data
[00:07:01.885] -> write all other data
[00:07:01.885] -> patch c.d.flagged infos of pictures
[00:07:01.885] -> add sequence end code
[00:07:01.885] -> set resolution in SDE
[00:07:01.886] -> PVA: strictly specs. for audio streams
[00:07:01.886] -> VOB: determine diff. Cell timelines
[00:07:01.886] -> TS: ignore scrambled packets
[00:07:01.886] -> TS: enhanced search for open packets
[00:07:01.886] -> TS: join file segments (of Dreambox®)
[00:07:01.887] -> TS: generate PMT stream dependent
[00:07:01.888] -> get only enclosed PES/TS packets
[00:07:01.888] -> concatenate different recordings
[00:07:01.888] -> ensure 1st PES-packet start with video
[00:07:01.889] -> generate PCR/SCR from PTS
[00:07:01.889]
[00:07:01.890] -> write output files to: 'E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song'
[00:07:01.891] -> 2 cutpoint(s) defined ( (0) use BytePos. for cuts )
[00:07:01.891]
[00:07:01.891] -> main I/O-Buffersize in bytes 4096000 bytes
[00:07:01.896]
[00:07:01.897] FileSegments:
[00:07:01.897] * (0) E:\BeyonwizTransfers\The Music Instinct_ Science & Song.ts
[00:07:01.898] second. Files:
[00:07:01.898] * ---
[00:07:01.898]
[00:07:01.899] +> Input File 0: 'E:\BeyonwizTransfers\The Music Instinct_ Science & Song.ts' (1,930,428,416 bytes)
[00:07:01.899] -> Filetype is TS (generic PES Container)
[00:07:01.899] -> demux
[00:07:01.910] -> Service ID 0x221
[00:07:01.911] -> PMT 0x100 refers to these usable streams:
[00:07:01.912] Video:
[00:07:01.912] PID: 0x200(#1)
[00:07:01.913] Audio:
[00:07:01.913] PID: 0x28A(#2)(eng)
PID: 0x17C0(#5)[PD]
[00:07:01.913] Teletext:
[00:07:01.914] PID: 0x240(#3)(eng_s801 )
[00:07:01.914] Subpict.:
[00:07:01.916] n/a
[00:07:01.916]
[00:07:01.918] !> missing sync. byte @ 82590164
[00:07:01.919] !> found sync. byte @ 82590280
[00:07:01.920] !> PID 0x100 (PMT) (82592536 #13) -> ignored
[00:07:01.939] ok> PID 0x240 has PES-ID 0xBD (private stream 1) (TTX) (82595168 #27)
[00:07:01.945] ok> PID 0x200 has PES-ID 0xE0 (MPEG Video) (82602312 #65)
[00:07:01.950] !> PID 0x0 (PAT) (82650816 #323) -> ignored
[00:07:01.954] ok> PID 0x28A has PES-ID 0xC0 (MPEG Audio) (82695748 #562)
[00:07:02.145] -> cut-in @ GOP# 6 / new vframe 0 / new Timecode 00:00:00.000 (84913960)
[00:07:02.146] -> saving cut PTS value (1308220146) to file..
[00:07:02.147] -> video basics: 720*576 @ 25fps @ 0.7031 (16:9) @ 10000000bps, vbvBuffer 110
[00:07:02.147] -> starting export of video data @ GOP# 6
[00:07:02.147] !> dropping useless B-Frames @ GOP# 6 / new Timecode 00:00:00.000
[00:07:21.342] !> missing sync. byte @ 439680864
[00:07:21.342] !> found sync. byte @ 439681240
[00:07:21.343] !> PID 0x200 -> packet 1899419 @ pos. 439681240 out of sequence (1/2) (shifting counter..) (~00:09:33.040)
[00:07:21.344] !> PID 0x240 -> packet 1899428 @ pos. 439682932 out of sequence (10/9) (shifting counter..) (~00:09:33.040)
[00:07:21.344] !> PID 0x28A -> packet 1899441 @ pos. 439685376 out of sequence (12/9) (shifting counter..) (~00:09:33.040)
[00:07:21.346] !> packet writing: length index out of bounds, shortened.. (28a / c0 / c0 / 4004 -- 4072 / 16 / 4608) @ PTS 04:11:49.299
[00:07:21.375] !> dropping GOP# 1201 @ orig.PTS 04:11:49.379 (1359844146), errorcode: 24
[00:07:21.375] !> Pics exp/cnt 12/11, inGOP PTS diff. 0ms, new Timecode 00:09:33.520
[00:07:21.394] !> PTS difference of 43200 (00:00:00.480) to last exported GOP detected
[00:07:21.394] !> dropping useless B-Frames @ GOP# 1202 / new Timecode 00:09:33.520
[00:07:21.716] !> missing sync. byte @ 446725976
[00:07:21.717] !> found sync. byte @ 446726352
[00:07:21.717] !> PID 0x200 -> packet 1936891 @ pos. 446726352 out of sequence (8/6) (shifting counter..) (~00:09:41.600)
[00:08:11.797] !> missing sync. byte @ 1230569416
[00:08:11.797] !> found sync. byte @ 1230569792
[00:08:11.798] !> PID 0x200 -> packet 6106269 @ pos. 1230569792 out of sequence (9/8) (shifting counter..) (~00:32:24.320)
[00:08:11.799] !> PID 0x240 -> packet 6106324 @ pos. 1230580132 out of sequence (8/7) (shifting counter..) (~00:32:24.320)
[00:08:56.691] -> cut-out @ GOP# 6631 (1927286136)
[00:08:56.691] -> saving cut PTS value (1594420146) to file..
[00:08:56.769] packs: 9674667 99% 1929051644
[00:08:56.770]
[00:08:56.771] ++> Mpg Video: PID 0x0200 / PesID 0xE0 / SubID 0x00 :
[00:08:56.771] -> Video: fr-ct-1p-cg-og-dg -> 79484-15-6639-6624-0-1
[00:08:56.820] -> Video length: 79484 frames @ 00:52:59.360
[00:08:56.821] -> GOP summary: min. 20, max. 24 fields; contains interlaced frames
[00:08:56.822] -> avg. nom. bitrate 4128624bps (min/max: 2446800/7424000)
[00:08:56.822] -> set first sequenceheader bitrate to 7424000bps
[00:08:56.883] ---> new File: E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song.mpv
[00:08:56.932]
[00:08:56.933] ++> Teletext: PID 0x0240 / PesID 0xBD / SubID 0x10 :
[00:08:58.845]
[00:08:58.846] -> export format: srt
[00:08:58.864] -> temp. file: The Music Instinct_ Science & Song.tt (21991956 bytes)
[00:08:58.864] -> looking for page number 801
[00:08:58.957] -> Teletext PTS: first packet 04:02:12.604, last packet 04:55:19.864
[00:08:58.977] -> Video PTS: start 1.GOP 04:02:15.859, end last GOP 04:55:15.779
[00:08:58.978] ->adjusting teletext at video-timeline
[00:09:06.083] 826 pages of No. 801 written...
[00:09:06.083] ---> new File: E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song[801].srt
[00:09:06.146]
[00:09:06.147] ++> Mpg Audio: PID 0x028A / PesID 0xC0 / SubID 0x00 :
[00:09:06.183] -> check CRC of AC-3 / MPEG-Audio L1,2
[00:09:06.184] -> remove CRC in MPEG-Audio L1,2
[00:09:06.184] -> fill gaps with prev. frame
[00:09:06.184] -> add frames
[00:09:06.221] -> Audio PTS: first packet 04:02:12.723, last packet 04:55:19.731
[00:09:06.262] -> Video PTS: start 1.GOP 04:02:15.859, end last GOP 04:55:15.779
[00:09:06.263] -> adjusting audio at video-timeline
[00:09:06.306] -> src_audio: MPEG-1, Layer2, 48000Hz, stereo, 256kbps, CRC @ 00:00:00.000
[00:09:07.130] !> A/V sync discontinuity in next audio packet @ 00:09:33.144
[00:09:07.130] !> 1 frame(s) (24ms) inserted @ 00:09:33.144
[00:09:07.131] !> missing syncword @ 18452737, @ 00:09:33.528
[00:09:07.131] !> found syncword @ 18452952
[00:09:10.510] audio frames: wri-pre-skip-ins-add 132473-0-0-1-0 @ 00:52:59.352 done...
[00:09:10.553] ---> new File: 'E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song.mpa'
[00:09:10.561]
[00:09:10.562] summary of created media files:
[00:09:10.562] .Video (m2v): 79484 Frames 00:52:59.360 'E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song.mpv'
[00:09:10.562] Audio 00 (mp2): 132473 Frames 00:52:59.352 0-0-1-0 'E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song.mpa'
[00:09:10.562] Teletext 00: 826 pages of No. 801 'E:\BeyonwizTransfers\2010-10-07_16.19.54_The Music Instinct_ Science & Song\The Music Instinct_ Science & Song[801].srt'
[00:09:10.563] => 1,742,604,628 bytes written...
[00:09:10.564] -> we have 26 warnings/errors.

[mr.duck]

see above :)
Is that good/bad? :confused:


Mr Duck I have logged a file I transferred using the settings shown in my wiki (signature below) although 26 errors were reported all was in sync and ok. Not sure what settings in ProjectX you are using but take a look at mine and see if that helps.
I'm using nearly all the default settings. I changed one option just now. I ticked "Fill gaps with prev frame". But all seems to be the same after this. All the other options look OK too.

Just reminder that in post #6 I reported that things go back in sync again after running it through mkvmerge. Even with difficult files that would be impossible to get right with other programs like eac3to. So I'm getting good results at the moment.

The main problem I'm trying to work round now is that some of my TS files from specific TV channels have a secondary audio track that is mono and seems to be mute. With eac3to it was easy to choose the tracks you want as they were numbered 1, 2, 3, so you can just say you want tracks 1 and 2 for every file. With ProjectX when you demux it is easy to end up getting the mono track when you remux to mkv in the next stage of a batch file. Is there any settings or tricks I could use to make sure I get the correct audio track reliably?

[Ghitulescu]

As I said, I don't use ProjectX any longer, not because it's no good, but because I've changed the SAT receiver - the new one corrects the recordings on the fly. However, from what I was told and what I have personally read, ProjectX can synch everything in demux mode.

[netmask]

Locally files from digital TV often have 2 audio tracks, an AC3 and a mpa so it is easy to identify. However you could simply use mediainfo to identify the characteristics of the 3 or 4 audio tracks. I generally use Womble or SONY Vegas to recombine the video and audio and add effects etc; so far I haven't had any sync problems.
I find ProjectX essential for local free to air TV to maintain sync. Cable down here is a closed option as the cable and satellite set top boxes only provide an analog output and has a minor market share compared to the local 16 channels of FTA - so I have no experience with cable derived signals which until fairly recently were mpeg1 (crap!)

[mr.duck]

I'm using mediainfo now so thx for that tip. I can pretty much remux any TV recording I have now. Apart from badly corrupt files maybe. My batch files have grown in size and complexity considerably. I may post them when I make sure everything is working. They took hours to write.


The TV we get is pretty poor at times. Video bitrates are something like 2.9 Mbps MPEG2. We should be getting HD in a couple of years or less. That's a joke. I would be so pleased with just DVD quality. Even 1/2 DVD bitrates would be something like 5Mbps I think. I would gladly take that.