dgindex doesn't detect pid

[jmac698]

I'm finding about half my files don't work in dgindex. It won't detect the pid, and gives me a big list, none of which are video or audio. If I specify the pid manually it still doesn't work. This file plays fine in VLC, it works fine in tsmuxer. I want to be able to use it in avisynth though, as directshowsource isn't working for me right now.
I'll make a sample.

[jmac698]

Here ya go:
http://www.mediafire.com/?97306hu22241bhr
Thanks if you're able to try it :)

[poisondeathray]

as a workaround you can remux with tsmuxer then use dgindex

[Guest]

The stream is illegal because it has no PAT/PMT. Where did this stream come from? Knowing that will help me to resolve this.

You can open it and then do Stream/Set PIDs. Set the video PID to 980. You will see the video. I am investigating why the raw PID detection does not show that PID at all, let alone as a video stream.

As a workaround, open it in VLC and query the PIDs in View/Media Information/Codec details when it is playing and then use them manually in DGIndex.

[Guest]

The stream has a transport sync error, which kills my PID detection. I will try to make it more robust to such errors. I still would like to know the source of the stream and how you captured it.

xport Transport Stream Demuxer 0.96
program = 1, video channel = 1, audio channel = 1
Program Number = 1 (0x0001), Program Map PID = 55 (0x0037)
Transport Sync Error, skipped 73 bytes, at 44 <------------------------------ kills my PID detection!
program descriptor = 0x88, 0x04, 0x0f, 0xff, 0xc4, 0xfc
Video PID = 2432 <0x0980>, type = 0x02
Audio PID = 2433 <0x0981>, type = 0x81
ES descriptor for stream type 0x81 = 0x0a, 0x04, 0x65, 0x6e, 0x67, 0x00
Audio Bitrate = 384000, Audio Sampling Rate = 48000
Audio Mode = 2/0, bsid = 6, bsmod = 0
Sequence Header found
26 frames before first Sequence Header
Horizontal size = 1920
Vertical size = 1080
Aspect ratio = 16:9
Frame rate = 29.97
Sequence header bitrate = 25000000 bps
Progressive Sequence = 0
First Video PTS = 0xa89e0530
First Audio PTS = 0xa89dfd3b, -2037
ts rate = 450760, video rate = 3479986
packets for pid 0 <0x0000> = 197, first = 1, last = 48047
packets for pid 55 <0x0037> = 154, first = 1012, last = 48048
packets for pid 2432 <0x0980> = 42407, first = 50, last = 48178
packets for pid 2433 <0x0981> = 5424, first = 45, last = 48183
packets for pid 5269 <0x1495> = 1, first = 44, last = 44
coded frames = 454, video fields = 1135

[Guest]

OK, I have it fixed in DGDecNV; the stream opens right up with the correct PID and video. Now I will port it to DGIndex and give you a test version.

[Guest]

Here you go:

http://neuron2.net/misc/DGIndex_jmac698.zip

You should investigate the sync error, as it may lead to corrupted video or audio if it occurs throughout the stream (it occurs only once in your sample). Again, knowing the source and how you captured/processed it would help in assessing the seriousness.

[Guest]

Not all the way there yet. There's a bad frame displayed at the beginning when you preview with F5. Strangely it doesn't happen in DGDecNV.

Investigating...

[jmac698]

Dude, that is absolutely incredible :) Thanks man :)
It was captured through firewire interface of cable box. I have many files like this, let me test them with your new version. And also I am glad to have helped detect this limitation so that you can improve your wonderful program.

[Guest]

Did you see my edit? There's still a little work left but it should be much better.

What cable box gives you content in the clear over firewire???

[jmac698]

I've never seen anything encrypted... firewire was a requirement made by the FCC (communications dept. of USA), on all cable boxes since Apr 1, 2004. I can't find the regulation now, but certain types of channels (maybe local ones?) had to be unencrypted. There was only a US model made so any other country that used these boxes had the same features. So for example you get reports like this: http://forums.sagetv.com/forums/archive/index.php/t-33553.html and drivers here http://home.comcast.net/~exdeus/stbfirewire/
You can change channels, view live in vlc and stream etc. JVC D-VHS could record these shows up to HD. Some Sony TV's had live firewire video inputs. You don't see the menus on it, though. With a modulator, you can even record your own signals, which I can use to do a calibration of the analog outputs. You could even record your own DVD's to the DVR if you want. There's also many clear QAM signals on the cable you can pick up with a computer tuner anyhow. Finally I found a way to combine two airings (or select certain frames of 720p) to get double the quality.
Interesting thing though, I found with ProjectX that some packets were marked scrambled but they weren't encrypted, but the commercials weren't, so they were all marked for me :) Could you make a filter for only scrambled packets?
I'll try to get a sample...
Sorry, I just had a lot of fun with those :)

[SeeMoreDigital]

If it's of any interest...

TSremux (http://forum.doom9.org/showthread.php?t=125447) is able to open (some) transport streams that do not contain PAT/PMT data ;)


Cheers

[jmac698]

tsremux crashes immediately on the test.

[SeeMoreDigital]

tsremux crashes immediately on the test.Bummer... Not one of the "some" then :eek:

[Ghitulescu]

There's a SW from a German called TS-Doctor, was free during trials, now it's some 30€.
It claims it can correct many transmission errors. Give it a try.

[jmac698]

Yep, this program does work with the stream. It cut some garbage from the beginning, and even used my idea of cutting dd2.0 parts as commercials. One more feature I haven't seen though, is cutting parts where there is no pulldown pattern, this also separates movies from commercials and intros.
:thanks:

[jmac698]

You can see firewire capture here http://www.youtube.com/watch?v=sXJRJF-I45k

[Guest]

Thanks, jmac698!

[Ghitulescu]

One more feature I haven't seen though, is cutting parts where there is no pulldown pattern, this also separates movies from commercials and intros.
:thanks:
1% of transpiration (to revert the classical quote from Edison) must one sacrifice :), and forget not the animes, which often have an irregular pattern ....

[TheFluff]

1% of transpiration (to revert the classical quote from Edison) must one sacrifice :), and forget not the animes, which often have an irregular pattern ....

Japanese TV is almost exclusively 1080i, so anime is almost always hard telecined (but these days, it's usually a single fixed pattern between the commercial breaks, which makes it somewhat easier to deal with). Soft telecine exists only on a select few high-end satellite channels.

[jmac698]

Are you going to officially release the fixed dg's?

[jmac698]

Strangely silent?