HD subtitle ripping (SUPread)

[Thunderbolt8]

Thunderbolt8, there is no source for supread. It's also written in Delphi, which isn't very commonly known.

I have been thinking of writing my own version - although it won't be much more functional than suprip if I ever do start on it.
im basically already fine with supread. the only problem remaining for me is that sometimes subtitles from this or that movie cannot be displayed at all, theres nothing to be seen then other than the background (already tried all kinds of brightness and gamma tweaking). guess this is a bug, if this was fixed, it would already be enough, since I use finereader for further ocring.

[dburckh]

I'm trying to write an app to automatically convert HD DVD to Blu-Ray (w/o menus). I've got most of the code to drive eac3to and TsMuxer to this end, but subtitles are a real PITA. It looks like this app. will read in HD DVD and save the titles as Blu-Ray compatible (PGS) format.

I was wondering if there are any CLI options? I was able to open a .sup file by adding it to the command line, but kind of got stuck there. I'm looking for things like triggering the export button and possibly setting the frame rate. I would prefer not to do a sendkeys solution.

If that isn't possible, does anybody have specifications on how to create a PGS stream? Assuming it's not far from DVD, I think I can decode the HD DVD subtitles.

[Rectal Prolapse]

dburckh, you may want to look at AutoIt scripting as a solution to automating the supread GUI.

[dburckh]

I got it working with a .vbs script using sendkeys last night. It's not 100% stable, but I am able to control the conversion programmaticly and detect completion.

Through some tricks, I can tell if it's processing, or it failed. SUPRead defaults to Blu-Ray and 23.976. Eventually, I know I'll hit something that really is 1080i30 and it may pose a problem.

Now I just have to decouple the HD DVD conversion code out of ToNMT and integrate the subtitle code.

[laserfan]

As an aside, I made a HD DVD to BD conversion the other day where in the muxed output, turning-on the subtitle resulted in some odd blocking (resulted in black over the picture image, to the right of the subtitle) and even after turning-off the sub the black remained.

If anyone knows of a good way to TEST SUPread's output before the muxing step, I'm all ears.

Oops, I forgot to mention that I HAD tested the mux with a couple of PC players, and it appeared to work OK, but this problem only appeared after burning, on a set-top player.

[dburckh]

As an aside, I made a HD DVD to BD conversion the other day where in the muxed output, turning-on the subtitle resulted in some odd blocking (resulted in black over the picture image, to the right of the subtitle) and even after turning-off the sub the black remained.

If anyone knows of a good way to TEST SUPread's output before the muxing step, I'm all ears.

Oops, I forgot to mention that I HAD tested the mux with a couple of PC players, and it appeared to work OK, but this problem only appeared after burning, on a set-top player.

Were those PGS or SRT files? I was hoping PGS would work because it's lossless and automateable. If it requires SRT, I could force the user to verify.

I don't have a set top player either.

[laserfan]

Were those PGS or SRT files? I was hoping PGS would work because it's lossless and automateable. If it requires SRT, I could force the user to verify. I don't have a set top player either.It was an HD-DVD.sup to BD.sup (PGS).

Last time I tried this, bd.sup worked no problem, and as I recall I "tested" the bd.sup output by opening with SupRip, which thought it was a BD sup and OCR'ed it just fine. I was just uncertain about this PGS-to-PGS process so SupRip was all I could think of short of muxing & testing.

But I didn't bother with SupRip this last time, maybe I will try a do-over and see what SupRip thinks about the SUPread BD output. I could also demux into individual PGSes I suppose and look at those...

[laserfan]

I was hoping PGS would work...Well, don't let my one bad experience slow you down. I re-ripped the troublesome hddvd.sup again, made a bd.sup, and SupRip OCR'ed it like nobody's business--seems just fine. Maybe my stb player glitch was due to tsmuxer perhaps, and not SUPread at all. :o

P.S. I just tried BDSup2Sub on my converted HDDVD.sup and it also works fine. A nice tool btw just to see the graphics in all their glory.

Anyway still it appears SUPread is working well.

[astronman]

Does anyone knows how to make SUP file for BluRay from srt or sub file??

[0xdeadbeef]

A two step solution should work via the BDN XML format. There are at least two free tools available to convert BDN XML to BD-SUP: BDSupEdit and BDSup2Sub.
So the only problem is to convert SRT (or VobSub) to BDN XML. AFAIK Subtitle Workshop is able to.

[Ulf]

Does anyone knows how to make SUP file for BluRay from srt or sub file??

Well, I do. Take a look at this (http://forum.doom9.org/showthread.php?t=146488)post for srt to SUP creation.

[PassThePeas]

As an aside, I made a HD DVD to BD conversion the other day where in the muxed output, turning-on the subtitle resulted in some odd blocking (resulted in black over the picture image, to the right of the subtitle) and even after turning-off the sub the black remained.

If anyone knows of a good way to TEST SUPread's output before the muxing step, I'm all ears.

Oops, I forgot to mention that I HAD tested the mux with a couple of PC players, and it appeared to work OK, but this problem only appeared after burning, on a set-top player.

Looks like you're running into the same issue I mentioned earlier in this post :
(...)I'm having an issue with hd-dvds subtitles converted to blu-ray when played on a stand-alone player (sony BDP-S350). (...)

As soon as the first sub appears, the screen goes black except for the subs bounding box (readjusting as each sub comes along)

The subs play just fine with software player (tmt or power dvd).
I tried to compare the subs to others extracted directly from BDs, and the only thing i came up with seems to be the palette : when i display it in supread, the first color is red (whereas it comes black with other subs). Extracting PNGs produces the sames result (red background for "bad displaying" subs and black for others).

Has anybody else experienced the same issue ? In that case, has any solution been found ?
Any clue as to resolving the issue (or finding a workaround) ?


I don't think I got an answer on this one ... sorry ;)

I didn't get time to go any further in searching a way to fix those subs ....

Peas.

[laserfan]

Looks like you're running into the same issue I mentioned earlier in this post :

I don't think I got an answer on this one ... sorry ;)

I didn't get time to go any further in searching a way to fix those subs ....You're right, Peas, I missed your post. You did a better job of explaining the problem than I did!

I've tried a couple more HD-DVD conversions to BR recently, and am having no luck it seems even getting the converted subtitles to display at all, nevermind the "black" problems. I've used both SUPread and BDSup2Sub to try to make a BR-compatible subtitle directly from the HD-DVD original, and they just don't display at all when Subtitle is turned On. So I've had to use SupRip to convert to .srt and then tsMuxeR to make a subtitle from it on mux.

If anyone knows the magic of converting HD DVD subtitles to BR-compatible Reliably (it seems SUPread works *sometimes* but not *all times*) by all means tell.

[0xdeadbeef]

While I wouldn't completely rule out the possibility that both SupRead and BDSUp2Sub create BD-SUPs that are in a subtle way not compliant to the BD specification, chances are that the source of the problem is somewhere else. This idea is also strengthened by the fact that the subtitles are displayed for some people.

Anyway, if captions are displayed for SRTs converted by tsMuxer while they aren't for (bitmap) SUPs imported by tsMuxer, this shows that tsMuxer treats them differently.

Indeed, I find it hard to believe that the BD-SUPs created by either SupRead or BDSup2Sub are so corrupt that not a single caption can be decoded by a standalone. It seems much likelier that there is an issue in the transport stream or BD structure that doesn't allow certain standalones to access the captions at all.

[PassThePeas]

While I wouldn't completely rule out the possibility that both SupRead and BDSUp2Sub create BD-SUPs that are in a subtle way not compliant to the BD specification, chances are that the source of the problem is somewhere else. This idea is also strengthened by the fact that the subtitles are displayed for some people.

I agree with that. I don't think the issue is coming from those apps.


Anyway, if captions are displayed for SRTs converted by tsMuxer while they aren't for (bitmap) SUPs imported by tsMuxer, this shows that tsMuxer treats them differently.

Agree again. Difference is pretty big because when you feed tsMuxer with an srt file, it actually builds the SUP file for you. In the other case, it just uses the one you feed to mux it in the output file/structure you chose.


Indeed, I find it hard to believe that the BD-SUPs created by either SupRead or BDSup2Sub are so corrupt that not a single caption can be decoded by a standalone. It seems much likelier that there is an issue in the transport stream or BD structure that doesn't allow certain standalones to access the captions at all.
The problem doesn't not really come from the subs which display fine. The problem is that once one appears, that's all you gonna get from the movie you're looking at : subs surounded by a black screen (and sound if you turn the volume up) !!

My opinion is that the problem comes from the palette that uses a color (apparently close to red) which is not correctly handled by the SAP as the transparent color. It has the nasty effects not to be that transparent when displayed on screen and then to mess up the rendering software of the SAP in such a way that even if you turn off subtitles, screen won't come clean again (unless you go back to menu/stop playing and start again) ....



That explanation is also coherent with the fact that software players that (for some unknown reason) tends to manage that background/transparent color better.

I made some tests at the time to try and extract pngs directly from the HD-DVD sup file and I think they had already red background, which would clear SUPread from being the culprit !

I'll check that when I get home and give feedback.

If this is true, then the problem either lies directly in the original sup stream in the EVO file or in EVODemux process to extract it.


Peas.

[laserfan]

...the problem either lies directly in the original sup stream in the EVO file or in EVODemux process to extract it.In my case(s), the demuxing has always been done by eac3to, not EVODemux. Then I would convert with SUPread, and if that output didn't work (with tsMuxeR output), next BDSup2Sub, then finally giving-up and making an .srt with SupRip and muxing with tsMuxeR cli.

BTW only once did I actually get a bad subtitle on my SAP--I'll usually check first (as I did just recently with a failed attempt at conversion) using PowerDVD 7.3 and Arcsoft TMT 2.0 (neither of these displayed anything at all).

[anode]

(strange display of converted HD-DVD subtitles)..

Maybe you could check the following: If the palette definition of the generated Blu-Ray *sup has 256 entries (00-FF)(which HD-DVD allows) then the subtitle isn't properly displayed.
From my research, Blu-Ray subtitle specs allows only 255 palette entries(00-FE).
You can check the palette definition with pelican9's SUPread. You have to switch on options/general/detailed info and see in the log file the palette size.
For me i have tried to write a tool that cuts the last entry of palette and replaces the references to this entry with the nearest similar one. That subtitles displayed without problems...

Perhaps 0xdeadbeef can implement this in his fantastic tool, if it is the reason for wrong displayed subtitles...

anode

[0xdeadbeef]

Maybe you could check the following: If the palette definition of the generated Blu-Ray *sup has 256 entries (00-FF)(which HD-DVD allows) then the subtitle isn't properly displayed.
From my research, Blu-Ray subtitle specs allows only 255 palette entries(00-FE).
256 entries are allowed, however the last palette entry (0xff) always has to be a transparent color.


For me i have tried to write a tool that cuts the last entry of palette and replaces the references to this entry with the nearest similar one. That subtitles displayed without problems...
The last entry must not be an opaque color. By deleting the last entry, it becomes transparent as every undefined entry is assumed to be transparent by definition.

Perhaps 0xdeadbeef can implement this in his fantastic tool, if it is the reason for wrong displayed subtitles...
I must admit I can't remember currently if BDSup2Sub doesn't consider the above limitation when converting from HD-DVD-SUP. If so, this is by mistake. I will have a look.

[EDIT]
Seems I really overlooked this case (although e.g. when converting from BDN XML it was considered).
Could I get a sample to test a fix?

[EDIT2]
OK, I put out 3.7.0, please give it a try.

[anode]

Could I get a sample to test a fix?

Here is one from the German HD-DVD "Die Insel":

http://rapidshare.de/files/47214409/THE_ISLAND_HDDVD_TEST.zip.html

Hope this will work, its my first try.

Thank you very much for looking into this..

[PassThePeas]

256 entries are allowed, however the last palette entry (0xff) always has to be a transparent color.


The last entry must not be an opaque color. By deleting the last entry, it becomes transparent as every undefined entry is assumed to be transparent by definition.


I must admit I can't remember currently if BDSup2Sub doesn't consider the above limitation when converting from HD-DVD-SUP. If so, this is by mistake. I will have a look.

[EDIT]
Seems I really overlooked this case (although e.g. when converting from BDN XML it was considered).
Could I get a sample to test a fix?

[EDIT2]
OK, I put out 3.7.0, please give it a try.

OK, I've got two words for you : THANKS and WON-DER-FUL !!!!

I've just made two tests : one with a SupRead HDDVD->BD converted file and another one with a HDDVD file directly converted with BDSup2Sub.
Once each of those files converted by BDSup2Sub to BD format (palette : create new), I remuxed and burn the BDs and it works flawlessly : no black screen, no bounding box .... just a movie and its subs !!!! :thanks::thanks::thanks:

You've just made my day !

Peas.
PS: I can't remember if I said it : THANKS !

[0xdeadbeef]

Once each of those files converted by BDSup2Sub to BD format (palette : create new), I remuxed and burn the BDs and it works flawlessly : no black screen, no bounding box .... just a movie and its subs !!!! :thanks::thanks::thanks:
You're welcome and thanks for testing.
The "palette : create new" setting doesn't have an influence here btw - it only comes into play it the image is scaled.

[anode]

OK, I put out 3.7.0, please give it a try.

Could you please try my sample?

3.7.0 crashes when i want to save that file to BR/SUP with some IndexOutOfRange-Messages...

:thanks:

[0xdeadbeef]

Yeah, heck, I screwed it up. Try 3.7.1.
Anyway, let's continue discussion about BDSup2Sub in the according thread.

[Pelican9]

Hi all!

How do you get the PG streams from a BD?
I mean, which software is preferred?

[hubblec4]

hi Pelican9

nice to see you are back.

i use eac3to to demux a bluray only. after the demux i have the PGS files with information in the filename like this
"00048 - 8 - Subtitle (PGS), German, 1727 normal captions, 29 forced captions.sup"

What would you do?

[Pelican9]

Edit:

A new snapshot is available soon with minor bugfix, improved BD compatibility (can read larger graphic).
http://pel.hu/down/SUPread_053.gif


hi Pelican9

nice to see you are back.

i use eacto to demux a bluray only. after the demux i have the PGS files with information in the filename like this
"00048 - 8 - Subtitle (PGS), German, 1727 normal captions, 29 forced captions.sup"

What would you do?

Thanks!
So, your vote is eac3to. :)

I'm developing the BDedit (and SUPread).
I've spent the last two hours to figure out why my PTS/DTS values are too big... forgot to substract the first video PTS... :rolleyes:

[frank]

Download broken.

[Pelican9]

Download broken.
:thanks:

I've fixed it.

[Thunderbolt8]

thanks for the new update, appreciate it. hopefully the bug is gone that all titles can be read now (in some rare cases the colours were so strange that OCR programs couldnt read the letters, or sometimes the suptitle file looked empty with nothing at all, while it worked fine with suprip).

[movq]

i load .sup file,then OCR all ok,but nothing on srt menu except line 1 or 2 etc,why

[PowerGamer]

I am getting "Access violation" message when trying to open this .sup file (http://www.multiupload.com/1MJP7YLET4) (extracted by eac3to from Monsters, Inc. BluRay) in SUPread v0.53b2. Any chance this bug can be corrected? Thanks in advance.

[Thunderbolt8]

there has been a small update today

[Octo-puss]

Could anyone explain how to use this program to me please? I don't understand the options, and I can't get it to read subtitles properly.
This is more or less what I get instead of text:
·····d·r'···:····'·d·····:r:··.
·d:··:···:·d···r··:·d.

[sneaker_ger]

I don't know the answer, but maybe an alternative program would be ok?
Extract subtitles with e.g. eac3to and OCR them using SubExtractor (http://forum.doom9.org/showthread.php?t=162633) or Subtitle Edit (http://www.nikse.dk/subtitleedit).