Buffer Overflow 0003 Errors

[beretta79]

jdobbs,
I know you don't like concerning yourself with people that preprocess, but is there any way to get around 0003 errors after preprocessing with DvdRemake? Most titles work fine preprocessing, but some episode dvd's result in the 0003 errors.
Thanks

[Sir Didymus]

In another thread it has been suggested as a clever solution for this type of troubles to use DvdRemake as a POST PROCESSOR...

[beretta79]

Yes I think it would work fine to post process that way. However, my point of preprocessing is that by removing things like opening and ending credits from each episode, you can save 300 to 500 MB. Thus ending up with a better quality rebuild. For instance, Sopranos Season 1 Disc 1 originally is 7.29 GB, after preprocessing it is 6.85 GB. A savings of 440 MB, I think that can make a noticeable difference to the end result.

[Sir Didymus]

You may tweak the "target size" in DVD-RB in order to produce an oversized output for the amount you need to cut in the post processing.

I never tryed this but, again, it has been reported other time to work.

Please go to the settings thread and get a look to the hidden settings...

I understand that you have to tweak a bit, and it is not immediate...
But you should understand that DVD-RB is in its beta test stage, and Jdobbs reported many times that there is no point for now to debug a third part application or non standard titles...

Cheers,
SD

[Dimad]

Originally posted by beretta79
jdobbs,
I know you don't like concerning yourself with people that preprocess, but is there any way to get around 0003 errors after preprocessing with DvdRemake? Most titles work fine preprocessing, but some episode dvd's result in the 0003 errors.
Thanks

Searching through the forum it looks like DvdReMake is not the only source of this error. In any case, I can probably change something in DRM so that ReBuilder will not have problems with its output. But I need to know what this error is and what in DvdReMake output might cause it.

@jdobbs
Congrats on a nice app. I can only imagine how busy you are, but would appreciate if you can contact me once you up to looking into this problem. There is a copy of dvdremake waiting for you :) when you decide to use it to reproduce the problem.

[jdobbs]

@Dimad

As DVD-RB recreates the VTSs, between each packet to be written as output it pulls audio and subpicture packets for the original stream and places them in the correct temporal position based upon SCR and PTS values. This error indicates that there was an extremely large number of consecutive sp/audio packets inserted between video packets -- so many that the buffer space (meant to hold one VOBU) was exceeded. The best guess for a cause of this error would be a situation in which the SCR and/or PTS values of the original stream somehow got corrupted.

Not sure if that helps...

I'd love to get a copy of DVD ReMake to see if I can reproduce the problem... but from what I gather there are a lot of folks using it with DVD-RB successfully -- so I'm not sure how easy it will be to reproduce the error.

[NobbyNobbs]

I agree that Remake works fine with DVD RB, have not had any problems because of it, all problems I have had are also there on the original.

[Dimad]

Originally posted by jdobbs
@Dimad

As DVD-RB recreates the VTSs, between each packet to be written as output it pulls audio and subpicture packets for the original stream and places them in the correct temporal position based upon SCR and PTS values. This error indicates that there was an extremely large number of consecutive sp/audio packets inserted between video packets -- so many that the buffer space (meant to hold one VOBU) was exceeded. The best guess for a cause of this error would be a situation in which the SCR and/or PTS values of the original stream somehow got corrupted.

Not sure if that helps...


DRM does not touch SCR/PTS fields in vob files at all. Due to this it is possible to get a jump in SCR/PTS going from one cell(A) to another(B) if end of A or begining of B was cut (in this case SCR would start not from zero - but reading various docs I have not found anything that prohibits this).

[beretta79]

Let me know if you'd like any info from my Sopranos example. I removed the beginning credits by removing entire cells using the "hide block" option. The end credits were cut out of cells using the "cut from here" option.

[geffroman]

Has anyone made any headway on this yet...? I don't know what to think... I have a DVD that will work on DVD-RB... If I run ReMake it will fail on DVD-RB... But it works with Shrink, IC and others... Dimad says jdobbs has a copy of ReMake now so hopefully something can happen...

[beretta79]

I'm hoping the same thing...

[winny]

I'm in the same position, I'm backing up a copy of an old film called Tora! Tora! Tora!. Chapter 18 is sn old style Intermission of significant size. The use of DRM as a pre processor makes good sense here.

Once this has been removed I get the buffer overflow #3 error at the rebuild stage in Chapter 19, about a third of the way through the m2v.

[geffroman]

someone told me to make sure I was using Avisyn 2.54... He eliminated his 0003 issue that way... Not sure what you guys are running but I already have been on that version...

[winny]

Good idea Geffroman, and I can also confirm I am using Avisynth version 2.54.

[beretta79]

I'm also using 2.54

[beretta79]

I tried the same thing as before (removing opening and closing credits) using VobBlanker this time. I got the same result...the 0003 error.

[lighty]

I can confirm that this error does indeed occurs if I replace trailers with a blank in DVDStripper or DVDRemake- it doesn't matter.

I did try playing stripped files in WinDVD and everything worked fine so it must be DVD-RB related problem. I also tried transcoding in Shrink and everything works fine (I would use Shrink but even with trailers cut out and extras significantly reduced the main movie is at 67% of original so I do have to use CCE).

I can only say that error occured during a rebuilding phase of process.

I do have Avisynth 2.5.4 installed and everything works fine if I don't try to strip anything. It is a Final Destination 2 PAL.

[Joergen]

I've had a 0009 error ONCE from titlesetblanker + dvd-rb, but that was as soon as you hit prepare. So preprocessing can mess up things.

If you want to blank out trailers that reside in their own VTS, and you cant blank them due to an error, you can just move that VTS entirely out of the VIDEO_TS dir, prepare encode rebuild, then copy it back in the rebuilt VIDEO_TS dir, THEN blank it.

This of course assumes you are not leaving anything of significant size in that VTS so you dont oversize.

[zoidberg22]

@dimand

I notice you have DVDremake version 2.0 out...Is there anyway you might be able to test it with dvd-rb and see if it works smoothly.(In regards to #0003 errors)

It seems lots of dvds work already, so I've been having problems with Sopranos Season 2 Disc 1, if you want to try with a DVD that doesnt work.

These programs are some good stuff, I hope it all comes together

[ShadowKnight]

this Is my first time with the 0003 error, on school of rock R1. I pre-processed with DVDRemake, and the results play fine before running them through DVD-RB, and obviously I cant rebuild it after it encodes. I'm using RB v55b, and am hoping this problem isnt being ignored, simply for the fact that its caused from pre-processing. :-/
and not meant as an offence to jdobbs, but, doesnt it follow that if the dvd works perfectly fine after running DVD-ReMake, that the problem has to do with the method of which RB reads (or rebuilds) this "modified" information? and what exactly is the logic that would be followed that would prove otherwise? (am very curious about solving/learning about these compatibility issues)

Edit: oh and Im using ReMake 2.3.0

[Sir Didymus]

@SheadowKnight

I understand your question is posed to jdobbs, so I am afraid for the intromission, and I want to state clearily that everybody IMHO considers useful or even necessary the usage of preprocessing tools, at a certain stage of development of the application, for the proper preparation of the own backups.

I just think that at the present time (i.e at the stage of beta testing) it is just an additional complication to cope with a process based on multiple applications, since it may lead to situations where it could be very difficult to understand the origin of any given problem.

All the best,
SD

[ShadowKnight]

@Sir Didymus

I completely understand that train of thought, and I do know that this issue will be resolved at some point. I just think (and I may be wrong) that solving these problems would provide greater stability and flexibility down the line. My purpose in bringing this up at all, is NOT to bug Jdobbs into working on this as top priority. However, I do think that we could benefit from tossing some ideas around as to why pre-processing causes these issues, and maybe so that we can find the flaws that are holding back this area of development.
I'm not sure what exactly is causing the problems that can arise from pre-processing, but I do know that its been very rare for me to have any issues come up at all. So perhaps with some insight into the probable causes and some discussion will make troubleshooting/fixing these problems much easier for Jdobbs.

[ShadowKnight]

just for an update, still getting 0003 with RB56 and Remake2.3.4

[beretta79]

Just curious if either jdobbs or Dimad have looked any further into this issue. Thanks.

[Doc409]

My #0003/#0004 problems went away when upgrading to Remake Pro 2.3.4 and Rebuilder .56b. I am also using CCE Basic v2.69. It's my understanding that some having this buffer overflow problem did reinstall v2.67 and this solved the problem.

Also, when I was trying to solve the problem ... before the Remake and RB upgrades ... I ran unchanged Decrypted files and unedited Remake files through without any problems. (I would suggest doing this to establish that the RB-CCE is installed OK.). It was when I got into heavy editing with RMPro that I would get the error.

[AmigaFuture]

Has anyone been able to use DVDReBuilder 0.56b on The Matrix? I used DVD Decrypter 3.2.3.0 then DvdReMake Pro 2.3.4 to remove the Logo & warnings & removed PGCs 13, 14 & 15 (which in turn also removes interleaving) then export the DVD. Then have DVD Rebuilder process it.
I get 0003 every time.

Edit: -Rebuilding segment 5 VOBID:6 CELID:1 This is where I always get the buffer overflow. Filename is V02000500006001.M2V if that helps.

I don't know if it's a problem with DvdReMake Pro or DVD-RB.

Thanks.

[jdobbs]

The Matrix is an interleaved DVD and is not supported in v0.56. You should have gotten a warning message when you tried to run it.

[AmigaFuture]

Originally posted by jdobbs
The Matrix is an interleaved DVD and is not supported in v0.56. You should have gotten a warning message when you tried to run it.

Hi. I do get that message when I try it without any pre-processing. As Dimad says, DvdReMake Pro will deinterleave when you remove PGCs that are interleaved. Which is why I stated that in my message to make that clear.

[djan]

Originally posted by Doc409
My #0003/#0004 problems went away when upgrading to Remake Pro 2.3.4 and Rebuilder .56b. DVD-RB 0.56b ? From where did you get it ? The last version I have is 0.56 !

[AmigaFuture]

Oops, I'm a bit old school that way, back in the days of the Amiga (which is still going) & Commodore 64. When a program was in Beta we'd tack on "b" at the end of whatever revision number. It was so common that now guess I don't think about it much. Sorry for the confusion. Version 0.56 (Beta). ;)

[djan]

Oh, oki :)

[brobear]

2.8 GHz P4 Dell 8300; 1 GB RAM; 2 HDD (80 + 250 GB); XP Pro OS; Samsung DVD ROM; Memorex Dual Format 4X burner. Tried with both CCE Basic 2.67 and 2.69. Latest version of RB. Nero Recode2, WinDVD Copy2DVD, XCopy Platinum suite, DVD Shrink, CloneDVD2, CopyToDVD, these are among several programs that work well on my PC. So, it isn't an inability to record.

Ripped with latest DVD Decrypter in file mode. DVD-5 and DVD-9 produce the 0003 Buffer Overflow. This has happened on every movie tried. The only time the RB/CCE finished was when I cut out all sound tracks. With even one sound track and no processing and recording an old DVD-5, the failures continue to occurr. I followed the setup guide meticulously and don't understand what is going on. Most people have no problems, but a few of us seem to be plagued by this problem. A friend has a Dell and has no such problems. So I don't think it is a Dell thing. All suggestions appreciated. I've tried a number of checks and the problem keeps occurring.

[jdobbs]

@brobear

What version of Decrypter are you using, and what do you have checked in DVD Decrypter's "settings" tab for File Mode?

[jdobbs]

Originally posted by AmigaFuture
Oops, I'm a bit old school that way, back in the days of the Amiga (which is still going) & Commodore 64. When a program was in Beta we'd tack on "b" at the end of whatever revision number. It was so common that now guess I don't think about it much. Sorry for the confusion. Version 0.56 (Beta). ;) Amiga and Commodore 64... were those electric or steam powered?

[AmigaFuture]

@jdobbs

Hehe. :) The Amiga was doing it all before M$-DOG, & before Windows was a thought. Look it up, you'll see. It took M$ buying off Commodore because M$ knows the power of the Amiga, to get Windows as King Of The Hill (that & marketing). Besides M$ hasn't been innovative in YEARS, whereas the Amiga pioneered Personal Computers. Jay Miner did an excellent job as the Father of the Amiga, I don't think he would've let Commodore be bought out.

Windows is a tool, but the Amiga is loved by the people who use it & know it.

Don't forget, things become Classic & Classics never die, they become show-cased & improved on.

[RaistlinMajere]

the amiga??? haha funny. My ZX81 still rules, get with the times the amiga was good for a few years 10 years ago, now its a relic, donate it to a museum lol

[jdobbs]

Originally posted by AmigaFuture
@jdobbs

Hehe. :) The Amiga was doing it all before M$-DOG, & before Windows was a thought. Look it up, you'll see. It took M$ buying off Commodore because M$ knows the power of the Amiga, to get Windows as King Of The Hill (that & marketing). Besides M$ hasn't been innovative in YEARS, whereas the Amiga pioneered Personal Computers. Jay Miner did an excellent job as the Father of the Amiga, I don't think he would've let Commodore be bought out.

Windows is a tool, but the Amiga is loved by the people who use it & know it.

Don't forget, things become Classic & Classics never die, they become show-cased & improved on. Oh, I remember them well. My first computer was an S-100 bus based unit I built from a kit that used an Intel 8080... which came out years before the Amiga or Commodore 64.

If you look around you may even find some of my code in your old '64 dead-software pile:
- I wrote a driver for high-speed I/O to the 1541 disc drive.
- Wrote a CP/M 80-character terminal emulator for the Z80 add-on
- Wrote memory swapping software to utilize hidden memory under the video banks.
- Converted a famous CP/M chess game to work under C-64


In other words... I'm old.

[AmigaFuture]

Ah, yes, I remember a lot of that. Now I know who you are. :) I never was into I've spent more time Battling with Chess but never became very good at it but it was a lot of fun trying. My claim to Commodore 64 fame was a Rock'N'Roll BBS.

You never know who's who until you get more info from them. I've never written anything by myself as far as programming goes, always a joint effort. I know the projects you speak of *grin*. I still use my 64 software & play some of the games, mostly with my kid. He's learning the Amiga, 64 & Doze. ;) I figure he'll benefit from the knowledge of all 3 later.

I'm not old, however, just matured well like a fine cheese. :) I love your prg, DVD Rebuilder, & plan to donate very soon. Anyway, make sure you come up for air once in a while.

[brobear]

@jdobbs

Up until the latest version of DVD Decrypter came out yesterday (3.5.0.0), I was using the latest 3.2.3.0.
On Startup Select Files: All
Stream Processing Search 50,000 Sectors
File Splitting: By File
Multi Angle Processing: unchecked
All boxes are checked for remove protection and PUOs and patch timecode, all five boxes.

I understand multi angle movies are a problem and made a point of not using those. No pre-processing has been done. I even tried black and white DVD-5 to eliminate any compression being part of the problem. The only time I finished recording an entire video was when I eliminated all sound.

I used the latest downloads from AD and set up just as Vurbal's guide directed. I even used the 2.67 CCE after trying the 2.69 Basic. These are registered versions of the software and freshly downloaded just in case an old copy might have been corrupted. I've noticed a lot of suggestions and a lot of those directed at some particular problems like the multi angle issue. I have consistently tried with one sound track and no preprocessing using the File settings with DVD Decrypter. I even tried the option using an ISO file once to see if that would make a difference, none. I used one step and the 3 step method. The error always occurs in the final step when Rebuild is in the final phase following CCE finishing its operation.

[jdobbs]

Does anything get written at all to your output directory in the Rebuild phase, or does it die right away?

[brobear]

@jdobbs
Some of the Vide_TS files are copied into the folder. It doesn't crash until part way into the rebuild phase. There doesn't appear to be any particular point, except in each movie it is the same point if I try again. Most of the time, it will be well into the movie.

This group of Configuration settings lead to the 0003 Buffer Overflow:
[Options]
OneClick=1
NoWarn=1
AudioDub=0
idct7Opt=1
LoadPlugin=1
[Paths]
CCEBasic=C:\Program Files\Custom Technology\Cinema Craft Encoder Basic\cct2.exe
MPEG2DEC=C:\Program Files\DVD Rebuilder\MPEG2Dec3dg.dll
Source=D:\UNDEFINED\VIDEO_TS\
Working=C:\UNDEFINED\
[CCEOptions]
VBR_bias=25
Quality_prec=16
eclPasses=2

The following settings were suggested by someone who has been having good success with the program. However, I got Run-time error '6': Ovaerflow.

[Options]
NoWarn=1
OneClick=1
AudioDub=0
idct7Opt=1
LoadPlugin=1
RemoveDTS=1
Completed=18
[Paths]
CCEBasic=C:\Program Files\Custom Technology\Cinema Craft Encoder Basic\cct2.exe
MPEG2DEC=C:\Program Files\DVD Rebuilder\MPEG2Dec3dg.dll
Source=D:\HIDALGO\VIDEO_TS\
Working=C:\UNDEFINED\
[Setup]
Language11111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111
sLanguage11111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111
[CCEOptions]
VBR_bias=25
Quality_prec=16
eclPasses=2
[Audio]


The only adjustment to the file was the location of the Mpeg2Dec3dg.dll file which has a different location on my system. Also it was suggested I check Mpeg2source under advanced options under AVS options.

I went from a "0003 Buffer Overflow" which occurred partway into the 3rd phase (rebuild) to the "Run-time error '6': Overflow" which stopped the program as soon as it started. That was the difference between the settings I started with and those recently suggested.

[jdobbs]

- Try moving the C:\UNDEFINED\ directory to your D: drive (assuming it's a hard drive) and see if it makes a difference.

- Delete the Language and sLanguage lines under [Setup] they should have said "Language=" and "sLanguage=" -- also having them set to all 1's tells DVD-RB not to keep any audio. If you want those lines added to the .INI it's better to let DVD-RB do it by checking/unchecking audio/subpicture languages in the DVD-RB setup screen.

- If you are using CCE Basic there should be a line that says "CCE=2" under "[Options]" -- not having it might lead me to believe you never checked a choice under the Options/CCE Options menu -- but it should default to CCE Basic anyway...

How much space do you have available on your C: drive? Is the directory really named "C:\UNDEFINED\"?

[ShadowKnight]

Originally posted by ShadowKnight
this Is my first time with the 0003 error, on school of rock R1. I pre-processed with DVDRemake, and the results play fine before running them through DVD-RB, and obviously I cant rebuild it after it encodes. I'm using RB v55b, and am hoping this problem isnt being ignored, simply for the fact that its caused from pre-processing. :-/
and not meant as an offence to jdobbs, but, doesnt it follow that if the dvd works perfectly fine after running DVD-ReMake, that the problem has to do with the method of which RB reads (or rebuilds) this "modified" information? and what exactly is the logic that would be followed that would prove otherwise? (am very curious about solving/learning about these compatibility issues)

Edit: oh and Im using ReMake 2.3.0

Great News!!!! Updating rebuilder to .57 solved the problem!!!! JDobbs, I'm so happy man, you rule! you did it!!! I'm definately gonna be sending more money your way this evening my friend. Congrats on getting this accomplished. I'll let you know if I end up encountering any more problems.

Heres the update on the steps I took on School of rock. I had kept the Remake output form before, and had run it through the newest Remake (2.3.4), and it still had the problems with DVDRB .56. But when I upgraded yesterday, I saw the mention of the possible fix for the 0003 Error, so I decided to run it through... low and behold... its better than a miracle. I appreciate it Jdobbs. I was gonna send you money when the interleaving/multi-angle feature got added, but now I'm definately sending money now, and after the interleave/angle gets added. You deserve it Jdobbs. EVERYONE DONATE SOME TO THIS MAN, HE DESERES IT! MAD PROPS TO YOU FOR ALL YOUR HARD WORK, IT MEANS THE WORLD TO US :)

[djan]

Hi all,

0.57 solved my problem too, you're the best jdobbs. No more "Buffer Overflow 0003 Errors" ! Thank you. I'm gonna donate too !

[AmigaFuture]

My donation will be sent soon. Next on my list is len0x after JDobbs. :) Excellent software should always be supported in some way when you can do it!

[brobear]

jdobbs
Thanks to your assistance and that of Sophocles, I have my annoying problem with buffer overflow solved. It appears the main problem was due to my system setup not sychronizing the folder info quickly enough with Rebuilder. I have two hard drives and size and speed isn't an issue. For some reason there was enough lag in moving info across the drives that a buffer problem occurred. 2.8GHz P4 with 800MHz FSB with 80 and 250GB hard drives (min of 40 GB free on smaller drive). So, there isn't an apparent cause with the hardware. We now know the cure for this particular software and hardware setup. By moving the folders onto the primary hard drive with the program, the sychronization problem was cured and no more buffer overflow errors.