Possilbe livelock.??

[Tuning]

I was encoding a DVD in DivX5.05 and simultaneously copying another DVD(using DVD Decrypter..no protection).In some time this showed in the log window :"Dub:I/O thread has not cycled for ten seconds -- possilbe livelock.".What is meant by this?Is this a kind of deadlock?

This caused no error..only showed slight increase in estimated encoding time.Any one could tell me what caused this.Thanks


:confused: Tuning

[Malevolent]

Using VdubMod 1.5.10 & bugfix i get the same.

~50% of encoding jobs end in the same warning:
I/O thread has not cycled for ten seconds -- possible livelock
-repeats ad infinitum.

Sometimes the last frame isn't encoded, sometimes it is.
Haven't noticed any other effects, so the question is:
Should i worry, is it me or VdubMod or what?

[Tuning]

Hey, this is an old thread. Now I know what is causing it. The problem is due to multitasking or simply doing any other cpu intensive (for eg listening AAC in foobar too) work while encoding. It has also proven that this will not harm your encodes. its only a warning and hence no one should worry about it. This warning states that the codec have not received any data since 10 seconds. So if you are doing any other things while you encode, stop that and you will see encoding starts again.

-Tuning-

[Malevolent]

Yeah, this is an old thread, but i didn't find anything on the issue when i searched (aside this thread, that is).

I too noticed that other activities cause it, but the thing is:
It hangs at the end & does not resume.
As i previously said, last frame isn't always encoded.
Just as i'm typing this btw, an encode just finished - with last 5 frames unencoded,
plenty of livelock warnings too...

Coded with normal priority, with no CPU intensive tasks running.
(practically no tasks running at all, i'd say :))

Although this is a minor issue, i think i'll go back to 1.5.4.1,
never had any problems with it.

[ermannob]

Originally posted by Malevolent
Although this is a minor issue, i think i'll go back to 1.5.4.1,
never had any problems with it.

Maybe it's not a problem of VirtualDubMod.
I confirm that those warnings are innocuous and VirtualDubMod is strong. Even if I suspend WinXP during an encoding, on resume the encoding resumes too, with no errors but that warning.

[Suiryc]

Those warnings shouldn't matter if your encoding finishes.
But if there is a real problem then this message is added to the logs (every 10 seconds) and your encoding is frozen (0fps) and will never finish (that's a real livelock).

[Malevolent]

Originally posted by ermannob
Maybe it's not a problem of VirtualDubMod.
For all i know, the cause could be anything from sunspots to faeries ;)
All i do know, is that this only happens with VdubMod 1.5.10.1 (haven't tried latest Vdub)

Originally posted by Suiryc
Those warnings shouldn't matter if your encoding finishes.
But if there is a real problem then this message is added to the logs (every 10 seconds) and your encoding is frozen (0fps) and will never finish (that's a real livelock).

The encoding stops, never resumes & every 10 seconds i get a note about it,
so yes, a livelock it is.
Happens on roughly 50% of encodings.
I encoded somewhere around 40 clips (commercials for a project, all 2-pass),
so that would be about 80 encodings in total. Should be enough to confirm that the problem does exist ;)

I just wonder why it happens on the last frames?
Always 1-5 frames from the end are left unencoded.

Since i seem to be the only one experiencing this, i gather something is FUBAR in my system.

Reverted back to 1.5.4.1 and all is peachy again.


Just for reference, system is:
Athlon 1GHz @ 1.34GHz (problem exists without OC too)
384 133MHz SDRAM :rolleyes:
XP Pro SP1

[Suiryc]

Encoding to DivX 5.1 (or later) ?

[Malevolent]

Originally posted by Suiryc
Encoding to DivX 5.1 (or later) ?
Encoding to whatever:
Huffy, Loco, VBLE, XviD (Koepi 24062003/Ciao).
These are what i daily use, and i get the same thing with all of them.

DivX i don't have & don't need ;)

[iago]

I have the same issue with the last frame(s) as well. I use VirtualDubMod 1.5.10.1 - 2407 release, XviD-1.0-Beta3-26122003 (aka "Selam" ;)), mpeg2dec3dg.dll, avisynth_191203, this time with a very plain avs script:

---------------------------------------------
LoadPlugin("C:\DECODER\mpeg2dec3dg.dll")
mpeg2source("D:\movie\movie.d2v")
crop(16,4,-8,-4)
a=Trim(0,134932).BicubicResize(512,384,0,0.5)
b=Trim(134933,0).BilinearResize(512,384)
a+b
----------------------------------------------

(Celeron 900, 256 SDRAM, XP Pro)

:confused:

regards,
iago

[mikeX]

similar problem here
it usually happens on the 2nd pass when i encode small clips of a larger movie via avisynth to test new settings (the trim is done from dvd2avi actually)
i haven't really checked if any frames are missing at the end
i don't think i've seen it on a whole movie (but then again most of them crash on the second pass anyway)

codecs: xvid 1 beta2/beta3 koepi's builds
vdubmod version: 1.5.10.1 build 2389 (updated to 2407 & crashed with beta3 on second pass with no crashreport)

edit: tried that second pass with 2407 and it crashed again, but now i saved a crashinfo file ;) (acces violation, out of bound memory read)

my avs is like this:

crop(14,8,696,564)
BicubicResize(624,352,0,0.5)
FluxSmooth(7,7)
Undot()

using mpeg2dec3 with an 1024x576 source (.d2v project)
avisynth version: 2.52 build Sep 17 2003

[sapient]

Hi!
I get the same livelock problem each time I try to mux something in an ogm or mkv container. It never happens with avi.
So, what gives?

[cypher_soundz]

i just updated Vdubmod with the two bug fixes and the first encode did not stop with a live lock! ...maybe it was vdubmod?? i may update this after my next encode lol. my live locks used to start and display 0fps in vdubmod...real annoying!
Regards
cyph
UPDATE:
lol yup just luck ...still getting live locks

[Belgabor]

Ok guys, lets get this straight, do you just get the warning (= your job finishes) or a 'real' livelock (= it doesnt finish)?

This warning is just that, a warning VDub(Mod) spits out when the processing rate goes down to a certain extent (very possible with any of the following, heavy filters/slow cpu/heavy codec).

[cypher_soundz]

up to now everything was fine, but the new builds have been REAL live locking! every time it does it , it REAL live locks! whats weird is that it seems to be mostly with ogm and mkv , but i started using oggmux and its all fine, of course i would love to use your app but it just doesn't seem to be working at the mo' for me.
Regards
cyph

[sapient]

I get real livelocks too, and only with mkv and ogm as I said. The point at which the livelock occurs is not the same everytime, even if I am trying the exact same muxing.

[Belgabor]

Originally posted by sapient
The point at which the livelock occurs is not the same everytime, even if I am trying the exact same muxing.
This is very very bad. Makes it almost impossible to track down the bug :(
I'll fetch the cavallery (Cyrius), perchance he has an idea...

[Suiryc]

In 1.5.10.1 versions a bug could be triggered regarding mkv files, and generate a livelock (dubbing stuck at the very beginning).
It has been fixed (the bug was in the Matroska libs) and the latest bugfix (build 2424, available on Sourceforge; to use with care since the Matroska libs are heavily changed those last times) should be ok concerning it.

Unfortunately I didn't spotted other livelocks (concerning OGM or MKV) at the moment ...

[sapient]

I have just tried the latest build (2424). The livelocks still occur, only now they might be occuring even faster, more towards the beginning of the muxing. The problem is the same for mkv and ogm. I should probably give you a few more details:
I am using xvid video, vbr mp3 audio and srt subtitles and my system is pentium4 based.

[ToiletDuck]

I'm on a dual opteron system without having any intensive task running and I'm at livelock right now. It has actually locked and will not continue. This was using xvid 1.0 and regular mp3 encode. What gives?

[langegg]

I'm also having trouble with the "Dub:I/O thread has not cycled for ten seconds -- possilbe livelock" error message. It happens at the start of the second pass. Frame count is 1 of 150,000 at 0fps. I've let it sit overnight, but never moves off this spot. I'm using Xvid and ac3 sound. It's happening every time I try to use the program with different DVDs. It make the program unusable.

[langegg]

I de-installed Gordian Knot and then reinstalled it along with VirtualDubMod 1.5.4. The first DVD worked fine. The second locked up just as before. I rebooted my pc, and then it worked fine. A bit tedious, but at least it's working.:(

[Flexy]

same warning here (io lock)..but while using a filter and encoding to either mjpeg or huffuy...seems to be a general Vdubmod problem w/ latest version

[Suiryc]

You should try the latest bugfix version (build 2439). Speed issues concerning threads priority (generating livelocks most of the time) or the use of VBR audio were fixed.

[sapient]

I just tried the new bugfix version. I still get the same livelock problem when I try to mux .ogm or .mkv. Avi still works fine for me.

[langegg]

Seems to be working fine for me, too, so far. I'm using avi.

[MoSs]

It seems that this (livelock) has nothing to do with the various versions of VirtualDub and/or VirtualDubMod, i have tried both and many different versions of them and happens to all of them...
A real livelock, meaning suddenly the encoding freezes and no frame is being encoded, not in the beginning and not at the end, during, the encoding at random frame possitions.
I am trying to encode an mpeg2 video using Avisynth 2.5.5
DGDecode.dll for Mpeg2Source() and made my d2v file with DGIndex instead of DVD2AVI (trust me this is not the problem)
Xvid 1.0.2
VirtualDub 1.6.0 (experimental)
Creative MP3 Codec CBR (source is .wav file)

It is a 2 pass job, the first pass is always completed successfully, but I can never get through the second pass... :(

Now, has anywone a real answer to this problem?
Please don't reply by telling me to try different versions, or different codecs or different settings and scripts...
I TRIED ALL OF THAT and same thing keeps happening,
Also it cannot be a source video problem because it does not lock at the same frame every time, each time at a random frame!

and as langegg said
It makes the program UNUSABLE!

ps. If there is no solution or workaround to the livelocks, can you suggest me another program to do my job? (please not any virtualdub port) (and it has to support avisynth )

[stephanV]

you dont want me to say this but

dont use creative MP3!

some threads:
http://virtualdub.everwicked.com/index.php?act=ST&f=2&t=4935&hl=creative+mp3&
http://virtualdub.everwicked.com/index.php?act=ST&f=3&t=4643&hl=creative+mp3&

more general possible solution for livelock:
http://virtualdub.everwicked.com/index.php?act=ST&f=2&t=6427&st=15&hl=livelock

Other programs like VirtualDub... cant think of any right now...

[MoSs]

OMG You are right!
Since having the audio stream not compressed or compressed with different format (like ogg) was not an option for me, I didn't try a different audio codec or no codec at all...
That is because the Creative Mp3 codec didn't cause any problem with other encoding tools (like Xmpeg, which sucks btw) and I thought that couldn't be it.
Also I had no idea that the Windows audio codec management mixes up the codecs according to their priority!

Here comes my next question that I couldn't find the answer at the topics that you posted, and don't have the time to try it my self:
If I change the priority to 1 to the Creative MP3 codec, could this fix the livelock problem? Or the codec it self is causing the problem? In simpler words, is it the priority of the codec, or the codec it self?

At this time of my post, my encoding has reached 80%, which probably means that will finish successful, since it never reached that far before, but without any audio...

Anyway if my troubles are over
THANKS A MILLION!
I've been fighting with this problem for 3 days now! It is a big relief :D

[stephanV]

It seems to me that both Creative MP3 and the priority system of windows are causing problems. But what works for you, works for you. :)

Since i never have had Creative MP3 i can not give any sensible observation about it.