DG NV tools

[MrScientist]

hi, since there doesn't seem to be a trial version for this software, i would just like to introduce my scenario before purchasing to make sure it will work for me. i have panasonic 1080i avchd m2ts files i currently use coreavc to decode and megui to encode with yadif to deinterlace. i have a geforce 220 and would like to do the decoding/deinterlacing on the card and still use megui to encode. would this be possible with dgnv? i know my card can hardware decode/deinterlace the files without issue by playing in mpchc. thanks.

[Adub]

Yes, the GT220 is fully supported, as you can see here: http://en.wikipedia.org/wiki/PureVideo#Table_of_PureVideo_.28HD.29_GPUs

It supports the VP4 engine, so you can get some sweet compatibility with it.

[Guest]

Should work fine as 220 has a VP4 engine. You can test with the free CUVID Client/Server if you like, but it shouldn't be necessary.

[MrScientist]

thanks for the replies. i have the latest drivers (197.13). i tried the cuvid server/client with my 1080i avc files, the "cheese slices" 1080i avc and mp2 files and the "cheese slices" 480i mp2 file and got interlacing while stepping through all of them.

am i using the server/client wrong? i start CUVIDServer in the dgdecnv200b3 folder then start the CUVIDClient in the cuvidclient200b1 folder and then load my avc or mp2, reset and step through. i don't seem to be using anything in the cuvidserver200b1 folder and maybe that's my problem?

[hydra3333]

Thanks neuron2 for your continued work on your great tools !

[Guest]

thanks for the reply. i have the latest drivers (197.13). i tried the cuvid server/client with my 1080i avc files, the "cheese slices" 1080i avc and mp2 files and the "cheese slices" 480i mp2 file and got interlacing while stepping through all of them. OK, so it's interlaced. The sample client has no means to specify deinterlacing. The purpose of the server/client apps is only to test whether your card is supported (and as a model for those who might want to use the server with their own application.). If you get video then the DGNV tools will work for you. You can specify deinterlacing via a parameter to DGDecodeNV() or DGMultiDecodeNV().

am i using the server/client wrong? i start CUVIDServer in the dgdecnv200b3 folder then start the CUVIDClient in the cuvidclient200b1 folder and then load my avc or mp2, reset and step through. i don't seem to be using anything in the cuvidserver200b1 folder and maybe that's my problem? What is the problem you are experiencing?

@hydra3333

Thanks for the kind words. They are always appreciated.

[Guest]

It supports the VP4 engine, so you can get some sweet compatibility with it. I understand that VP4 supports MPEG4 ASP so maybe I will add that at some point.

[MrScientist]

OK, so it's interlaced. The sample client has no means to specify deinterlacing. The purpose of the server/client apps is only to test whether your card is supported (and as a model for those who might want to use the server with their own application.). If you get video then the DGNV tools will work for you. You can specify deinterlacing via a parameter to DGDecodeNV() or DGMultiDecodeNV().

gotcha. i thought using the server/client would allow me to view the footage deinterlaced if my card could handle it.

What is the problem you are experiencing?

i guess none. see above.

[VincAlastor]

@neuron2
is there a test x64 version of your tools, i would like to help you as a tester?

[Guest]

@neuron2
is there a test x64 version of your tools, i would like to help you as a tester? Not yet.

[GZZ]

Hey Neuron2

This is not a serious bug, but if you open up a video file in DGIndexNV and press File -> Close it dosnt free the file handle, so it impossible to rename/delete the file until you load another video file or close DGIndexNV. Can you can fix this ?

[ndkamal]

Hello Neuron2,

Do you intend to do a version of DGIndex working in OpenCL with ATI cards. Cuda and OpenCL are the same language. ATI Radeon HD 5000 is more powerful than Geforce GTX400 in compute (2.7 Teraflops for the HD 5870 and 1.43 Teraflops for GTX480) and gaming (Radeon HD 5970 vs GeForce GTX480).You could make a unified version of DGIndex working with UVD and PureVideo in OpenCL. Moreover the deinterlacing of ATI is better than Nvidia (I have a 9500GT and a Radeon HD 4670). ATI has created a section to help developpers with OpenCL :

http://developer.amd.com/zones/OpenCLZone/Pages/portingcudatoopencl.aspx
http://developer.amd.com/zones/OpenCLZone/Pages/default.aspx


Finally, UVD is used by some software like PowerDirector for decoding.

Thanks for your answer.

[Guest]

Do you intend to do a version of DGIndex working in OpenCL with ATI cards. It would be possible only if there is a published spec and API for video decoding on the ATI cards. Do they exist and are they available?

Keep in mind that DGNV tools do not use CUDA. They use the CUVID API.

[ndkamal]

It would be possible only if there is a published spec and API for video decoding on the ATI cards. Do they exist and are they available?

Keep in mind that DGNV tools do not use CUDA. They use the CUVID API.

I think because they use UVD in PowerDirector for decode, like they say in this test :

http://translate.google.fr/translate?hl=fr&ie=UTF-8&sl=de&tl=en&u=http://www.pcgameshardware.de/aid,743333/Geforce-GTX-470-und-GTX-480-Test-von-Nvidias-GF100-Generation/Grafikkarte/Test/%3Fpage%3D18


For more information about that. We mask ask that to ATI.

[Guest]

Please quote the relevant text so I don't have to spend an hour searching for it in your link.

[ndkamal]

It would be possible only if there is a published spec and API for video decoding on the ATI cards. Do they exist and are they available?

Keep in mind that DGNV tools do not use CUDA. They use the CUVID API.

With ATI Radeon, the API for Lunix is XvBA (X-Video Bitstream Acceleration), there is no information about the same thing for Windows.

The options seems to be limited to motion compensation (mo comp) and inverse discrete cosine transform (iDCT), and VLD (Variable-Length Decoding) for MPEG-2, MPEG-4 AVC (H.264) and VC-1 encoded video. No deinterlacing or noise reduction. :mad:

I will ask the question to ATI Forum developpers.

For Power Director article, you should look at the third party of the page, you cannot miss that, the title is GeForce GTX 480/470 in the test: GPU rendering with Power Director 8. Thanks for your patience.

[Guest]

So the status is unchanged. There is no available API outside of DXVA.

[Audionut]

Hi Don,

Sorry for the delayed response.

A stream for you. Blu-ray source indexed by latest dgdecodenv and encoded by x264 with,

--preset veryslow --tune film -B 3000

So, bframes=8 , ref=16.

What happens if you use level 4.1 instead of High 5?

Adding --level 4.1 to the command line fixed the problem. What reason is there for the --level parameter causing this issue.

[Guest]

What reason is there for the --level parameter causing this issue. IIRC, DXVA is limited to 4.1, so I speculated that only 4.1 is fully supported (although some L5 streams are known to play fine).

[djesteban]

Hi Neuron,
Could you add rollover button description textbox in the next version please.

Thanks in advance

[hydra3333]

Haven't followed this for a while, however will DGIndexNV ever open .mpg files as well as mpeg2 elementary streams ?

Also, I need to de-block a HD TV capture ... in the new
DGMultiSource("Inputdgm.dgm",deinterlace=0)
is there a way to achieve an equivalent to the older deblocking and de-ringing ?
MPEG2Source("Inputd2v.d2v",info=0,ipp=true,cpu=4) or
MPEG2Source("Inputd2v.d2v",info=0,ipp=true,cpu=6)

[kebulek]

Hey Neuron2

I found an error in your DG NV Tools (2007).

Error window: http://www.imagebam.com/image/5fa3b675373056

(Cannot find audio data...) - but for example in tsMuxeR is everything alright.

Sample: http://uloz.to/4482766/cthd-sample.ts

Sample was cut in newest TSPE 0.810. Error occurs randomly, once is cutted .TS ok, once is not... :( Maybe its TSPE error, i dont know - can you please look into it?

:thanks:

[Guest]

will DGIndexNV ever open .mpg files as well as mpeg2 elementary streams ? It already does.

Also, I need to de-block a HD TV capture ... in the new
DGMultiSource("Inputdgm.dgm",deinterlace=0)
is there a way to achieve an equivalent to the older deblocking and de-ringing ?
MPEG2Source("Inputd2v.d2v",info=0,ipp=true,cpu=4) or
MPEG2Source("Inputd2v.d2v",info=0,ipp=true,cpu=6) Not currently possible. Use an external deblocker.

@kebulek

Investigating...

[hydra3333]

I have acquired another old PC and put 220GT in it, and am wondering what to do ... do I need to donate again to get a 3rd license ?
I located an email which said
> If you have multiple machines, or you switch NICs on and off, send
> all the machine IDs that can thereby be generated, so that I can send you
> one comprehensive license file. We can also add machine IDs later without
> problems. and
A license server is being created to
simplify the licensing process for you.

[Guest]

@hydra3333

Send me an email from the account you used to donate and ask for a login to the license generator.

[hydra3333]

With an old PentiumD2 2.8Ghz/220GT-1gb, do you think there'd be benefit in decoding 1080i mpeg2 streams using the NV tools vs using ordinary DGDecode ?

I know I'll have to
deinterlace with Yadifmod/Nnedi2 and then use and external deblocker like Deblock_QED_MT2() and then resize/reinterlace to 576i
instead of using the noble MPEG2Source("Inputd2v.d2v",info=0,ipp=true,cpu=4) and then deinterlace with Yadifmod/Nnedi2 and then resize/reinterlace to 576i

I'm tempted with the NV to use it's Nvidia deinterlacer in DGMultiSource, however I'm guessing (and seeking your opinion) that Yadifmod/Nnedi2 may be superior for HD fast sports action.

[Guest]

With an old PentiumD2 2.8Ghz/220GT-1gb, do you think there'd be benefit in decoding 1080i mpeg2 streams using the NV tools vs using ordinary DGDecode ? I would expect some gain during serving but not a massive one. Indexing itself will be slower with DGNV due to architectural compromises made to cleanly support decoding of all the video and container types.

I'm guessing (and seeking your opinion) that Yadifmod/Nnedi2 may be superior for HD fast sports action. Try it both ways. You may be surprised.

[hydra3333]

Thanks I will try it. I think the following workflow will be OK although I admit to being unsure about the deblocking position (eg before or after deinterlacing, say after a separatefields... although I couldn't do that as a part of (b) I suppose)

(a) DGMultiSource without deinterlacing
deinterlace with Yadifmod/Nnedi2 to doubleframerate
Deblock_QED_MT2(quant1=40)
resize to 704x576
limitedsharpenfaster
reinterlace to 576i

(b) DGMultiSource with doubleframerate deinterlacing
Deblock_QED_MT2(quant1=40)
resize to 704x576
limitedsharpenfaster
reinterlace to 576i

I gather I could also re-size at the same time as deinterlace under (b) although I'm not sure what that would to do Deblock_QED_MT2 ...

[Guest]

Sorry hydra3333, but you're going way off topic talking about workflows here. Please start a new thread.

[hydra3333]

No worries, thanks.

[hydra3333]

Oops, not getting too far, HCenc23 & 24beta all throw an error when using NV per the script below. Vdub opens the script and can scroll OK. May I seek suggestions on how to do away with the error and consequential exiting of HCenc ?
http://i42.tinypic.com/2lo2mbn.jpg
XP-SP3, fully patched. Latest Nvidia drivers. Latest NV download. Intel Q9450, 4Gb, 8800GT card.
Source mpeg2: File Name: G:\HDTV\AFL\q2.mpg
File Size: 2640592896 ( 2.46 GB )
Program Duration: 00:29:13.00
File Type: PS - MPEG2
Encoding: MPEG2
Video stream Id: xE0
Encoding Dimensions: 1440 x 1080
Display Size: 1440 x 1080
Aspect Ratio: 16:9
Frame Rate: 25.00 FPS
Bit Rate: 9.416 Mbps
VBV_Buffer: 888 KB
Profile: Main/High
Progressive: Prog or Int
Chroma: 4:2:0
Audio Format: 5.1
Audio Stream Id: AC3: 0 (x80)
Audio Bit Rate: 384 Kbps
Audio Sampling Rate: 48000 Hz
TS Mux Rate (bps): -1
Est. video bit rate: 11.200 (Mbps)

SetMTmode(mode=5,threads=4) # start with mode=5 forAVIsource http://forum.doom9.org/showthread.php?p=1067216#post1067216
SetMemoryMax(256)
LoadPlugin("C:\SOFTWARE\DGindex\DGMultiDecodeNV.dll")
LoadPlugin("C:\SOFTWARE\DGindex\DGDecode.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\NNEDI2.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\Yadifmod.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\WarpSharp.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\aWarpSharp.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\mt_masktools.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\mvtools2.dll")
#LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\RemoveGrain.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\RemoveGrainSSE2.dll")
#LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\Repair.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\RepairSSE2.dll")
#LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\RemoveDirt.dll")
LoadPlugin("C:\Program Files\AviSynth 2.5\plugins-zzz\RemoveDirtSSE2.dll")
Import("C:\Program Files\AviSynth 2.5\LimitedSharpenFaster.avs")
Import("C:\Program Files\AviSynth 2.5\Deblock_QED_MT2.avs")

DGMultiSource("G:\HDTV\AFL\HD-sharpen\q2.dgm",deinterlace=0)
#DGMultiSource("G:\HDTV\AFL\HD-sharpen\q2.dgm",deinterlace=2,resize_w=720,resize_h=576) #deinterlace=2 means double rate deinterlacing
AssumeFPS(25)
AssumeTFF()
#SetMTmode(mode=2,threads=4) # mode=2 for temporal multi-threading (interleaved frames)
AssumeTFF()
yadifmod(mode=1, edeint=nnedi2(field=-2)) #mode=1 means double framerate,field=-2 means double rate (alternates each frame)
Lanczos4Resize(720,576)
LimitedSharpenFaster(smode=4,strength=100)
AssumeTFF() #choose the SAME field order like before deinterlacing
SeparateFields().SelectEvery(4,0,3).Weave() #reinterlace.
AssumeTFF() #choose the SAME field order like before deinterlacing
SetPlanarLegacyAlignment(True)
Distributor() # use this when using HC and SetMTmode, per http://forum.doom9.org/showthread.php?p=1063622#post1063622

edit: Well, that's strange, Vdub worked with it yesterday. First time after reboot and after trying HCenc, I opened it in Vdub and it threw this error
http://i40.tinypic.com/148gacw.jpg
Ran Vdub again and it worked fine if a bit slow. Any help appreciated.

edit2: changed setmtmode to threads=1 ... no change :)

[JoeH]

I use DGIndexNV + AVFS to edit H264 AVS files in Sony Vegas. For rendering it is fantastic, and goes over 25% faster than if I use an intermediate codec.

But, Sony Vegas Pro draws the thumbnails on the timeline quite slowly - it takes about 10 seconds to draw the timeline. If I need to move around the timeline a lot, this is a serious problem. If I use an intermediate codec it basically paints the thumbnails on the timeline instantaneously, but of course requires serious disk space.

So, this is a question / feature request about DGIndexNV. I don't know if the cause of the slowness is that DGIndexNV is not optimized for the type of quick "seeking" throughout an entire file that timeline thumbnails require, or if my GT 9500 is simply too slow for this type of application, or if AVFS is causing a bottleneck.

But, I wanted to throw this problem out here to see if you, neuron2, or anyone else had any ideas if there is anything I can do to improve the performance, or if this is something DGIndexNV could be improved on ("quick seeking", I guess), to suggest it as a feature request.

[Guest]

Seeking speed is determined by the keyframe interval, so you should encode with smaller GOPs. How big are your GOPs (how many frames between keyframes)? I've seen people using very large numbers here. That's better for compression but worse for seeking.

[hydra3333]

Oh. It works only with ALL of the MT code removed, even Distributor().
Fair enough, however I'd thought "threads=1" might be OK.
I must have misinterpreted the manual "2) multiple instances of the filter can be created" and thought using MT0.7 multithreading would be OK.

In my case, opening and doing things inside DGMultiSource I'd expect to be comparatively quick, however anything in code after that, eg deblocking and limitedsharpenfaster and re-interlacing, would not benefit from multithreading.

Do you think it's a NV type bug or a HC type bug (Vdub playing up seems to suggest NV) or even a bug at all ? Happy to report it elsewhere, just let me know.

[Guest]

Sorry I have no idea as I have never even touched any of that MT stuff.

(I hope to have more time for DG tools stuff when I wrap up the current physics paper I am writing.)

[hydra3333]

OK, hope the paper works out nicely for you !

For later: surprisingly, it crashes consistently with the MT stuff in BUT then ...
I remove all the MT code except Distributor() from the script and ran HCenc and it just did nothing literally -
and then when I killed that process and un-commented all of the MT code (threads=1, not 4) and ran it, the whole thing suddenly works fine.
But that only works if I've just previously done the only-Distributor()-line-and-kill-the-process 1st !
Replicated the behaviour.
Tried the same thing with threads=4 but it still crashes no matter what.

Seems suggestive of an initialization type bug somewhere or other :)

[hydra3333]

Well, I'm happy with NVtools (even without multithreading available via MT0.7).

My really old PentiumD2 2.8Ghz/220GT-1gb achieves about 1/2 the processing rate for mpeg2 GPU deinterlacing/resizing and non-GPU deblocking/re-interlacing as does my Q9450/8800GT, with the exact same script. It should be a larger gap, but I think Trend anti-virus is sucking the life out of the q9450.

With comparing with equivalent scripts not using NV (although taking advantage of MT) the q9450 earns its money (likely the extra cores), in that it's about 3 to 7 times faster than the old D2 depending on the script.

Comparing reasonably equivalent scripts (obviously the deinterlacing will be different) on the old D2
GPU deinterlacing/resizing and non-GPU deblocking/re-interlacing = 4.3 fps
non GPU deinterlacing/resizing and non-GPU deblocking/re-interlacing = .8 fps

NV's GPU offloading gives older boxes a life after retirement.

Now, all I need is a GPU based deblocker :D

[JeffBDVS]

@kebulek

Investigating...
Some AVCHD files I have will cause the same "Cannot find audio" error, and others from the same camera won't.

I'll PM soon you with a link to a sample clip.

-Jeff

[blazer003]

So what are the steps to open files in Premiere CS3?

I have:
Installed DGNVIndex.
I index the mts file and save the project.
I have a template avs file that mixes the video and audio.
Source = DGSource("00023.dgi")
audio=NicAC3Source("00023 PID 1100 2_0ch 48KHz 192Kbps DELAY 0ms.ac3").ConvertAudioto16bit()
AudioDub (Source, audio)
I start CUVidServer.exe

But here's the problem. I can import one of my DGDecode avs scripts into Premiere just fine. The video plays wonderfully. Way better than just playing an AVCHD file in Premiere CS4.

However, I try to import a second DGDecode AVS file and Premiere hangs. If I just let it sit there a second it starts trying to conform the audio and hangs. If I click on the file it tries to load it and Premiere hangs. I have to end task to close it out.

Does this happen to anyone else? Do I need another program? Is there something I'm doing wrong that you can see? If you need more nifo just let me know.

[Guest]

Try using DGMultiDecodeNV() instead of DGDecodeNV(). Kill the CUVID server and try that.

[blazer003]

Try using DGMultiDecodeNV() instead of DGDecodeNV(). Kill the CUVID server and try that.

Perfect, thanks man for your lightning fast response. I appreciate everything you've done with these tools and for your help.

I realized once I read your post, I think I already knew this at one point, but somehow had forgotten along the way.

It works like a charm now. Thanks.

[blazer003]

Ah crap, I have to take that last post back (not the part about appreciating the quick response work and help though...) Everything isn't working great. I imported 6 scripts into Premiere. Everything's find. I edit on one clip all I want, everything's fine. I can edit two clips and everything's fine. But now, if I click on a 3rd clip, I get this error.
http://img338.imageshack.us/img338/2429/dgmultierror.jpg

I can repeat this error by getting back into premiere and clicking on 3 avs scripts in the bin. As soon as I click that 3rd script I get the error. I tried clicking one script, then clicking an AVI I have loaded, then clicking another script, and then another AVI and then the third script and this error pops up instantly. I was taking my time between clicks too, it wasn't like I was just rapidly clicking on after the other.

Any time I select a third script it seems it throws out the error.

[linyx]

@blazer003
I'm fairly certain that means your card cannot handle decoding 3 clips at once. I could be wrong, but DGSource with CUVIDServer might fix it.

[Guest]

You're limited by the memory on your Nvidia card. That's why I recommend people to get the big memory versions, 1 or 2GB.

[blazer003]

I see, do any Premiere users know a way to flush those previous clips out of the memory? In my case I'm working on right now, I'm really only editing one at a time. (Long clips of a talk that I'm editing in with HDV footage.)

[JeffBDVS]

I see, do any Premiere users know a way to flush those previous clips out of the memory? In my case I'm working on right now, I'm really only editing one at a time. (Long clips of a talk that I'm editing in with HDV footage.)
You could try making the unused script files offline (File | Make Offline). Then use File | Link Media when you need to edit them again. If that doesn't help, keep the unused ones offline and then save your project, close and re-open Premiere.

It'd be nice if Premiere had a Purge command like After Effects. :)

-Jeff

[hydra3333]

I'm doing something wrong or misunderstanding something, unless DGindex and DGIndexNV are doing different things ...

I'd expected the same frame number in each clip to be almost exactly the same. But after the 1st frame, they look to be out of sync by at least 1 frame for some reason I don't as yet fathom (it's easier to tell single-stepping frames in Vdub when a fade-in/out is happening).

dgi=DGMultiSource("G:\HDTV\AFL\compare\R3-HD-Q2.dgi",deinterlace=2,resize_w=720,resize_h=576)
dgi= dgi.HEIGHT==1088 ? dgi.cropbottom(8) : dgi
dgi=dgi.ScriptClip("""subtitle("dgi " + string(current_frame),size=25)""")

D2V=MPEG2Source("G:\HDTV\AFL\compare\R3-HD-Q2.d2v",info=0,ipp=true,cpu=0).AssumeFPS(25).AssumeTFF()
d2V= d2v.HEIGHT==1088 ? d2v.cropbottom(8) : d2v
D2V=D2v.yadifmod(mode=1, edeint=D2V.nnedi2(field=-2))
D2V=D2v.Lanczos4Resize(720,576)
D2V=D2V.ScriptClip("""subtitle("D2V " + string(current_frame),size=25)""")

INTERLEAVE(D2V,dgi)
SetPlanarLegacyAlignment(True)

Same source mpeg2 1440x1080i25 TFF.

Clarification welcomed.

[JoeH]

Seeking speed is determined by the keyframe interval, so you should encode with smaller GOPs. How big are your GOPs (how many frames between keyframes)? I've seen people using very large numbers here. That's better for compression but worse for seeking.

That makes sense. I'm not quite sure about how to determine the GOP of already existing files, but I see that at least MeGUI defaults to very high GOP numbers, and I imagine the files I am editing are pretty similar. I'll run some tests recoding with low GOP numbers, but my hope is to use original videos, and thus avoid recoding all together.

Do you think getting a faster video card (I have a 9500 GT) would make much difference? If so, what would be more important - processor MHz or number of "stream processors" it can handle?

[Guest]

I'm doing something wrong or misunderstanding something, unless DGindex and DGIndexNV are doing different things ... Get rid of all the filtering other than the source filters and then advise if you still see an issue. If so, post the script and provide a sample stream I can use to duplicate the issue.

[Guest]

Do you think getting a faster video card (I have a 9500 GT) would make much difference? If so, what would be more important - processor MHz or number of "stream processors" it can handle? Neither will make a big difference. It's the VP engine speed that is important and that is not that different from card to card now (leaving out the ancient cards).