TaZit: New tool to fully automate DVD to XviD/Vorbis/XCD conversion.

[Soc]

@Taz
Sounds good! :D It's not the best idea to turn off bframes though, it's better to use ratio=100 and offset=0 (ie no increase in quantizer) that way you still get bframes but they wont harm the quality.

Also, a suggestion for the algorithm that looks for the best resolution and resizer: The current algo could take up to 14 (!) comp tests on a very highly compressable movie, it would be faster to do something like this:

Test ideal res, bilinear.
if below highrescomp:
    lower resolution until lowrescomp or reached we exceed lowresdev (time for 2 CDs)
if above highrescomp:
    try ideal res, with lanczos
    if below:
        try other resizers for this res
    if above:
        go up to next higher resolution and start over

This would take at most 8 comp tests (assuming we stay on 1CD).
Even better would be to use the first comp test to guess the results of the other resolutions with that resizer, and somehow use this to make smarter tests :D
Like most of my suggestions, this is a minor issue, so save it for later if it's too complicated to code :)

[TaZ4hvn]

@ youngster:
search in tazit.log the commandline used with avs2avi, provided you didn't delete project files you can run avs2avi by its own (ie out of tazit) to see what happens. You can also try with avs2avi v1.25 the latest "stable" build according to me, 1.29 is heavily using vdub routines but hasn't been tested that much so you can have surprisingly faster results with 1.25.

@ soc:
of course that's a nice idea, but sorry to say this was already in my plans :D
that's damn right 14 comptests is a bit overkill.
I'm triyng to do an even smarter code as i'm studing if some linearity between resolution+resizer versus compressibility exists to predict results from only one comptest ... but i'm having hard time with this :(
things i like to do/improve now are comptest accuracy and speed, kicking in some denoiser when necessary (i still have to find a reliable test for this :confused: ), and improving a bit more auto decombing ... after these i don't have any idea what could be added so don't hesitate to suggest further :)

[superdump]

Please forgive me if I'm being stupid but I'm new to TaZit. I've set everything up correctly as far as I can tell but I get this error when I run the batch file...

'reg' is not recognized as an internal or external command,
operable program or batch file.
'reg' is not recognized as an internal or external command,
operable program or batch file.
'reg' is not recognized as an internal or external command,
operable program or batch file.
The system cannot find the file specified.
HDD was unexpected at this time.

I'm running Win2k SP3, TaZit version 0.3, Daemon Tools version 3.33, DVD Decrypter 3.1.6.0, Koepi's 14-05-2003-1 XviD compile... erm. If there's anything else you need to know to help me then please say. :)

Thanks for your time.

EDIT: That happens straight away as soon as I run the batch file. Nothing else happens. Also, in the filters.ini I just uncommented convolution3d movie hq. And here is my settings.ini:

# Program paths:
# SOURCE is DVD drive, TARGET is CD burner (SCSI address of),
# CONVDIR the directory where files are stored, DAEMON is full path to Daemon.exe.

SOURCE=D:
TARGET=1,0,0
CONVDIR=C:\DVD
DAEMON=C:\Program Files\D-Tools\Daemon.exe

# General settings:
# if MODE is HDD, TaZit will batch process each directory stored in \Rips subdir of CONVDIR.
# if MODE is DVD, TaZit will process the DVD in SOURCE.
# if PROJECT is AUTO, use DVD name as project name, either use the name provided.
# if LANG1 is none, audio is disabled.
# FORMAT? is either OGG or AC3.
# If FORMAT1=AC3 set LANG2=none, or know what you're doing !

MODE=DVD
PROJECT=AUTO
CD_SIZE=695
BURN=OFF
MOUNT=OFF
OGGQUAL=0.001
KFENFORCE=OFF
LANG1=English
LANG2=none
FORMAT1=OGG
FORMAT2=OGG

# Sizing/filtering decision:
# See readme. Don't touch unless you know what you're doing.

COMPTESTSIZE=3
TARGETRES=175
LOWRESDEV=2
HIGHRESDEV=1
LOWRESCOMP1CD=0.580
LOWRESCOMP2CD=0.650
LOWRESCOMP3CD=0.700
LOWRESCOMP4CD=0.700
HIGHRESCOMP1CD=0.650
HIGHRESCOMP2CD=0.700
HIGHRESCOMP3CD=0.750
HIGHRESCOMP4CD=0.750

# What to keep ?
# better to come on this...

KEEP_ALL=ON

[TaZ4hvn]

Looks like an interessting failure since it sounds to me that even internal windows command line instructions are not recognized.
Please be sure you run TaZit from its install dir, not dropping it to an external command session.
But sincerely I wonder if this has something to do with the fact you're running w2k, as far as I know every people running it so far is using XP, since this is my first batch I really dunno which commands are backward compatible.
can you try a "reg /?" into command window to see if it is supported ?
if you can't sort it out please contact me via private message I will do my best to help.

Regards

[Soc]

@Taz
Good to see that you're already a step ahead of me :)
As far as more suggestions for TaZit, having everything so far talked about would be excellent :D, but I was wondering if you have any plans for somehow using higher compression for the credits?

I imagine the hardest things to automate would be choosing the filters and lowering the quality for the credits, so maybe the user should just take a look at the movie, estmate how noisy it is, and find what time the credits start?

Trying to detect credits automatically would be an interesting problem :), I did a quick search of the forum and couldn't find any discussion about it, do you know if it's been attempted before? The best way I can think of is by looking for frames with a lot of pixels that have very high or very low luminace (ie average of [abs(Y-128)]^2 across all the pixels is close to 128*128). I wouldn't know how TaZit would analyse this though :(

- Soc

[Soc]

@superdump
I had the exact same problem a while back, I can't remember exactly but I'm pretty sure it was after I installed DVX and the DVX system pack, which brought with them their own copies of some of the software used by TaZit. My solution was to uninstall DVX (I didn't want to keep it anyway) and TaZit, then reinstall TaZit (so that the AviSynth reg entries belonged to TaZit's copy). After that it worked fine.

The first thing that happens in the TaZit code is a registry lookup to find where the AviSynth plugindir is, so the problem is most likely related somehow to the AviSynth registry entries. Any thoughts TaZ?

[EDIT] By the way, I'm using XP

Hope this helped

- Soc

[TaZ4hvn]

- looks like I sorted superdump's problem out with his help: win2k simply lacks reg.exe, so I uploaded XP's one here:
http://members.xoom.it/taz4hvn/reg.exe
To run TaZit on win2k, simply put it into windows/system32/

- about auto credits detection I dreamt of it sometimes at the beginning of the project, but I decided to postpone it since it really looks difficult to achieve. Anyway I have some very vague idea on how I can do this, both way uses avisynth script of course:
As you said, Soc, I can look for scenes with average luminance under a given threshold, providing this is at the end of the film ...
Or I can use autocrop plugin with a large threshold to look for sequences with large left/right black bands.
Really I dunno if any of this can be done seriously, and if it can be done quickly enought (don't want to add a third pass just to find credits :D )

- about DVX: that's one of the reasons I began writing this script, first time I installed DVX it looks very promising with all the features I wanted, but don't know why I never succeded to have it work on my box :(
This is certainly a very good project, by far more ambitious than TaZit, but as it didn't want to work for my eyes ...
Anyway i also found it a bit 'intrusive' since it screwed up my avisynth installation.
TaZit shouldn't bother on this: if you have avisynth already installed somewhere just uncheck it during TaZit install and required plugins will be installed in already existing plugins folder.
Of course if you leave it checked, new install will override older one !

- and also a very tiny thing: I don't like the name 'TaZit', that was just the first silly idea I add when first posting the batch. So feel free to suggest a better name :)

[superdump]

Hello again all. The reg.exe does fix the problem I had an now TaZit works flawlessly.

I have a couple of suggestions though. Some people won't want to make a mode 2 CD from their rip and so don't require that stage. This has been catered for in the settings.ini if I remember correctly. However TaZit still displays "Step 8: Making Mode 2 CD" or whatever it says, and doesn't close automatically. It's not a big problem at all. :)

What sort of volume normalisation/gain is used in besweet because the audio was a bit quiet. Aside from that everything turned out well and I think TaZit is a good name, memorable. :)

Thanks

EDIT: Also I set the CD size to 695 and ogmuxer muxed it and split it at 694 and left another little 1.2mb file. :) I found this quite amusing, but the 1.2mb bit would have fit on the cd and I only set 695 to give a bit of an overhead. So, does ogmuxer always cut below the split boundary? i.e. if you set 700mb as the boundary and it has two positions it can cut at, one at 698mb and the other at 700.1mb, will it always choose the 698mb one?

[Soc]

Sorry about my last post, it was completely wrong! I must have had some other problem than superdump's, I guess my memory is worse than I thought :rolleyes: Good to see that it's fixed though!

@Taz
I agree DVX is a good project and has definitely had a lot of work put into it, but I too found it quite intrusive (not just in the installation) and counter-intuitive to use (funny that I feel happier using TaZit even though it has no GUI (yet))

I'm all in favour of postponing credits detection till after you've finished all the stuff you're working on already! What I was suggesting was more complicated than just low average lumninance, but I'll talk to you more about it when you've done the next release.

As far as I can see credits detection wouldn't take long (I hope :D)!

@all
I've always been hopeless at thinking of names for projects, I'll leave it to someone else to make a suggestion.

If you're going to change the name maybe you should still keep 'Taz' in it somewhere, cause I'm getting very used to 'TaZit'. Also have you considered changing the capitalization to 'TazIt'?

[superdump]

How about "RazzmaTaZzit"? Lol.

EDIT: Typo in razzmatazz :)

[Soc]

@superdump

- TaZit is set to never close automatically, if you want to change this then remove these two lines from near the end of TaZit.bat:
ECHO Press any key to shutdown.
PAUSE >nul

- Setting MOUNT=OFF and BURN=OFF turns off step 9 and step 10, but TaZit still makes the image files (step 8). I assume Taz has already fixed this in the next release, but try adding this line at the beginning of step 8 (where it says ":: Step 8: Building image(s)"):
IF /I %MOUNT% NEQ ON IF /I %BURN% NEQ ON GOTO :ending

- TaZit uses "... -azid( -G max -L -3db -c normal -s stereo ) ..." for normalizing. Taz is planning on making this customizable (using profiles), hopefully next release. Of course in the mean time you can do as I did (I prefer r4r's method of boost + hybridgain) and modify it in TaZit.bat (do a search for 'core').

If you're not comfortable editing the batch file, I'd be more than happy to post (a link to) one with the above modifactions (tell me what BeSweet CLI you want though)

[superdump]

soc:

OK, I might change those lines for closing [Razzma]TaZ[z]it in the bat. ;)

I'll change the line in the bat to make it close automatically. I assume by shutdown it just means close TaZit? Or does it mean shutdown the computer?

I'm perfectly comfortable editing the batch file. I'll scout out the besweet command line and edit it as I see fit. But nevertheless, why "-s stereo" and not "-s surround2"? Does the latter not give a more desirable output? I also prefer the r4r hybridgain and boost method. -hybridgain goes in the ota switches doesn't it, if I remember correctly. But boost has it's own section, right?

Original:

-core( -input "%CONVDIR%\Projects\%PROJECT%\%TR1%" -output "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=‡%.ogg" -logfilea "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=‡%.log" ) -azid( -G max -L -3db -c normal -s stereo ) -ota( -d %TR1_DELAY% ) -ogg( -q %OGGQUAL% ) -profile( TaZit )

I would change this to...

-core( -input "%CONVDIR%\Projects\%PROJECT%\%TR1%" -output "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=‡%.ogg" -logfilea "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=‡%.log" ) -azid( -L -3db -c normal -s surround2 ) -ota( -hybridgain -d %TR1_DELAY% ) -boost( /b=2 /l=0.98 ) -ogg( -q %OGGQUAL% ) -profile( TaZit )

Is that the correct boost switch? I can't remember what it is and I don't want to install r4r again. :) Is the /l=# the right value from r4r?

Thanks for your help Soc.

EDIT: edited :)

[Soc]

RazzmaTaZzit lol :D
Any thoughts on something like TazEnc or TazDub or even the obvious but slightly boring DVD2XCD?

By shutdown it just means close TaZit, although now that you mention it it would be cool if TaZit could turn off the computer... :devil:

You were mostly right: r4r uses "... -ota( -hybridgain ... ) -boost( /b=2db ) ...", without azid at all (and no /l in boost), which becomes
-core( -input "%CONVDIR%\Projects\%PROJECT%\%TR1%" -output "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=?%.ogg" -logfilea "%CONVDIR%\Projects\%PROJECT%\%PROJECT%_T1_%LANG1:ç=?%.log" ) -ota( -hybridgain -d %TR1_DELAY% ) -boost( /b=2db ) -ogg( -q %OGGQUAL% ) -profile( TaZit )(Make sure you've changed this line in both places, ie for LANG1 and LANG2)


Glad to be of service :)

- Soc

[superdump]

TazEnc sounds good. However, no offence, but I'm still rooting for RazzmaTaZzit. :) Nah. TaZEnc sounds alright. I just think it needs an unusual name to make it stand out. But names are also more useful when they're more descriptive...

Brainstorming time. What are TaZit's main features?
- One-click startup.
- Automatic cropping, resizing and CD fitting.
- Burning to XCD.
- XviD Video and OGG/AC3(/MP3? I don't care about it so I usually scan over it when I see it, heh.)

Nope. Nothing's coming. I think RazzmaTaZzit takes the crown.

"RazzmaTaZzit - The ultimate DVD to XCD conversion tool."

:D

[jernst]

Originally posted by Soc
[B]after I installed DVX and the DVX system pack, which brought with them their own copies of some of the software used by TaZit. My solution was to uninstall DVX (I didn't want to keep it anyway) and TaZit, then reinstall TaZit (so that the AviSynth reg entries belonged to TaZit's copy). After that it worked fine.


@Soc&TaZ4hvn
Latest DVX and DVX SysPack do not longer screw up AviSynth installation (it shouldn't screw up any software installation anymore). It detects if you have it installed and uses the current plugins directory. As for the problem of TaZ4hvn I guess this was related to the directshow issues that have been fixed in the latest versions. If you want you might try it again and post on DVX's board if you still encounter problems (it might help others as well).

BTW I'm gonna try TaZ4hvn new tool which seems very promising as well !

[Soc]

@jernst
Thanks for the tip! I'll give DVX another chance, and from now on all my comments about it will go onto the DVX forum, instead of just complaining about it here :p

Go ahead and give TaZit a go, but remember there will be a lot of changes in the next release.


@superdump
The challenge IMHO is to find a name that is interesting and unusual like "RazzmaTaZzit", descriptive like "DVD2XCD" (or just "DVD2CD"), and that still has "Taz" in it. I wonder if this is actually possible, or if "TazEnc" is the best we can do :D

I don't think "Enc" is the best description of what TaZit does though, since the actual "encoding" as such is done by avs2avi/besweet, maybe the name should reflect TaZit's role as a manager of the overall process, eg "TazRip" or "TazBackup" or "TazDVD" or something :confused:. Maybe even "DVDDemon" :p

[bilu]

How about TaZ-o-matic ? :)

Bilu

[superdump]

Soc and Bilu:

TaZ-o-matic and TaZRip sound pretty good. I agree that TaZEnc isn't quite right for what TaZit does. I dunno. :)

[Soc]

I asked one of my friends to brainstorm some names and he suggested quite a few, so I've made a list of all the current suggestions and included them in it:

RaZzmaTaZzIt :p
TazEnc
TazDub
TazRip
TazRipper
TazBackup
TazDVD
TaZ-o-matic :)

DVD2XCD
DVD2CD
DVDDemon
DVD1 (cause it takes 1 step)
DVDZipper
DVDCompressor
DVDThief :p

DIVO - like TIVO, but stands for DVD in, video out
DIMO - DVD in, movie (or MPEG4) out
MIMO - MPEG2 In, MPEG4 Out :p
DICO - DVD in, CD out
DISCO - haven't decided what the S stands for yet :D maybe select? smart?


Hope I didn't miss any

- Soc

[TaZ4hvn]

LOL, I see you guys are having good time while I'm coding :D
I totally rewritten comptests procedure so that now the maximum tests is 6 while it was 14 previously (not bad at all :)).
Of course it is quite complicated now, but should be configurable in a certain extend (more precision to come).
I still have to test this, and fix the resdev feature broken by the way (ie locked to lowresdev=2 and highresdev=2).
If everything is going well, expect next release by the end of the week...

[JWillE]

@TaZ4hvn

Hey just tried your tool and its just what the doctor ordered.:D

I had one request. Would it be easy enough to add a setting for
MAXCD=# so I could adjust the max number of cds to use in only one ini file setting per rip and leave my default COMP settings the same.
Some rips I really don't care about max quality (i.e. many cartoon rips for the kiddies, ect.), I just want one cd.

I think that would be great. :devil:

Thanx for the work....

[TaZ4hvn]

@ JWillE:
I'm not sure I get the point. Is what you want to simply limit the number of CDs for any encode anytime regardless the quality can be shitty sometimes ?
If yes, edit the batch, search for :

SET FITCD=4
SET LOWRESCOMP=%LOWRESCOMP4CD%
SET HIGHRESCOMP=%HIGHRESCOMP4CD%
IF %COMP3CD% GEQ %LOWRESCOMP3CD% SET FITCD=3& SET LOWRESCOMP=%LOWRESCOMP3CD%& SET HIGHRESCOMP=%HIGHRESCOMP3CD%
IF %FITCD% == 3 IF %COMP2CD% GEQ %LOWRESCOMP2CD% SET FITCD=2& SET LOWRESCOMP=%LOWRESCOMP2CD%& SET HIGHRESCOMP=%HIGHRESCOMP2CD%
IF %FITCD% == 2 IF %COMP1CD% GEQ %LOWRESCOMP1CD% SET FITCD=1& SET LOWRESCOMP=%LOWRESCOMP1CD%& SET HIGHRESCOMP=%HIGHRESCOMP1CD%

if you want to limit to, say, 2cd, change like this:

SET FITCD=2
SET LOWRESCOMP=%LOWRESCOMP2CD%
SET HIGHRESCOMP=%HIGHRESCOMP2CD%
IF %FITCD% == 2 IF %COMP1CD% GEQ %LOWRESCOMP1CD% SET FITCD=1& SET LOWRESCOMP=%LOWRESCOMP1CD%& SET HIGHRESCOMP=%HIGHRESCOMP1CD%

That should do the trick (comps for 3 and 4 cds will still be displayed but ignored) if not, let me know.

Anyway I think this is a bad idea, cause some movies simply requires more than two cds ( try 'Saving Private Ryan' :D ).
If you want to force 2CD even if compressibility (and quality) is really low LOWRESCOMP?CD is made for this, simply set, for instance LOWRESCOMP2CD=0.50 and LOWRESDEV=2 and believe me, you'll have hard time finding movies requiring 3 or 4 cds !

[JWillE]

@TaZ4hvn

Sorry just edited my previous post to clarify before I seen your reply. My rips vary greatly from many that I want best quality regardless of the number of cds, to a few that I want convenience of 1 cd regardless of quality (children programs, they don't seem to care much:p). If there were some type of "cd limit" setting in the ini it would be a great convenience in these cases. I could leave my default quality settings for 1,2,3, & 4 cd rips and still have an option to force a max number of cds for a rip with minimal editing.

Thanx for your quick reply and keep the great work;)

[TaZ4hvn]

I understand better now.
Well next version should be able to manage different profiles so that you can set your settings one time for all for each type of material.
You'll be able to choose between 'great quality encode for my own eyes' and 'perhaps shitty quality for kids that don't care' :D.
So wait for it !

[JWillE]

Sorry to keep bugging you but for a quick edit until the next version I was wondering this would work.

1. Add MAXCDS to the settings.ini file

2. Add the following

SET FITCD=4
SET LOWRESCOMP=%LOWRESCOMP4CD%
SET HIGHRESCOMP=%HIGHRESCOMP4CD%
IF %COMP3CD% GEQ %LOWRESCOMP3CD% SET FITCD=3& SET LOWRESCOMP=%LOWRESCOMP3CD%& SET HIGHRESCOMP=%HIGHRESCOMP3CD%
IF %FITCD% == 3 IF %COMP2CD% GEQ %LOWRESCOMP2CD% SET FITCD=2& SET LOWRESCOMP=%LOWRESCOMP2CD%& SET HIGHRESCOMP=%HIGHRESCOMP2CD%
IF %FITCD% == 2 IF %COMP1CD% GEQ %LOWRESCOMP1CD% SET FITCD=1& SET LOWRESCOMP=%LOWRESCOMP1CD%& SET HIGHRESCOMP=%HIGHRESCOMP1CD%
IF %MAXCDS% LSS %FITCD% IF %MAXCDS% EQU 3 SET FITCD=3& SET LOWRESCOMP=%LOWRESCOMP3CD%& SET HIGHRESCOMP=%HIGHRESCOMP3CD%
IF %MAXCDS% LSS %FITCD% IF %MAXCDS% EQU 2 SET FITCD=2& SET LOWRESCOMP=%LOWRESCOMP2CD%& SET HIGHRESCOMP=%HIGHRESCOMP2CD%
IF %MAXCDS% EQU 1 % SET FITCD=1& SET LOWRESCOMP=%LOWRESCOMP1CD%& SET HIGHRESCOMP=%HIGHRESCOMP1CD%

Thanks:cool:

[TaZ4hvn]

@JWillE:

That's very close, if not equal, to what I wanted to add for you :)
Looks good and should work :)
One more time, one nice thing with TaZit (if they are any :D) is that anyone can easily modify it to better suit his needs.

@All:

Profiles feature is almost done. Please could you guys choose and export here (in reg format) your favorites xvid settings ?
Please add a few commentary on what for is each settings and why you choose them: I will start from your suggestions to ship next version with some default profiles :)
Thx

[Soc]

I'm assuming you meant for us to copy the entire contents of the reg file into our posts. If not then sorry cause that's what I'm going to do! :D

My no. 1 aim is to fit movies onto 1 CD, so long as quality is reasonable, and since I started using these settings I haven't yet had to go to 2 CDs (even when ripping 2hour+ movies) although a few have turned out a little blurry (especially with bicubic resize, it seems).

I'm still a n00b when it comes to choosing good avs filters, but the combination of Convolution3d("moviehq") and UnDot() works very well for me with these settings in most cases.

Summary of the settings:
- H.263 quant (because it softens plus it lets me use trellis quant)
- VHQ4 (makes for slow encoding but seems to be worth it)
- chroma motion ON
- qpel OFF (For my situation Qpel doesn't seem to help quality, and it's a lot faster to encode without it on my slow computer!)
- B-frames: 2/150/100/50 (I find threshold 100 too aggressive for my settings since the pre-processing, H.263, and a soft resizer already add plenty of compressability)
- chroma optimizer ON
- trellis quant. ON
- (all others on default setting)

Using these settings/filters does decrease first pass size quite drastically, so I've had to increase LOWRESCOMP and HIGHRESCOMP by at around .05 (or more) to get good results.

As far as audio goes, I never go below ogg quality 0.300, anything less sounds bad to me. My besweet CLI is straight from r4r:
-core( -input "%input%" -output "%output%" -logfilea "%log%" ) -ota( -hybridgain -d %delay% ) -boost( /b=2db ) -ogg( -q 0.300 ) -profile( %version% )

I hope you like these settings, they've served me well, and if you're feeling lazy you can pretty much apply them "as is" to most movies. Otherwise, please question/critisize anything you don't like (especially qpel), I'd love to have feedback! :D

I'd comment more but I really should go now, I have a programming exam in 2 hours :( I've never been very focused on my study, my last chance to do revision and I'm on here posting, lol :D

- Soc

P.S. you can ignore my "stats1" and "stats2", TaZit overwrites them anyway ;)

------- Begin XviD_Settings.reg -------
REGEDIT4

[HKEY_CURRENT_USER\Software\GNU\XviD]
"mode"=dword:00000003
"quality"=dword:00000055
"quant"=dword:00000005
"rc_bitrate"=dword:000dbba0
"rc_reaction_delay_factor"=dword:00000010
"rc_averaging_period"=dword:00000064
"rc_buffer"=dword:00000064
"motion_search"=dword:00000006
"quant_type"=dword:00000000
"fourcc_used"=dword:00000000
"vhq_mode"=dword:00000004
"max_key_interval"=dword:0000012c
"min_key_interval"=dword:00000001
"lum_masking"=dword:00000000
"interlacing"=dword:00000000
"qpel"=dword:00000000
"gmc"=dword:00000000
"chromame"=dword:00000001
"greyscale"=dword:00000000
"max_bframes"=dword:00000002
"bquant_ratio"=dword:00000096
"bquant_offset"=dword:00000064
"bquant_threshold"=dword:00000032
"packed"=dword:00000000
"dx50bvop"=dword:00000001
"debug"=dword:00000000
"reduced_resolution"=dword:00000000
"use_trellis"=dword:00000001
"chroma_opt"=dword:00000001
"frame_drop_ratio"=dword:00000000
"min_iquant"=dword:00000002
"max_iquant"=dword:0000001f
"min_pquant"=dword:00000002
"max_pquant"=dword:0000001f
"desired_size"=dword:0008b290
"keyframe_boost"=dword:00000000
"discard1pass"=dword:00000001
"dummy2pass"=dword:00000000
"kftreshold"=dword:0000000a
"kfreduction"=dword:00000014
"curve_compression_high"=dword:00000000
"curve_compression_low"=dword:00000000
"use_alt_curve"=dword:00000000
"alt_curve_use_auto"=dword:00000001
"alt_curve_auto_str"=dword:0000001e
"alt_curve_use_auto_bonus_bias"=dword:00000001
"alt_curve_bonus_bias"=dword:00000032
"alt_curve_type"=dword:00000001
"alt_curve_high_dist"=dword:000001f4
"alt_curve_low_dist"=dword:0000005a
"alt_curve_min_rel_qual"=dword:00000032
"bitrate_payback_delay"=dword:000000fa
"bitrate_payback_method"=dword:00000001
"twopass_max_bitrate"=dword:00989680
"twopass_max_overflow_improvement"=dword:0000003c
"twopass_max_overflow_degradation"=dword:0000003c
"hinted_me"=dword:00000000
"credits_start"=dword:00000000
"credits_start_begin"=dword:00000000
"credits_start_end"=dword:00000000
"credits_end"=dword:00000000
"credits_end_begin"=dword:00000000
"credits_end_end"=dword:00000000
"credits_greyscale"=dword:00000000
"credits_mode"=dword:00000000
"credits_rate"=dword:00000014
"credits_quant_i"=dword:00000014
"credits_quant_p"=dword:00000014
"credits_start_size"=dword:00002710
"credits_end_size"=dword:00002710
"deblock_y"=dword:00000000
"deblock_uv"=dword:00000000
"hintfile"="\\hintfile.mvh"
"stats1"="F:\\TAZIT\\Projects\\THE_FIFTH_ELEMENT\\THE_FIFTH_ELEMENT.stats"
"stats2"="\\videogk.stats"
"qmatrix_intra"=hex:08,11,12,13,15,17,19,1b,11,12,13,15,17,19,1b,1c,14,15,16,\
17,18,1a,1c,1e,15,16,17,18,1a,1c,1e,20,16,17,18,1a,1c,1e,20,23,17,18,1a,1c,\
1e,20,23,26,19,1a,1c,1e,20,23,26,29,1b,1c,1e,20,23,26,29,00
"qmatrix_inter"=hex:10,11,12,13,14,15,16,17,11,12,13,14,15,16,17,18,12,13,14,\
15,16,17,18,19,13,14,15,16,17,18,1a,1b,14,15,16,17,19,1a,1b,1c,15,16,17,18,\
1a,1b,1c,1e,16,17,18,1a,1b,1c,1e,1f,17,18,19,1b,1c,1e,1f,00
"credits_begin"=dword:00000000
------- End XviD_Settings.reg -------

[EDIT] fixed typo

[TaZ4hvn]

v0.4 release:

As usual, let's begin with the changelog:

v0.4:-improved auto naming
-better and universal timing functions
-better comptest algorithm
-more accurate comptests
-profile support
-changed for beta besweet, now using hybridgain and surround
-other minor enhancements

Some explanations:

-improved auto naming:
There's no more PROJECT setting.
TaZit will retrieve DVD name and convert it to a friendly format i.e. lowercase except for first letter.
If DVD name is "WILD_WILD_WEST", TaZit will propose to name project with "Wild Wild West".
You can either accept it or override it.

-better and universal timing functions:
Internal Timing should now work regardless of how exotic your system settings are !
Output is 24 hours and now accurate to the second.

-better comptest algorithm:
Well this is a big part. From the updated readme:

Algorithm is totally rewritten from scratch starting from v0.4. Main advantages are:
-Should be much more faster now: while search could requires up to 14 comptests in previous
algorithm, process will end in 6 steps max now.
-Is user configurable in some extend.

Parameters are stored in two files:
-The 'profile?.ini' in TAZDIR\Profiles subdirectory.
-The 'comptests.txt' file located at TAZDIR root.

First let's look into a profile file:
-------------------------------------

MAXCD=, should be 4, unless you want to force a number of cds regardless of the quality.
COMPTESTSIZE, is the percentage of the movie to use for compressibility tests.
TARGETRES, is resolution to achieve (in thousand of pixels per frames), allowing up to
LOWRESDEV resolutions under and HIGHRESDEV resolutions higher.
The LOWRESCOMP?CD are the min compressibilities to achieve for low resolutions (i.e.
ones under TARGETRES).
The HIGHRESCOMP?CD are the min compressibilities to achieve for high resolutions (i.e.
starting from TARGETRES included).

Then let's look into 'comptests.txt':
-------------------------------------

This is a guide file for the program to know in wich order to chain the comptests.
By default 'comptests.txt' contains this matrix:

0+03 0+01 0000 0-11 0000 0000 0000 0000 0-23 0000 0000 0-21 E-21
0000 0+02 E+01 0-13 0000 0000 0-12 E-11 0-25 0-24 E-23 0-22 E-21
0000 E+02 0000 0-15 0-14 E-13 E-12 0000 E-25 E-24 0000 E-22 0000
0000 0000 0000 E-15 E-14 0000 0000 0000 0000 0000 0000 0000 0000
0+05 0+04 E+03 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 E+04 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0+15 0+13 E+05 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 0+14 E+13 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0000 E+14 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0+23 E+15 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
0+25 0+24 E+23 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
E+25 E+24 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000

First char is either 0 (do a comptest) or E (encode).
Second and third chars are deviation from targetres i.e. +0 means targetres, +1 one res higher ...
Last char is resizer:
1=Bilinear
2=SoftBicubic
3=Simple
4=SharpBicubic
5=Lanczos

When a comptest is done TaZit will look at the first non 0000 term:
-going right if comptest failed,
-going down if comptest passed.

An example:
-----------

Let's say one has a 2.35:1 image, TARGETRES=175, LOWRESDEV=2, HIGHRESDEV=2,
all LOWRESCOMP?CD set to 0.650, all HIGHRESCOMP?CD set to 0.700.
Program will find TARGETRES is (640x272) for instance and then compute the two lower and
the two higher: (576x240) (608x256) (640x272) (672x288) (704x288).

The first compcheck program does is at minimal resolution less charpening filter, i.e. (576x240)
bilinear to determine the number of cds required.
Let's say compressibilities for 1/2/3/4cds are: 0.478 0.956 1.435 1.913.
Since the first compressibility to be over LOWRESCOMP?CD=0.65 is for 2cds,
movie will fit on two cds.

From here program enters 'comptest.txt' matrix at the upper left corner i.e. 0+03 by doing
a comptest at targetres (640x272) SimpleResizer.
Wether this comptest passed or not, TaZit will look at the next non 0000 term down or right:
-next term is 0+05 if comptest passed, so next test will be at (640x272) LanczosResize.
-next term is 0+01 if comptest failed, so next test will be at (640x272) BilinearResize.

Program will continue comptests until one of these conditions is reached:
-an E*** term (meaning encode) is reached in the matrix,
-LOWRESDEV or HIGHRESDEV are overgone,
-width of the current comptest is higher than original cropped width.

To complete this explanation, let's finish the example (colored in red in the matrix):
-0+03 (640x272@Simple) passed (going down in the matrix),
-0+05 (640x272@Lanczos) passed (going down in the matrix),
-0+15 (672x288@Lanczos) failed (going right in the matrix),
-0+13 (672x288@Simple) passed (going down in the matrix),
-0+14 (672x288@SharpBicubic) failed (going right in the matrix),
-E+13 Encode with 672x288@Simple.

Remarks:
--------

The whole process is faster not only because the new algo is clever but also because some settings
won't be tested anymore:
-NeutralBicubic is not used because it will conflict with Simple, sometimes compressibility is
higher for NeutralBicubic, sometimes it's higher for Simple. So that cohabition between them can
lead to serious trouble in prediction.
Furthermore Simple is faster and better quality than NeutralBicubic.
-For the two highest resolutions minimal resizer is Simple, since I believe one has to prefer one
resolution lower with Lanczos to one resolution higher with Bilinear !
So a higher resolution is considered beeing better only if it will fit with at least SimpleResize.
-I expect people to submit different 'comptests' matrices if they have different conceptions.

-more accurate comptests:
Compressibility is now extrapolated from comptest using a commandline version of jonny's Enc tool he was kind enought to compile for Bilu and I (thanks jonny !).
Also it relies on avs2avi logfile output capabilities, so avs2avi 1.29 is a must have.

-profile support:
Well it's better you read the readme about it and look at the examples I provide.
I think this is a very versatile implementation since a 'profile' is made of three files:
-general TaZit settings,
-XviD settings,
-AviSynth preprocessing filters.
You can define as many files of each kind and merge them into any combination.

-changed for beta besweet, now using hybridgain and surround:
As it says, as everybody tends to believe this is the best, including DSPGuru himself.

-other minor enhancements:
Well I worked on so much details at the same time I don't even remember right now.
I won't be surprised if things are badly screwed up :p

Last but not least: profiles I ship TaZit with are not, in no way, recommendation. But just here to show you how to define profile. Please if you have any good settings to propose don't hesitate to post them here.

As usual enjoy and keep reporting bugs and wishes for next versions.
Get v0.4 here: http://members.xoom.it/taz4hvn/TaZitv0.4.exe


[EDIT] Do you think I can write such a giant post in one shot ? :D

[TaZ4hvn]

Well regarding naming of the program: I see you guys really did some search, that's nice. Anyway I'm not determined yet wich name to choose or even if I should change (in no way for RaZzmaTaZzIt :D sorry superdump !). I will just go on with TaZit for the time beeing.

I already have some idea of what I want to add for v0.5:
-auto credits range detection to reduce bitrate/quant.
-auto find 'noise level' of the movie for denoising.
-matroska support if tools are finished enought at this moment.
-subs as soon as matroska is supported.
Anyway, for the two fisrt points I don't have solid ideas at the moment, if someone can help ...

[Soc]

Yay! Thanks TaZ :D

Very good idea, using a matrix to make a comptest decision tree! :)

My last exam is tomorrow, after that I'll try to put together a GUI, but I'm not promising that it will be good! ;)


v0.4 is working perfectly for me so far, but I have a couple requests for options to be added to settings.ini:

PROFILE=
Lets you choose which profile number to use, or set to ASK (default).

IMAGE=
For people who still use normal CDs and don't want to make a mode2 image, they could set this to OFF, otherwise it is ON (default). I've done it for myself by modifying the M2CDMAK check as follows:
IF /I %IMAGE% == ON (
IF EXIST "%M2CDMAK%" (
%CTEXT% "{f0}M2CDMAK {f2}found{f0} as %M2CDMAK%{\n}"
) ELSE (
SET MISSING=1
%CTEXT% "{f0}M2CDMAK {f4}missing{f0} as %M2CDMAK%{\n}"
ECHO M2CDMAK missing >> tazit.log
)
) ELSE (
SET MOUNT=OFF
SET BURN=OFF
)
and adding this line at the top of step 8:
IF /I %IMAGE% NEQ ON GOTO :ending

Keep up the good work :)

- Soc

[TaZ4hvn]

after that I'll try to put together a GUI
That would be terrific :) If you're into it contact me, I have some ideas for the layout.

Lets you choose which profile number to use, or set to ASK (default).
This is already the case, default profile is profile0, if you just press enter at profile request, profile0 is loaded. Or did I miss the point ?

For people who still use normal CDs and don't want to make a mode2 image, they could set this to OFF, otherwise it is ON (default).
Oh good, I forgot that small mod :D I will add your mod asap and update to 0.41.

[superdump]

Lets you choose which profile number to use, or set to ASK (default).

This is already the case, default profile is profile0, if you just press enter at profile request, profile0 is loaded. Or did I miss the point ?

I think what Soc means is that if you set said parameter to 'ASK' then it prompts you when you run TaZit. If it is set to a number corresponding to a particular profile then it uses that profile and does not prompt you at all about the profile being used, it just displays it. 'ASK' would be the default setting.

I have a small feature request. Could you make it possible to prompt you as to whether you wish TaZit to shut down the computer when done so people can leave it running overnight? i.e. "Do you want TaZit to shut down the computer when all tasks are finished? [Yes/No | Default = No]" sort of thing. I would appreciate it greatly. :)

Thanks

[TaZ4hvn]

I think what Soc means is that if you set said parameter to 'ASK' then it prompts you when you run TaZit.

LOL, sorry I though ASK was an abbreviation :D and so missed the request.
I dunno if this is required since if you want to use default you just have to press 'ENTER' one more time at the start: not a big thing :)

Could you make it possible to prompt you as to whether you wish TaZit to shut down the computer when done

Added to todo list: should be easy to do :)

I will also add a flag to disable XCD mod, as requested, and also implement a mod to encode as a regular avi with mp3 so that I can attract a larger audience ...

[Soc]

@Taz
The PROFILE= thing wasn't important, I was requesting it mainly so that the GUI would be able to select profile by modifying settings.ini. I haven't yet decided how GUI and TaZit should interact, I'll probably end up making quite a few modifications (suggestions welcome :)). I'll PM you to talk about more about the GUI and its layout, etc.

Finished exams now yay! :D:D:D I'm going away again though (skiing), so don't expect the GUI to be ready any time soon... :(

Would you be willing to fix the timekeeping code to allow for people like me who's encodes sometimes exceed 24 hours? I just did a 25.5 hour encode that TaZit says was 1.5 hours (I wish lol). Minor cosmetic detail only :)

It's a shame so many people still use mp3 (blech). Matroska support in v0.5 would be very cool!

I have a plan as to how to do credits detection, and if it works I'll be quite happy :), but it looks like I'll need to write an avs plugin, which will require me to do a fair bit of learning. I learn pretty fast, so I can do it sometime in the holidays, but it would be easier if someone else with some experience would write it for me :D if anyone is interested then I'll put up more details of what I have in mind.

- Soc

[TaZ4hvn]

I didn't even imagine your encode can take more than 24 hours :)
I already fixed the bug for more than 12 hours ... ok I will do it again for 24 :)

Also check your PM about the GUI thingy ...

[superdump]

What happened to the quick 0.41 update? :)

[Riley]

I am having a problem with the Tazit program. The program always seems to freeze up during the beginning of step 4, when it is checking if the source is interlaced. (avs2avi has 0% cpu usage)

I have run the program on other computers without any problems. But it always freezes up at the same point on my Dell Dimension 2350. I have XP home edition installed. I also believe the computer came with the .NET framework already installed.

I really love your program, but I need some help to get the program running on MY computer.

-riley

[Soc]

@riley
A possibility is that it's something to do with TaZit setting the avs2avi process priority to idle, and somehow either some other program with higher priority is using all the CPU or some similar problem. You could test this by changeing the priorty of avs2avi in the CLI (do a search in TaZit.bat for -p 0 and replace with -p 1).

Please let me know if this helps

- Soc

[Riley]

@Soc
I tried your suggestion, but unfortunately that did not solve the problem.

It is specifically "freezing" at the following line in step 4:
"%AVS2AVI%" "%CONVDIR%\Projects\%PROJECT%\ivtccheck.avs" "%CONVDIR%\Projects\%PROJECT%\ivtccheck.avi" -p 0 -c xvid >nul

With the task manager being the only other program running I can see that the cpu is 98% idle (with the task manager itself using 2% of CPU and avs2avi still using 0% regardless of priority setting).

I have tried testing with various DVD's and the problem is very repeatable.

I'm a big newbie when it comes to programming, but I'm assuming that avs2avi is being passed in with a command or setting that it just doesn't know what do with. Hence why it's stuck at 0% cpu usage? I really have no idea.
:(

I find the whole thing to be very odd. Especially since I am using a NEW install of Tazit (with no modifications to code) on a new system that has practically no other programs installed.

Any other suggestions? I would *REALLY* love to get this working on my computer.

[TaZ4hvn]

Well I assume you did some usual verification :sly:, open the convertion folder:

- does ivtccheck.avs exists ?
- can you open it with a player, with virtualdub ?
- is ivtccheck.avi created (even if 0 size) ?
- did you try to launch avs2avi out of TaZit to see if it works ?
- are you using avs2avi version provided with TaZit ...

Please give me some more stuff so that I can have a clue, I suspect it to be a silly thing.
Anyhow, in a few weeks at most, I'll release a totally new version of TaZit did with some real programming stuff: It could takes times since I have to learn so much on modern programming languages :)

[Soc]

Originally posted by Riley
I tried your suggestion, but unfortunately that did not solve the problem.

It is specifically "freezing" at the following line in step 4:
"%AVS2AVI%" "%CONVDIR%\Projects\%PROJECT%\ivtccheck.avs" "%CONVDIR%\Projects\%PROJECT%\ivtccheck.avi" -p 0 -c xvid >nul
Are you sure you change all the occurrences of -p 0 to -p 1, in TaZit.bat? That line you quoted is still using -p 0!

Please try again

- Soc

[Riley]

@Taz
I really appreciate your help (and for writing the program).

Yes. I am using the avs2avi version provided with TaZit. The only programs installed on the computer are DVDDecrypter v3.1.6, Daemon tools v3.33, Koepi's 14052003 Xvid build, and TaZit v.4

Yes, ivtccheck.avs does exist. I can view it in notepad. If it would be helpful, I can post its contents.

The file ivtccheck.avi is NOT created. At the command prompt, I tried to run avs2avi with the same parameters that TaZit uses, but got an error message like the following:

AVIfileOpen unable to open avi

I can also post the specific error message tomorrow.

Again, I appreciate you guys trying to help me out. I wish I could give you more specifics right now, but I can't. I'm running TaZit on my home computer, which does not have an internet connection, and I can only post from my computer at work.

@Soc
Yes, I am sure that I had made the appropriate changes, but it still didn't work. :(

[TaZ4hvn]

Yes, ivtccheck.avs does exist. I can view it in notepad. If it would be helpful, I can post its contents.
In case you're not familiar with avisynth, you should be able to open it with a media player also or with virtualdub and get the movie.
I have to know if you can do this or not to determine if the problem comes from the avs script or from avs2avi, plz let me know.

[Riley]

VirtualDub could NOT open ivtccheck.avs.

It said "Cannot Determine filetype of "C:\RIP\Projects\1MPRNTS\ivtccheck.avs"

Here are the contents of the ivtccheck.avs file:

Loadplugin("C:\Video\TaZit\AviSynth\plugins\AutoCrop.dll")
Loadplugin("C:\Video\TaZit\AviSynth\plugins\Mpeg2Dec3.dll")
Loadplugin("C:\Video\TaZit\AviSynth\plugins\Decomb.dll")
Mpeg2Source("C:\RIP\Projects\1MPRNTS\1MPRNTS.d2v")
Import("C:\RIP\Projects\1MPRNTS\ivtc.tmp")

SelectRangeEvery(1400,14)
Call("'C:\Video\TaZit\utils\NicEcho.exe' 'C:\RIP\Projects\1MPRNTS\ivtccheck.tmp' "+string(framecount), "-2")
Subtract(DeComber( 2, 6382))

[TaZ4hvn]

Ok, so your problem is certainly relative to avisynth installation and in now way with TaZit.
please try this minimalistic script:

"Loadplugin("C:\Video\TaZit\AviSynth\plugins\Mpeg2Dec3.dll")
Mpeg2Source("C:\RIP\Projects\1MPRNTS\1MPRNTS.d2v")"

does it works ? if no please check existence of 1MPRNTS.d2v.
if yes, try this even shorter:

"Mpeg2Source("C:\RIP\Projects\1MPRNTS\1MPRNTS.d2v")"

just to know if your plugins directory is find by TaZit. Let us know.

[mulderfox]

What about the Profiles? Are there profiles which use alternating bitrates? as in a movie with action scenes, and slow scenes..
All I see (in version 0.4) are 7 profiles, most of them low-motion..
I thought the program was supposed to analyze each movie and decide on a strategy in accordance..
Any tips about that?

thanks!

[TaZ4hvn]

@mulderfox: I don't get the point :confused: TaZit uses XviD, slow motion or low motion profiles are nonsense, this is codec's stuff to choose the right settings for each scene (at least with modern codecs). Perhaps are you talking about finer settings you class are low/fast motion like MPEG matrices, Bframes ratio or others ??

[mulderfox]

when I start tazit, I get the checkup screen (that sees if I got all the programs), and after that, I'm asked to choose of 8 profiles starting from "Best for low rare - english - slow" and ending with "higher quality - francais - slow". what's with those?

btw, how much free space should I leave aside from the space needed for the dvd ripping?


thanks

[majerle]

@mulderfox

an extra 3gb, over ripped dvd

~ 300 mb for every ac3 audio tracks
~ 60 mb for ogg vorbis audio
~ 700 mb for avi first pass
~ 640 mb for avi second pass
~ 695 mb for final ogm
~ 700 mb for .bin/.toc/.cue
~ 10 mb for varius test files

btw, in profiles, you can specify what files want to keep

for profiles : i made 11 xvid.reg dump (as this
Xvid_2-125-100-255-vhq1.reg xvid1
xvid_2-150-100-255-vhq0.reg xvid2
xvid_1-150-100-100-vhq0.reg xvid3
xvid_1-200-0-0-vhq0.reg xvid4
xvid_2-125-100-255-vhq0.reg xvid5
xvid_2-150-100-0-vhq0-gmc-qpel.reg xvid6
xvid_2-150-75-0-vhq0.reg xvid7
xvid_2-150-100-0-vhq0-qpel.reg xvid8
xvid_3-100-100-0-vhq0-qpel.reg xvid9
xvid_3-150-75-0-vhq0-qpel.reg xvid10
xvid_2-150-100-0-vhq0-qpel-RD.reg xvid11)
and 6 profiles, using differet settings.

Try yourself, tazit is able of marble result tweaking its settings)

Regards

Andres

[TaZ4hvn]

Well, I would recommend a bit more, like 5GB, since majerle example is a very favourable case: 700MB first pass and one CD output only :sly:
But if you specify to keep only selected files, others are deleted as soon as they are not necessary anymore, so it should decrease need for space drastically.
About profiles, you should almost always go with the first one, profiles are not educationnally designed, I mean I just did some very quickly to show ppl how to build them, I'm not claiming they are good, except perhaps for the first wich reflects actual consensus on XviD settings.

Good Rip :)