GPL command line M2V transcoder [Archive] - Page 11

dragongodz

27th November 2003, 04:36

wow. go away for awhile and look at those pages grow. :)

Nic - for authoring i still think the dvdauthor package is the way to go. it can mux video and audio plus create ifo's including chapters etc. ok the subs are not the best at the moment but it is still being worked on and is open for anyone to grab and change. to see some of things being done check here

http://www.dvdrhelp.com/forum/viewtopic.php?t=180017&postdays=0&postorder=asc&highlight=dvdauthor&start=0

so you have a duron and no dvd burner and no standalone player ? hey thats me too. :)

Doom9 - yes you are right, you must make available source on request. you also must state that your program is using GPL source code in it and the program must be released under GPL aswell. i dont know about anyone else but this is the first i have even heard of ifoedit using GPL source. i have to wonder why then it has never said so on his site or that the source is available by request etc.

Doom9

27th November 2003, 08:24

i have to wonder why then it has never said so on his site or that the source is available by request etc.Well.. I didn't know about this either until very recently. But it appears that the issue will be resolved shortly..

DVDRFreak

27th November 2003, 08:29

Originally posted by mmgrover
@VILLA21

I'm not sure when eyes`only will release his next version.

mike

@mmgrover

I tried to use it but somehow it does not work with DIF 1.3.4. Maybe I should enable the copying of unused VTS files but that is not what I want because those files I will blank out anyway.

Will this new version also include an option that it will not create the DVD2AVI files. For ReJig these are not needed and it takes a while to create them.

ffroms

27th November 2003, 08:36

Originally posted by E-Male
on a good dvd te bitrate already is distrubuted well
and rejig just keeps this distribution

I don't know if this was answer to my question but I didn't mean that. I was thinking more like in Xvid where you have option to set fixed quanta for end credits there for you end up with more space for main movie. Same thing can be used for diffrent parts of movie.

FFS

jhmac

27th November 2003, 12:11

Happy Bird Day all...

mmgrover

27th November 2003, 14:19

HAPPY TURKEY DAY ALL :-)

@DVDRFreak

What errored out?

mike

JvD

27th November 2003, 16:52

Happy bird!? (from a vegeterian point of view ;-)

Yeah, right, and He is the the leader of the free world? Sure.
http://www.whnpa.org/events/thanksgiving.jpg

Happy Thanksgiving!

rasta21

27th November 2003, 17:07

...sorry but does anybody know how to compile the new version in linux

...i tryed

gcc main.c -o requant -lm

...but i got the error

main.c:71: error: invalid register name for `outbitbuf´

unixfs

27th November 2003, 17:13

you have to undefine the REGISTER_<SOMETHING> macro at the beginning,
that is PPC specific.
And don't forget to #undef DEMO and to add -O3

rasta21

27th November 2003, 17:24

...thanx a lot...now it works

DVDRFreak

27th November 2003, 17:55

Originally posted by mmgrover
@DVDRFreak

What errored out?

mike [/B]

Wel DIF4U 1.3.4. says it starts ReJig but finishes right away and there is no ReJig.txt file created. I figure it has something to do with the option to copy unused VTS files to VIDEO_TS. I did disable it in my previous test because I do not want to include those in my final DVD.

mmgrover

27th November 2003, 18:46

@DVDRFreak

Ya, Copy Unused VTS Sets must be checked...
I always check every vts in DoItFast4U and run ReAuthorist to
Put dummy video clips in the ones I don't want then remove from
ReJigData.txt the ones I blanked out :-)

mike

mmgrover

27th November 2003, 18:54

A nice trick is to open the REJIGData.txt

look at your percentages

"M:\Star Trek The Next Generation Season 1 Disc 3\VTS02\VTS__02_P01.P.4~3_1.m2v", 2, 52"

Look at your m2v file and get 52 percent of it file size.

Then change line to:

"M:\Star Trek The Next Generation Season 1 Disc 3\VTS02\VTS__02_P01.P.4~3_1.m2v", 2, 52, 890"

this will cause rejig 0.4h to use desired file size instead of
percentage.

mike

DVDRFreak

27th November 2003, 20:25

@Nic

The new engine produces bad quality in comparison to the old one.

I did a test on a movie at 71%. The new engine produces a picture with a lot of scenes in them where the pulsating pixel problem is very noticable. The old engine however produces a picture without these anoying artifacts.

Also there are macro blocks in the beginning of the picture with the new version that are not there with the old one.

Did anyone else do a quality comparison yet ?

Nic

27th November 2003, 20:47

Did you use ReJig to do the testing?

-Nic

DVDRFreak

27th November 2003, 22:27

Originally posted by Nic
Did you use ReJig to do the testing?

-Nic

Yes, did do a few test on different movies using

ReJig 0.4g new requant engine
ReJig 0.4c old requant engine

In both cases I used raw M2V files. With the same ratio (71.765%).

Good example is Indiana Jones and the temple of doom I just bought. The beginning the old version shows no blocking or artifacts in the studio logo. The new version show pulsating and macro blocks. A little later in the movei when Indy is having a argument with the girl the wall that is yellow/brown is pulsating in the new version in the old version it is not.

E-Male

27th November 2003, 23:35

i was goign to do some back-ups at teh WE anbyway
i'll do the encoding twice to compare the results aswell

The_Flash

27th November 2003, 23:39

Originally posted by DVDRFreak
@Nic

The new engine produces bad quality in comparison to the old one.

I have to agree. I ran some comparisons on the new engine and have found that it tends to macroblock more often, especially at the beginning of films. I also concur with the above mentioned pulsating findings.

Nic

27th November 2003, 23:44

http://nic.dnsalias.com/ReJig.zip
http://nic.dnsalias.com/ReJig_src.zip

Load it up once then check the registry:
LOCAL_MACHINE\Software\ReJig

You'll be able to turn on the Original Engine there (it's only checked at start up, so only change before loading ReJig). Please let me know the quality of the two. Makira sent me a patch for libmpeg2 to test PSNR values, and assures me it's better quality. Ill do my own testing soon.

-Nic

@mmgrover:
Could you add a link to the dvdremaster website on www.rejig.org. Maybe one on the frontpage too, they are giving a lot of support. I think they'd appreciate it. Cheers :)

mmgrover

27th November 2003, 23:48

@Nic

I'll do that right now :-)

mike

Nic, It's on the main page and the links page.
Check if you could to see if it looks ok?

mike

I added 0.4i to web site

Fabiano

28th November 2003, 02:14

Hi,

Does anybody know what is the compression ratio between I,P and B-frames given a certain recompression factor ?

I've noticed with the old engine if you use a recompression factor of 90% only B-frames are compressed.

Fabiano

28th November 2003, 02:20

@NIC

Is the 2-pass working with the new engine for a m2v file? (Rejig 0.4i)

I've tried setting the output to 4300MB and 4200MB and both of them gave me an output 60MB less than the original file. The original file is 4660MB.

Edit 1:
I just tried 1-pass 92%, and again it gave me a file 60MB less than original.

I used AviSynth to compare both files (subtract frames), they are the same.

Am I missing something ?

Is 9x% too high to recompress using the new engine ?

Edit 2:
Just tried 80%, same output!

I think the new engine does not like my Alias HDTV files ! :(

dragongodz

29th November 2003, 03:30

i have just sent a new mod to the old engine to mike at rejig.org so hopefully you should see a new version of 0.4i up soon. it should be better/closer to resize ratio again. this is probably as far as it can be pushed using these changes, really what it needs is P frame quantisation aswell after a percentage of B frame quant is applied. that would produce even better size and should be better quality. if you want a more detailed explanation of what i mean just say.

speaking of quality....on static scenes the new engine does produce more blocks but on motion scenes the old engine can produce worse blocks that go good after a second. this is because the main brunt of reduction is being put on B frames. that is B frames are having the most done to them so when a lot of reduction is required they are made very bad.

unixfs

29th November 2003, 08:42

Originally posted by dragongodz
what it needs is P frame quantisation aswell after a percentage of B frame quant is applied. that would produce even better size and should be better quality. if you want a more detailed explanation of what i mean just say.

yes, please :)

Once I applied the changes you proposed to the reaction parameters to make m2vrequant compress more:

in requantengine.cpp change the react_delay values. so -2.5f becomes -1.0f, -5.0f becomes -2.5f. then change -60.0f to -10.0f and -80.0f to -20.0f. make sure to change all instances

but the result was the same; is there anything else (that can be made with sumple variable assignment) that I can do to make the program compress to less than 33%?
I'd really appreciate it!
Thanks.

DVDRFreak

29th November 2003, 10:10

Originally posted by dragongodz
speaking of quality....on static scenes the new engine does produce more blocks but on motion scenes the old engine can produce worse blocks that go good after a second. this is because the main brunt of reduction is being put on B frames. that is B frames are having the most done to them so when a lot of reduction is required they are made very bad.

The new engine however produces the enoying pulsating picture effect that is veru vissible on my TV. The old engine does not seem to have this problem if you use a percentage >= then 70%. Could this be caused by compressing the P-frames to much.

For now I'm sticking with the old one.

Nic

29th November 2003, 11:29

Thanks for the feedback, I might make the old engine the default for now then...

Ill try to get makira to come look at the thread, maybe he can post a comment.
He last wrote to me saying:
"It is a definite improvement. The bitrate controller is simply better."

Maybe it is my port or implementation that is causing an issue, ill look into it.

Last night I was writing a program that could copy the subtitle colors from one IFO to another IFO (like IFOEdit can do). Ive also written into a program called replex the ability to do:
replex in.vob in.sup out.vob
Which will mux sup files. Tried out dvdauthor too, works great with those files.

Got a dvd writer now too ;)

-Nic

E-Male

29th November 2003, 12:22

seems my exitement about this project was morethan justified

so rejig now can rip, transcode and author movie-only

i assume it's not much work finding out the length of the video and the bitrate of audio streams

so it shouldn't be hard to let rejig calculate the right final file-size for the video

let's say we use 4.2 GB
and subtract the size of the audio streams (=length * bitrate) and subtitles (can their size be easily calculated?)
then we got the video size

so after selecting which streams should be kept rejig could do the complete movie only backup automatically

thoughts on this?
anything difficult i overlooked?

CU
E-Male

p.s. it would be cool if on the window where i seletc which streams to keep rejig would directly show the needed percentage of the video compression, so i get an idea how many stream i can keep without causing too much quality loss

p.p.s. if no additional compression by rejig is needed it should of course skip it

p.p.s. will post quality test results on sunday or monday

dragongodz

29th November 2003, 14:12

unixfx - i also lower quant reaction and added an extra quant increase if further behind. easiest way to see all the changes is look at the requantengine.cpp and search for dragongodz. they are in the current version of rejig aswell. but please try my modded verion 0.4i when mike puts it on rejig.org (should be in development section) aswell. you will need to do the registry change to use old engine as Nic said earlier.

ok quick explanation of what i was talking about with the new engine.
now i have not gone looking through the code so am going on what was said comparing it to dvd2one(on dvdremaster site). it says basically that the new engine is a CBR engine, thats Constant Bitrate Reduction. so if you want to reduce the video by 30% then all frame types are reduced 30%. pretty straight forward. problem being i do not think that is the best since once you get to 30% you are doing quite a bit of damage to frames that should not be.
i think a weighted by frame type reduction would produce better quality. first i should say this is done a GOP at a time rather than a frame for size accuracy.so using the example of 30% reduction you reduce B frames 30%+30% of reduction amount(meaning 30% of 30%) so B frames would be reduced 39%. does this reduce the GOP to the 30% reduction ? unlikly, only when you are doing only a tiny amount of reduction would B frames alone be enough. so second step is to reduce P frames up to the point that the 30% reduction of GOP size is obtained. except if P frame reduction reachs the 30% and GOP reduction is still not done. only then reduce I frames aswell. since extra reduction was done on B frames I frames should only need to be reduced a little and never the full 30%.
so B frames would be reduced the most( reduction amount + 30% of that), P frames reduced to the reduction amount at most and I frames always less than reduction amount.
weighted frame reduction based on type as i said. :)

Nic - cool about the subs and dvdauthor. what dvd burner did you get ?

e-male - skipping reduction if not needed should be really decided by rejig itself, that way the engine is never called and frames are simply copied. i asume thats what you mean ?

JvD

29th November 2003, 14:32

Originally posted by Nic
Last night I was writing a program that could copy the subtitle colors from one IFO to another IFO (like IFOEdit can do). Ive also written into a program called replex the ability to do:
replex in.vob in.sup out.vob Which will mux sup files. Tried out dvdauthor too, works great with those files.

Got a dvd writer now too ;)

-Nic

Congrats to the new writer, at last ;-)

How about those programs, are they free to try out?

E-Male

29th November 2003, 19:51

Originally posted by dragongodz
e-male - skipping reduction if not needed should be really decided by rejig itself, that way the engine is never called and frames are simply copied. i asume thats what you mean ?

i just mean if ((target size) >= (original size)) then rejig should basicly function only as a ripper (and reauthorer) but not as a transacoder, which would make no sence in this case
basicly i shouldn't have said that, I'm sure Nic thinks of sooo basic stuff himself :)

Nic

30th November 2003, 02:01

Have to be quick, wrote two little programs today. One which I wrote from scratch this morning called SupMux which works in the form of:
SupMux c:\in.vob c:\out.vob c:\english.sup 0x20 c:\dutch.sup 0x21

You can guess what it does :) Works real well.

Also CLUTCopy, written from scratch, which works like:
CLUTCopy c:\original.ifo 0 c:\new.ifo 0
which copies the original subtitles colors from original.ifo PGC0 to new.ifo PGC0

Also, incase you didn't know, Derrow has agreed to release the authoring code of IFOEdit. Although he has to seperate it from IFOEdit (im guessing), so this may take a while to surface.

But I dont think we need it. I tried my new programs with mplex -f8 and dvdauthor and did Reloaded with two subtitle languages and one audio language. Came out perfect and right size :)

So ill be adding all that in soon,
-Nic

TCmullet

30th November 2003, 07:20

Nic,

Do you think you'll be modifying ReJig to shrink P frames? If so, do you know approximate when?

And yes, the new engine always shows worse for me than the old. I am embroiled in capturing volleyball games from cable. Using the new engine (default in 0.4i) the players have a 'pixelation force-field' around them when they are moving. With the old engine, that artifact is much more negligible.

And yes, I vote to have this 1 big thread, not a lot of little threads--no matter how big it gets.

Your program is changing my life... and I don't even have a DVD player. Thanks so much! :)

TC

DVDRFreak

30th November 2003, 15:33

@Nic

New version of the engine is available. No idea what has changed however.

Nic

30th November 2003, 16:07

Cheers, Ill release a new build tonight.
Im going to make a new seperate prog that will come with ReJig that will do DVD Authoring, ill try to make it look like IFOEdit's DVDAuthor Dialog. It will use mplex, dvdauthor, supmux, clutcopy all built in. So if I go quiet on ReJig for a bit, it will be because im writing that.

-Nic

echooff

30th November 2003, 16:19

Wow! You rock. Keep up the great work. Love this stuff.

TCmullet

30th November 2003, 16:54

Originally posted by Nic
Cheers, Ill release a new build tonight.
Im going to make a new seperate prog that will come with ReJig that will do DVD Authoring ... So if I go quiet on ReJig for a bit, it will be because im writing that. -Nic Great! However, is there any chance you could do P-frame reduction first? We've got lot of mpeg PS files that have to be cleared off, and I'd hate to do them prematurely because I couldn't wait for the P-frame enhancement. However am running out of space, so will have to use .4i if P-frame enhancement is not soon. Hope you understand.

If you KNOW you won't tackle P-frames soon, could you please say so? Thanks! TC :)

TCmullet

30th November 2003, 17:00

Originally posted by DVDRFreak
@Nic
New version of the engine is available. No idea what has changed however. Nic, for us idiots out there, could you please make it clear in the docs which engine will be which? I'm now settled on the idea that the registry switch should be set to 1 to use 'the old engine'. Now that there is 'a new version', will there be 3? Or just 2, and which 2? Will the 'new' one replace the "OLD new one" leaving the "old OLD one" intact? I hope you see why this is a bit confusing.

Nic

30th November 2003, 18:02

@TCMullet: P-Frames do get compressed, just perhaps not as well as they should be. I wont be looking into in much detail soon. Ill be hoping makira and metakane will be doing that for us ;)

There will only be a maximum of two engines so:
Use Old Engine = 1 means using the old engine
Use Old Engine = 0 means using the latest engine

As far as I can tell this new update doesn't help matters...Ill email makira and see what he thinks (I can still see the blocking on the first few frames, etc)

(Currently im checking for SUP creation bugs...)

-Nic

ps
grrr...found the bug in sup creation. VobEdit has it too, hence I never noticed it....

E-Male

30th November 2003, 22:40

EDIT: question removed
found the reg key, will test now

Eyes`Only

1st December 2003, 03:34

DoItFast4U! 1.3.5 has been rlsed for use with Rejig 0.4h+. I've been sick (crazy winter viruses!) lately so it took me a while to code, test, and feel comfortable with the newest bugfixes/additions.

Sorry I haven't been active on this thread but I honestly feel like DoItFast4U! issues should be discussed in the Big3 section of this forum, and I don't want to discuss most of the things that have been asked in this thread as I feel it is better left to other discussion. On the other hand, don't feel like you can't ask questions about DoItFast4U! and Rejig integration in the Big3 forum, because you can, and I openly welcome you to. I talk with mmgrover about integration often and he is very active in this thread so I feel he's a good liason for this thread. If anyone disagrees, I'm open to opinions.

DVDRFreak: Your assumption of not needing d2vs is incorrect. The d2v and avs files are still needed for accurate duration assessment and so they will still be created.

TCmullet

1st December 2003, 06:59

@Eyes only, and everyone else,
While I haven't been talking about doitfast4u, dvdshrink, etc. I have been looking into them. Or perhaps I should say it was a couple long weeks ago I was recommended to look for dvdshrink and related utilities that I somehow found Rejig. The big question on my mind is: Are there programs other than Rejig that will accept an mpeg2 program stream (.mpg) or elementary stream (.m2v) and create an output stream like ReJig? I've tried Dvdshrink, but could not make it open my .mpg or .m2v files. What good are those programs if they won't open the mpeg2 files on which DVD is based? (I suspect they are working with DVD-authored files of which I am still ignorant as I have no DVD player yet or any DVDs--but I'd appreciate y'alls feedback and/or orientation.)

My background is that in late 2000, I got a Dazzle DVCII and have been active at times on the discussion board www.dazzlegeek.com. I've both received and given a lot of help. There's been a lot of great on-point and slightly off-point discussions as well. Others have occasionally visited the board and commented on how great it is both in attitude and content in comparison to other boards. My own personal experience is limited to burning PS files to CD-R and a few SVCDs. Some (or many) of the other users there are into DVD authoring and burning, but I'm behind the times. This is the only Doom9 thread I've jumped into--twas a challenge to wait out those 5 days, but am glad to be here. As a whole I found it very helpful to read the entire thread up to this point. Many thanks to Nic and everyone. :)

Eyes`Only

1st December 2003, 07:24

TCMullet: CCE is my tool of choice for reencoding .m2v files. You can get excellent quality even at low bitrates (something no transcoder can do currently). Though there's an upside (quality) there's also a downside (speed) so it's basically dependent on how much you value quality. I personally don't mind the extra time for the output I get. However, this topic definitely doesn't belong in a pro-Rejig thread :)

For more info see: http://www.doom9.org/mpg/cce-advanced.htm