chapterEditor(Chapter-Database Disc2mkv Matroska-Tools[Tags,Menu,Multi-MKV])+CLI

[hubblec4]

Hi darksen

Can you try to upload chapters, and tell if everything works?

[darksen]

Hey, thank you! It now works well like usual.

[hubblec4]

Wonderful. Thanks for your feedback.

[hubblec4]

chapterEditor(cE) rev1.30 is available.
Windows (https://forum.videohelp.com/attachments/62735-1641249148/cE-W(1.30).7z)
Linux (https://forum.videohelp.com/attachments/62736-1641249148/cE-L(1.30).7z)


After a while there is an update again.

BCP 47 IETF language-tags are now available after the new Matroska Standard
and replace the old language and country codes.

The processing of the language-tags works similarly to MKVToolNix(MTX).
So you have to get used to no new input mask.

However, I did not want to open this extra form to set a language.
The goal was to maintain the "old input" for the languages.
For this you can predefine in the settings("often used") IETF language favorites,
which are then available in the selection lists and can thus be used directly.

New language-tags can be added individually at any time to the selection lists.

The input mask:
https://gitlab.com/hubblec4/laz_bcp47/-/raw/master/docu/pics/FormBCP47.jpg

There are a few differences to the input mask of MTX.
My Laz_BCP47 Package (https://gitlab.com/hubblec4/laz_bcp47) supports the complete IANA code list for all subtags.
So there is also the "Grandfathered" option
and for the Extensions there is a selection list of the possible ones (there are only two) permissible values.

MTX supports about 8000 languages but in the IANA code list there are 8213 (cE supports all).
Therefore, it can happen that MTX does not recognize a language code from cE.


Change chapterEditor

added &
fixed *
improved #
changed %


rev1.30 2022-01-03
// chapterEditor
& BCP 47 IETF language-tags
- own Lazarus Package -> Laz_BCP47 (https://gitlab.com/hubblec4/laz_bcp47)

& IETF language favorites (settings)
- Predefined BCP 47 language-tags for the selection lists


// Matroska Chapters
% "Disable the multi-language and country system" removed

% Country selection for chapter names removed


// Chapternaming
& Chapter names from Favorites: Language-tag parsing for BCP 47 IETF
- The obsolete language and country codes continue to work

% Matroska: Country selection removed


// Tab management
% "Compare tabs": Countries for Matroska tabs removed
- New comparison code for Matroska tabs <0,0,0,0>


// Chapter database
% Old languages: Data column removed
- older cE versions no longer compatible

[Lirk]

Hi. Is there way to select certain chapters in DVD2MKV, export them in MKV and to select all titles/chapters at once? Also, if open .IFO file through "Chapter Editors" tab, then DVD angles does not appears, even if uncheck all "Hide IFO-Title" filters, unlike DVD2MKV tab.

[hubblec4]

Hi. Is there way to select certain chapters in DVD2MKV, export them in MKV and to select all titles/chapters at once?

Hi and welcome to cE.
Export chapters from the DVD2MKV editor is not possible. The chapters will be created automatically for each title and can be loaded into the chapter-editor.


Also, if open .IFO file through "Chapter Editors" tab, then DVD angles does not appears, even if uncheck all "Hide IFO-Title" filters, unlike DVD2MKV tab.

Yes that's true, the Angles of a title there not present because the chapters are always identical for Angle-Titles.

[Masutin]

How do I choose a file to use Upload chapters? It looks like I have an account.

[hubblec4]

Load your chapter file to the chapter editor tab(Matroska). Then you can upload it.

[Masutin]

Alles klar! I got an error as I opened in the OGG section.

[hubblec4]

chapterEditor(cE) rev1.31 is available.
Windows (https://forum.videohelp.com/attachments/63745-1646786541/cE-W(1.31).7z)
Linux (https://forum.videohelp.com/attachments/63746-1646786541/cE-L(1.31).7z)


In this update there are a few improvements and new features for mass paste of chapters.


Change chapterEditor

added &
fixed *
improved #
changed %


rev1.31 2022-03-09
// Text-Favorites (chapter names)
# multiple IETF Language-Tags for a chapter name (comma separated)
- Example: Chapter||de,en,de-CH or Chapter||ger,eng,de-CH
- support for the old language-country-code formatting removed


// Matroska Chapters
& use predefined IETF languages of chapter names from the Text-Favorites


// Multi Chapters
& delete existing chapters

& All tabs

* two values were not loaded from the INI file


// Chapter naming
& all values are now stored in the INI file


// Disc2mkv
* Disc Title Profiles now use IETF language tags

[skelleton]

Hey I hope this is not the wrong place to ask.

But i have my own tool for processing my BluRay rips that o have been working on once in a while in the last few years. And up to now I have used the copy of chapterdb that is hosted by plex.

Unfortunately it seems like Plex has disabled API access in the last couple of months.

I have seen that you seem to have a copy of the chapterdb database. Do you know of any source where I could also acquire a copy of that data short of writing a web scraper for the Plex site?

As a fallback i tried to use the CLI version of your program, but it does not seem to like my credentials.
And I think at this point I would like to have a local backup data source at the very least.

Unfortunately I can't find any other copy of the data and I seriously doubt that the plex guys would even respond to me.

[hubblec4]

Hi skelleton,
and welcome to Doom9.

Yes chapterEditor(cE) uses the chapters from ChapterDB.org. Many people have registered and uploaded new chapters to cE's database.

The CLI version uses the old database of the deprecated cE (versions up to 0.51).
I'm wondering a little that the database still works.
You can create a user account with the old cE(0.51), and than you can use the CLI version.
But this database is outdated and only a small amount of chapters is used from ChapterDB.org.

cE->1.xx uses a new database, but there is currently no CLI options.

What is your aim and what do you need?

[skelleton]

I have my own tool to fix metadata and set encoding options for my makemkv rips.

So far I have used the data from https://chapterdb.plex.tv/ via the api. Unfortunately the API no longer works, so i need an alternative source for chapter data.
The way i use the API is that i run a search for the title and match the length from chapterdb to the lenght of my file. This has worked pretty decently for cases where chapterdb actually has data available.

At the very least i need something that i can call from python or the command line to get results. Ideally i would want a data source that i can run on one of my computers. That is mostly because i only run my new blu rays in batches every few months, and its a pain when i notice that one of the external services i use does not work any more, or has changed something.

[hubblec4]

...
The way i use the API is that i run a search for the title and match the length from chapterdb to the lenght of my file. This has worked pretty decently for cases where chapterdb actually has data available.

That means you need a new way to get your chapters from a working database via batch process.
Maybe I find time to add such function for cE's CLI.
Is the old cE-CLI version good enough for your needs? Or do you need other options?


At the very least i need something that i can call from python or the command line to get results. Ideally i would want a data source that i can run on one of my computers.

If you want I can share with you the ChapterDB.org database.
I have downloaded almost the whole DB.
The DB has a uncompressed size over 2GB. For each ID there is a chapter xml file and a html file (saved as .txt) with the movie info.

[skelleton]

It would be great to have the chapterdb database. And 2 GB is not an issue storage wise. That will still fit my fast storage.

With the old CLI version. I think i might work for me, but as i never had it running so far i am not 100% sure.
Currently i kind of rely on getting several matches for a title search and those matches contain the movie length associated with the chapterset. Once I have those to values I match my movie length.

So depending on what ChapterEdit returns I may have to rework how i match chaptersets to my ripped media.

But besides that i am not sure that its smart to incorporate an essentially deprecated tool. Especially if it works against a different database than the current version.

[hubblec4]

It would be great to have the chapterdb database. And 2 GB is not an issue storage wise. That will still fit my fast storage.
OK. But keep in mind I have filtered some movies(chapters), because titles like "xxxxxx" or "chapters_01" doesn't make sense or chaptersets with only one or two chapters. Furthermore there are no new chapters which uploaded to cE's database.
ChapterDB.org (https://forum.videohelp.com/attachments/63887-1647694774/ChapterDB.7z)


With the old CLI version. I think i might work for me, but as i never had it running so far i am not 100% sure.
....

So depending on what ChapterEdit returns I may have to rework how i match chaptersets to my ripped media.

OK.
The output of the old cE-CLI version is a simple text with info about a movie and you can download the chapter xml/or ogg.txt file.


But besides that i am not sure that its smart to incorporate an essentially deprecated tool. Especially if it works against a different database than the current version.

Yes of course :-)

[skelleton]

Thank you a lot. And your changes basically just save me some work so that is great.

[tormento]

I have bought a collection of anime BD.

Unfortunately each mpls contains 2 episodes, divided in two m2ts.

Encoding and audio demuxing is not a problem, as I indexed each m2ts separately, but obviously the chapters are contained in the mpls.

Is it possible to create the two separate chapter files for each episode with the correct timings?

[hubblec4]

Is it possible to create the two separate chapter files for each episode with the correct timings?

Yes, but not automatically.
You can use the Split-Chapter (https://forum.doom9.org/showpost.php?p=1902412&postcount=554) feature.

[hubblec4]

chapterEditor(cE) rev1.32 is available.
Windows (https://forum.videohelp.com/attachments/65052-1653752889/cE-W(1.32).7z)
Linux (https://forum.videohelp.com/attachments/65053-1653752889/cE-L(1.32).7z)


A small update with a lot of work for the BCP47.
Mosu had adjusted a lot and I have now made up for this.

The new chapter format, YouTube chapter from the comments, has now also been finished.
Simply mark and copy the text in the comment.
You can then create a text file or load the chapters directly via the clipboard.
It may well be that there is still a little need for adaptation, since the comments can be quite different in their structure.


Change chapterEditor

added &
fixed *
improved #
changed %


rev1.32 2022-05-28
// chapterEditor
& support for chapters from YouTube comments
- can also be loaded via the clipboard

& support for the time format MM:SS (minutes:seconds)
- M:SS is also supported

# Time format H:MM:SS is now also supported

# Laz_BCP47 updated on rev 1 (ChangeLog (https://gitlab.com/hubblec4/laz_bcp47/-/blob/master/ChangeLog.txt))

[bovirus]

@hubblec4

- New language (italian) /njew chnagelog file (italian)

I created the italian language for your program.,

I also created the changelog for italian users.

Italian (.po) language - https://mega.nz/file/uVZETSzD#kCQjOZctR-d0cypT-BxgixCIQgDhu--VKoVwEECWMaU

Italin changelog - https://mega.nz/file/zMxQiDja#8hzhoq-k_6kwK25i0QjDhT3nfjrJZH2ZBZi1QPc9RH0

- Proposal for .po language string change

- Original
msgid "Five- to eight-letter language codes are currently not supported."

- Proposal

msgid "Five-to-eight letter language codes are currently not supported."

to align it to other string

msgid "Four-letter language codes are reserved for future use and not supported."

- Add/test new language file

How can add and test a new language (as Italian).
Pelase consdier to add an option to use additional language file to test in place,

[hubblec4]

Hi bovirus,
and welcome to Doom9.

First, many thanks for your help.


@hubblec4

- New language (italian) /njew chnagelog file (italian)

....

- Add/test new language file

How can add and test a new language (as Italian).
Pelase consdier to add an option to use additional language file to test in place,


Unfortunately only the BCP47 uses the .po-files. As I started coding chapterEditor(cE), I had no idea how to use .po-files for translations.
cE uses a own simple("stupid") translation system.
English and German are hard coded but I had added an option to add more languages dynamically, but this feature is not finished and not tested.
It's a long time ago, but I think the plan was an "in-tool translation feature". So that every user can adjust any text.

I have to check this.

For testing your translated .po file you can use a "dirty workaround":
Rename your "*.it.po" file to "*.en.po" and replaced it with the original en.po-file(make a backup first).



- Proposal for .po language string change

- Original
msgid "Five- to eight-letter language codes are currently not supported."

- Proposal

msgid "Five-to-eight letter language codes are currently not supported."

to align it to other string

msgid "Four-letter language codes are reserved for future use and not supported."


These strings were copied by MKVToolNix to stay synchronously.

[bovirus]

@hubblec4

I already tried to change .it-.po as .en.po but I didn't see any changes in GUI.

Could you pelase post a list of the strings hardcoded in the program and I can translate it in Italian?
In this way you can add italian language to your GUI.

When will be available a mroe felxible external system to read lanbguage file we can switch to this.

What kind of developping language are using to develop cE?

Thanks. KR.

[hubblec4]

@hubblec4

I already tried to change .it-.po as .en.po but I didn't see any changes in GUI.
Only the BCP47 form is effected by the .po files.



Could you pelase post a list of the strings hardcoded in the program and I can translate it in Italian?
In this way you can add italian language to your GUI.

When will be available a mroe felxible external system to read lanbguage file we can switch to this.


I looked this night over this issue, and I think the best solution will be to use .po files for the whole cE.
My own translation system is fine, but I have to write a lot of code for an interface, so that users can translate cE.
.po files are widely used and works. But all this will take some time because over 1500 Strings are used in cE.



What kind of developping language are using to develop cE?



cE is written in Lazarus(FreePascal).

[tormento]

I have cut a multiple episode but single mpls by chapters and now I have many MKV files with the chapters starting with the original numeration, i.e. some starting with 5, other with 11 and so on.

Is there a way to "normalize" multiple OGM chapter files at once? I have tried with manual chapter renaming but it's too slow.

[hubblec4]

Is there a way to "normalize" multiple OGM chapter files at once? I have tried with manual chapter renaming but it's too slow.

Do you use the "All tab" option for the renaming?
For my tests, only two mouse clicks are necessary after splitting chapters.
Open Chapter-naming feature and one click more "Change names and exit".

But I guess you want an automatic feature.?

I will check this: maybe I can combine it with the existing Chapter-naming feature or I have to add a simple renaming feature within the split feature.

I added this issue to may TODO list, but be patient because I work on the .po files which will take some time.

[tormento]

Open Chapter-naming feature and one click more "Change names and exit".
Very nice feature but then I have to manually save each chapter, close the tab with middle click and repeat.

You can:

1) ask to save a chapter if modified before closing
2) add a save all button

[hubblec4]

Very nice feature but then I have to manually save each chapter, close the tab with middle click and repeat.


2) add a save all button
A save all tabs option exists, make a middle click on the save button(In the Status bar is a hint for that) or the entry in the main menu or the default short cut Shift+CTRL+S.
Also exists an option to close all tabs at once. Make a middle click on the tab header and a popup opens. There are other options for closing tabs.




1) ask to save a chapter if modified before closing

I don't know if I can this implement easily. I will check this.

[hubblec4]

Hi bovirus

I have good news for the translation request.
At the beginning it seemed .po files could not be used, or not so easy like I thought.
But I was able to make it works, with a small amount of time and code.

Your translated *it.po file works, but I have found some small issues.
Sometimes you use a line break.
Two strings are not translated: "Grandfathered" and "No normalization".


I have to prepare and fix some things and will provide a test version so soon as possible.

[bovirus]

@hubblec4

"No normalization" = "Nessuna normalizzazione"

What's the meaning of "Grandfathered" in this context?

Thanks.

[hubblec4]

What's the meaning of "Grandfathered" in this context?


I have also tested Google translater....
Grandfahter = Nonno

"Nonno" is the father of the father/or mother?

For German:
Grandfather = Großvater
Grandfathered = Großväterlich

Maybe is a german -> italian translation better.


The behavior of a person is grandfathered. Means this person behaves like a grandfather.

Sorry I'm not a language expert.

[Mosu]

"Grandfathered" in this context means entries that had been valid at one point in time but that don't follow the current-day structure of the language tags. However, the specs writers don't want invalidate existing content that uses those tags. Therefore they make exceptions for those tags.

In English such exceptions for historic elements are generally called "to be grandfathered in".

Translating it directly using "grandfather" as in "my parents' father" would be wrong here. Take something from Italian that matches the semantics of what I described above.

In German I use "Elemente mit Bestandsschutz", which has nothing to do whatsoever with parental relationships.

[hubblec4]

Ahh ok. that helps. Thanks Mosu.

"Elemente mit Bestandsschutz" this seems a bit long for a translation for one english word(grandfathered).
So in short form for this context, is "Bestandsschutz" correct (a good translation)?

[Mosu]

I know what you mean, our German has notoriously longer words than English.

Not sure if I like "Bestandsschutz" without "Elemente" or "Tags" in it, e.g. "Bestandsschutzelement". Similarly you could use "Historisches Element", I guess. Not really shorter, though.

[hubblec4]

Yeah you are right "Bestandsschutz" is to generic.
I like your two suggestions.

Who has the choice has the agony.

[hubblec4]

Hi bovirus

The cE_po_Test (https://forum.videohelp.com/attachments/65428-1655324050/cE_po_Test.7z) version is ready.

In the preferences you can change now the GUI language to Italian.
The BCP47 form is already translated based on your translation.
Grandfathered uses the therm "historical element". Please check the other translation with the "grandfathered" word.

In the languages folder you will find the chapterEditor.it.po file.
For the translation some hints:

1) There are unused Strings -> "??". For the translation use also "??".
My old language system has used only IDs and I have to keep in synch with that system.
This unused Strings could be used later again.

2) Sometimes you will find this two chars "&&", this is fine and must be kept.

3) Duplicated Strings
There were some and I removed these strings.
But for example "Number" is used in German for two different meanings
a) "Nummer" = a string of digits
b) "Anzahl" = a count of something

[bovirus]

@hubblec4

Some proosal.

- Include in the package also .mo files (usefull for a complete UI switch off).

- Rename the empty po file (template) as .pot (template)

- Strange situyation about english language (bcp_47_rs.en.po contains alls trings equal to master - chapterEditor.en.po is empty - it's justa template).

[hubblec4]

- Include in the package also .mo files (usefull for a complete UI switch off).


There was .mo files, but I have removed this files, because I don't know for what this files are used.
cE uses the .po files only.
I know the .mo files are a binary format of the .po files, but I couldn't edit this .mo files with PoEdit.
So I thought the .po files are enough.
You can create a .mo file by your self with PoEdit.

What do mean: "usefull for a complete UI switch off"
Can you explain it a bit?


- Rename the empty po file (template) as .pot (template)

All the .po and .pot files are automatically handled by Lazarus and I don't know when and why the .pot file is created.
For the Laz_BCP47 package was a .pot file created but for cE not. cE uses an older version of Lazarus.



- Strange situyation about english language (bcp_47_rs.en.po contains alls trings equal to master - chapterEditor.en.po is empty - it's justa template).

Yes this was a strange issue which has ticked up time and nerves.
I have used .po files first time in the Laz_BCP47 package. Only the german .po file was used and there was no issue.
Also the BCP47Form example(included in the package) worked without problems.
The translation to English worked without a .en.po file.
I don't know why.

After implementation in cE it seemed all worked well but I found an issue.
It was not possible to change the language back to English.
And I don't understood why the translation worked at start up of cE.

My first idea was to add a "translated" .en.po file.
The BCP47 was now translated like expected and I was happy.

Now I know the .en.po file can be empty and it works also.
(I guess I will remove the translation from the bcp_47_rs.en.po)

It seems the older Lazarus version works different to the current version.


The template .po is the chapterEditor.po but you can also use the chapterEditor.en.po and simple rename the language part(.en.).

[hubblec4]

@tormento

I have started coding your request for auto "ChapNaming".

Unfortunately it is not so easy like I thought. Only the GUI will be able to change the chapter names automatically, not the CLI part.

And I found a bug. Can you check this please?
If you split OGG/OGM files, the splitted files don't have a file-extension, and if you set a "New file name" the files will be created in cE's root folder(also without a file extension).

[tormento]

And I found a bug. Can you check this please?
Please write here the exact event sequence, so others can test it too.

I am asking as I haven't understood. ;)

P.S: Today I learned that "split after X chapters" is different than "after chapter X"... Please add another splitting option, similar to MKVToolnix "split before chapter", where you can write the chapters you want the split(s) to happen before.

[hubblec4]

Please write here the exact event sequence, so others can test it too.

I am asking as I haven't understood. ;)

All is fine now. I found the bad code and fixed it.


...
Please add another splitting option, similar to MKVToolnix "split before chapter"....

All 3 options uses "split after a chapter", except the start chapters from the option "Split by parts".


a) I could add 3 new options which uses "split before a chapter"
b) only one new Checkbox which change the "before or after" state.

Which would you prefer?

I see MTX uses an edit field for the split-input.
Do you also want to have such an input field?

[tormento]

Which would you prefer?
What seems better (and more elegant) to you. :)

[hubblec4]

Hi tormento

Here (https://forum.videohelp.com/attachments/65938-1658267315/cE.7z) is a test version for you.

Automatically chapter naming after splitting and a new split option "before x chapters".

I was a bit wrong, that all 3 split options uses "split after". The individual split option uses "split before".

[tormento]

Here is a test version for you.
Thank, I will test and report.

[BuccoBruce]

Just used this to make some ordered chapter MKVs of movies with multiple editions like Salt and T2. Was pretty damn painless, thank you!

[hubblec4]

Hi BuccoBruce

You are welcome and thanks for your feedback.
Yeah I also like multi Edition MKVs.

[Harrenkyym]

Hi.

I have a doubt. I have a script for movie sync and I'd like to add your tool so I can sync automatically the chapters when available. The thing is, how can I do, using CLI, first a time conversion then a fps conversion. Because via CLI I just know how to change the framerate. Using the GUI I've seen I can change the framerate first then the timestamps. But I need to do it the other way around, if not, the sync is just not correct.

Is that possible?

Thx.

[hubblec4]

Hi Harrenkyym


... first a time conversion then a fps conversion. ......
change the framerate first then the timestamps.


A FPS/frame rate conversion is clear, but what do mean with "time conversion" and "change timestamps"?

I guess you mean time shifting.
Time shifting is not implemented in the CLI nor the GUI->CLI.


Using the GUI I've seen I can change the framerate first then the timestamps. But I need to do it the other way around, if not, the sync is just not correct.


There is no restriction to shift the timestamps first and change then the FPS.

[vertigo220]

Is it possible to take a multi-edition MKV file and switch the editions? So if I have a movie that has the theatrical cut first and extended cut second, could I swap them so the extended cut is first and the theatrical cut second? Most players unfortunately don't support multi-editions, so in order to play any but the first one it would be necessary to do something like this.

[hubblec4]

Hi vertigo220

First: A multi-Edition mkv uses ordered chapters, and this is the whole magic behind.
Most of the software players support ordered chapters, but I guess you will play this mkv on a TV.
I have never seen a TV which supports ordered chapters.
On what a device you want play it?

Therefore the answer is rather no.

It is possible with cE->Matroska Tools->multiMKV editor to extract the Editions. There is a Split-Mode.
But this is not always 100% safe,
because mkvmerge has to cut the big.mkv and merge several mkv parts and this produces sometimes issues at the transitions.