chapterEditor(Chapter-Database Disc2mkv Matroska-Tools[Tags,Menu,Multi-MKV])+CLI

[hubblec4]

Hiho

Last week I had some time and have programmed an online chapter database(o-c-d) for the cE.

The user have the possibility to create a new chapter file or you rename the existing chapters in the Treeview.

A simple search by entering characters in the search edit field.
You can rate movie/chapters and manage your ratings.
You can upload chapters with movie information and manage them(only editing).
Statistics are open for everyone.

Are you a chapter freak and you like to support the o-c-d?
You want to help the o-c-d stay clean.
In the o-c-d is a right management implemented.
You get a lower level and have access to hidden features like Logs or movie/chapter management and more.

The o-c-d is not quite done yet. I will also go on holiday soon.
If someone wants to test the o-c-d, just contact me.
I will then send you a test version by email.


here's a preview.

[hubblec4]

it seems that the o-c-d works.
I have a test version uploaded.

Testversion

[von Suppé]

Hi hubblec4,

Have you received my private messages? I send you twice but I'm wondering if they arrived.

cheers
von Suppé

[hubblec4]

yes i got it, and i answered back to you.

thanks for your helping.

[hubblec4]

The online chapter database is finished so far.

So a few useful chapters / movies are the same place, I have transferred the Chapter
Grabber database.And I have all rubbish removed.
While there are many duplicate records but with different times or chapter names.

therefor the rating system is designed. the chapter (movies) should no good, it can be deleted.

Out of more than 120,000 movies in the CG database 30246 movies been taken in the cE database.

Then there are a few small improvements and bug fixes.

Changelog chapterEditor 

add &
fixed *
improvement #
layout change %



rev0.24
// chapterEditor
& support for ChapterGrabber.chapters file

* Drag&Drop not support folders led to the crash of the editor 

// XML Format
& Online chapter database
  - XML Format (ordered chapters, multi editions and "hidden" features)
  - multilingual
  - individual chapter management (upload and edit)
  - rating system
  - statistics
  - save the login data and automatically login
  - new chapter files generated directly out of the database
  - chapter names replace at present chapters (improved chapter naming)
  - an edition can be optionally added to existing editions
  - simple search using four selection criteria

* "chapter cutting" working on a edition with
   ordered chapters not always right

# End times produce revised for ordered chapters
  - End times are now always recalculated when activate
  - End times can not be more smaller than the start time

[von Suppé]

Hi hubblec4

Did you get my message? Can't logon to chapter database anymore. I get error:
The user or password is incorrect.
Tried to delete .ini file and do again - no luck.

Please advise?

Cheers

[hubblec4]

hi Suppé

I'm back and answered your pn.

[hubblec4]

I have not used any more DVDs for a very very long time and now had to find the DVD parser does not always work properly.

Changelog chapterEditor 

add &
fixed *
improvement #
layout change %



rev0.25
// chapterEditor
* DVD parser did not work correctly

[hubblec4]

chapterEditorCLI

You can order quickly and easily chapter files from the database or from Blu-Ray's / DVD's generate.
Chapter names may be using the database also generated.

Examples of the application can be found in the first post and the download.

Changelog chapterEditorCLI

add &
fixed *
improvement #



init release

chapterEditorCLI(init) help
---------------------------

-a / --anleitung  The help on german

-h / --help       Show this help

--mid             Movie ID, an integer greater then 0
                  Displays all movie information and chapters

--names           Save a simple chapter names list of a movie
                  output: a file name without an extension

--ogg             Output format: ogg-chapter.txt
                  output: a file name without an extension

--pass            your database password

--range           A Movie ID. Displays the following 200 movies

--title           Displays all movies(max: 200) with titles
                  (at least 2 characters)

--user            your database user name

--xml             Output format: matroska-xml-chapter.xml
                  output: a file name without an extension

X: / X:\          a drive

"path DVD"        a DVD path to VIDEO_TS folder
"path Blu-Ray"    a Blu-Ray path to BDMV or PLAYLIST folder

VTS_xx_0          VTS ifo file: xx = 01 .. 99
                  without the ".ifo" extension

1..99             a title number for VTS ifo file

00000..99999      a mpls file/number without the ".mpls" extension

---------------------------
Mode 1: database syntax
1-2.parameter:  --user="your name" --pass="your password"
3.parameter:    --mid= OR --range= OR --title="a title"
  If 3.parameter equal  --mid  you can enter a 4. parameter
4.parameter:    --ogg="output txt" OR --xml="output xml" OR
                --names="file path and name"

Mode 2: DVD/Blu-Ray/folder syntax
1.parameter:    Drive(X:) OR a folder path "DVD/Blu-Ray path"
*** Blu-Ray ***
2.parameter:    00000..99999
3.parameter:    --ogg="output txt" OR --xml="output xml"
  generate a chapter file with chapter names
4-6.parameters: --user="your name" --pass="your password" --mid=
*** DVD ***
2.parameter:    VTS_xx_0
3.parameter:    1..99
4.parameter:    --ogg="output txt" OR --xml="output xml"
  generate a chapter file with chapter names
5-7.parameters: --user="your name" --pass="your password" --mid=

NOTE:
File names can be empty, a default file is then created in the root directory.

[hubblec4]

It is once again time for an update.

This time I have a support for Matroska files (mka, mks, mkv, mk3d) implemented.

The first 4 format editors can load this file formats now. In OGG and XML Editor can save the chapter files directly without re-mux into a mka, mkv or mk3d file.

In the menu of the chapterEditor now there's a new "settings" menu. There, only the paths to the external programs are for the time being set.

Changelog chapterEditor 

add &
fixed *
improvement #
layout change %


rev0.26
// chapterEditor
& Matroska file support (not for the multi editions editor)
  - mkvextract.exe is required
  - mka
  - mks 
  - mkv
  - mk3d

& menu: settings 
  - Path settings to the required external tools
  - Folder can be loaded via drag&drop (no matter where you drop down) and
    these are automatically detected and assigned to the correct tool
  - MKVToolNix, there is checked on the mkvextract and mkvpropedit exe

* load of too large files let crash the Editor

// OGG Format
& Matroska file support (save as)
  - mkvpropedit.exe is required
  - mka
  - mkv
  - mk3d

// XML Format
& Matroska file support (save as)
  - mkvpropedit.exe is required
  - mka
  - mkv
  - mk3d
  - in Taginfo.xml Editor Tags can be stored in Matroska files

[hubblec4]

Please do not use the new feature: "- in Taginfo.xml Editor Tags can be stored in Matroska files" !!!

I have forgot to connect the procedure. The target Matroska file will be overwritten.
An update is coming soon.

[hubblec4]

There is again a new rev of chapterEditor.

An important bug fix for the save the tags directly in Matroska files.
Since the procedure was not connected, the Matroska files were overwritten.

Mkvinfo.exe:
with which one can now read the playing time of Matroska files and use them.(multiAVCHD or multi chapters).

Changelog chapterEditor 

add &
fixed *
improvement #
layout change %


rev0.27
// chapterEditor
* Bluray Parser: Could float-value calculations for very small "in-time" times
                 identify an incorrect start time for the first chapter.
                 The BD-clock time is used directly from now.

// Multi Chapters
& Drag&Drop support for Matroska files:
  - the playing time is then entered automatically

// XML Format
* Tagsinfo.xml save in Matroska files not working

# XML-Parser: 3 chapter-elements were missing 
              (ChapterPhysicalEquiv and ChapterTrack+ChapterTrackNumber) 

// multiAVCHD
& Thumbnail Position Generator: this is open, you can drag&drop
  Matroska files load and the playing time is automatically entered

// Multi Editions Editor
* no output of a "mmg-mux" file more when "cutting" has been disabled

# Naming audio formats
  - DTS: it lacked the kbps and kHz designation
  - DTS Master Audio: "(strange setup)" in special 7.1 channels (DTS-ES Core)

I started to program a new 6. Editor. (Thought I may have with him in this version offer but unfortunately I lack the bit time).

It is a Matroska Menu Editor:
Based on this article(101 things you never knew you could do with Matroska)
and the Matroska specs.

It was times my original goal to write a full-fledged Matroska Menu Editor, but nothing will come as no splitter offers the full Matroska support.

[hubblec4]

A new editor beholds light of the world.
Lots of improvements and some new features.

add &
fixed *
improvement #
layout change %


rev0.28
// chapterEditor
& Matroska Menu Editor

// chapter database
# The database is now always open and switches before to the XML Editor

// XML Format
* XML-Parser: If comment lines are included between editions,
  - the editions were not processed correctly
  - XML validation not working

* the function check boxes have been moved wrong in widening 
  the chapterEditor when another format-editor was active

// Multi Editions Editor
& mpls support (only drag & drop)
  - mpls files from eac3to (Blu-Ray structure) are not recognized,
     can thus nevertheless be processed

& a setting for mpls files using a m2ts multiple times 
  - use m2ts once 

* The path to a PLAYLIST folder could crash the editor

* Tags.xml: edition names appear incorrectly (UTF8)

* no ":" more in the converted audio file name

# Audio files keep in their re-converting track order
  - mmg is incorrectly constructed when before re-converting an external subtitle
    was loaded

# Default Track switch (mmg) for audio and video is now set automatically

% checkbox: "use m2ts once" insert

// Matroska Menu Editor
& input - left
  - select source folder and run, collect information
  - select a file shows the information
  - double-click on a file adds them to a selected menu edition
    is no menu editiion selected, a new menu edition is created

& prefer insert further editions
  - a menu edition that is added (double-click) is not selected,
     thus more rapidly menu editions can be inserted

& Matroska Menu (editions) - middle
  - is not an edition name is specified, the file name is used instead
  - each menu edition is later seen in the player as shown in the ListView
  - add as menu: a special menu edition which can be repeated
  - with several menu editions you may opt for a default edition
  - the menu editions can be moved by drag & drop

& Matroska files (editions and chapters) - right
  - Is the special menu edition selected, you can set how many times they repeated to 
  - selection of a Matroska file: the checkbox is ticked, the available editions
    of the file is loaded (default edition is selected) and uses the chapters.
  - files can be moved by drag & drop

[hubblec4]

Matroska Menu Editor (MME)

The new MME helping a while Matroska files (mkv, mka, mk3d) that are located in a folder and
the same specifications (number of tracks in the correct order and the same codecs for video, audio, subs) have,
to connect with each other via the menu.
In this case, no files need to be remuxed.

The whole menu system is located in the _chapters.xml and _tags.xml, which in the saving
the selected Matroska file to be written.

In a short video which will serve as a tutorial, I show how to build such a Matroska menu.
Maybe the subtitles not good to read, here you find the original srt.


First of all:
A full menu as we know it in Bluray or DVD is currently not possible.
No splitters or players offers full support Matroska.

To use the Matroska menu requires you LAV Filters or the Haali Media Splitter.
There are in the current LAV Filters (0.63) even a tiny error. Then the menu does not work properly when Matroska files
were cut and the first frame have no IDR-frame. With Haali works but.
You can at any time download the latest nightly build of LAV Filters, there the problem is solved.

In both splitters the menu located in the system tray icon and is activated with a right click.
In MPC-HC you can right-click the screen -> filters -> LAV Splitter -> also access it.

The Matroska files must be identical in certain things. Number of tracks and the same codecs.
When I created the video tutorial, I noticed that the sound settings do not necessarily have to be equal.

So yes codec the same, but, I had a 2.0 Stereo Flac in the menu file and a 5.1 Flac used in the episodes.
It does everything without problems, and in AC3Filter you can see well that Flac is played.

In the MME, it is possible to use existing editions / chapters of the charged Matroska files.
Therefore, the menu always in a separate menu file should be stored (in the same folder).
To ensure that all Matroska files remain in the original condition and are still single playable (without menu).


How does the whole:

You have to know that each Matroska file has a SegmentUID (SUID).
LAV and Haali Splitter search for these SUID's within a folder.
With a chapter.xml and tag.xml you can on this SUID's access and process according to Matroska specs.

Currently I have two procedures known how to do it.

1. File Segment linking

This is the far most common and best known method.
In MKVToolNix (mmg) in the Global window there is a field for file / segment linking.
(Problem here is that the mux always new SUID's for the files are created and then not
longer match the entered SUID's.)

Personally, I find this method quite cumbersome.
First you have to manually determine the SUID's. This helps a header editor in the mmg.
Then all SUID's have to be entered in the correct order (PrevSUID and NextSUID).
But the biggest disadvantage is then the management of associated files.
If a series always has this "middle part" in it in the episodes.
The files should be divided up as follows.

Episode1_Start.mkv
Episode1_Rest.mkv
Episode2_Start.mkv
Episode2_Rest.mkv
and so on ... and
Middle_Part.mkv

Quickly you realize that you always have two files per episode.


2. Chapter Segment linking

In chapter.xml there is a "ChapterAtom" in which you can specify a SUID.
The chapter.xml must "ordered chapters" be constructed. Thus, one can refer to another file and play it.

The whole is done by the MME automatically. Manually, you can do that but also quite fast.
You only have a chapter.xml and Tags.xml created the in the XML editor and save it into a Matroska file.

For the above example, the folder with the files would look like this

Episode1.mkv
Episode2.mkv
and so on ... and
Middle_Part.mkv



What makes the MME

All SUID's are determined and depending on how one wants to build his own personal menu, processed.

In the middle part of the MME's the menu editions are created and managed. The order and labels
are reproduced in Matroska menu. Each menu edition can contain multiple files.

A special menu edition ("as menu") currently serves as a substitute for a Bluray / DVD menu, which is repeated again and again.
The default edition is started with the play. It must not necessarily start menu
are, you can also can start as a menu edition that includes all the episodes.

Another important function is the takeover of available editions/chapters of a file.
The episodes of the tutorial-video all have two editions. One with and one without the opening credits.
I created a menu edition with all episodes where I just want to see only the " without the opening credits editions".

If a file already have a chapters-segment linking, this will be recognized and taken over.
This case remain already created connections exist (middle part).


Creating a small menu-file


Simply load one of the episodes in mmg and the Global window for splitting - select split by time stamps.

Enter the timestamp 00:00:00.001
(of course very many files would be generated. So limit the number or quickly press cancel)
Mkvmerge then cuts directly after the first I-frame and you have a very very tiny but fully functional menu file.
The good is also the same, that all tracks and codecs match.


in the future (if I have time)

The created the menu editions automate.
The Haali function "TRACKSETEX" - A function with which you can directly select tracks in the file.
Nev asking whether he can install the Haali function in LAV Splitter.
Nev asking if he can add more Matroska features.

[hubblec4]

An important bugfix and new features are included in the update rev0.29.

New cut mode:

In mmg there is at "split mode" a function, that you can direct part "splitting" and add the same directly together.
I have added this function to Multi Edition Editor's Cutting mode.
However, be aware that the cutting times alternately entered as the start time and end time.
A complete "cut" always consists of start and end time. Are there no (last) end time, the playing time of all m2ts files is used.
This saves the additional muxing process.


edition ordered:

Menu mpls files that work with duplicate m2ts files obtained with activated checkbox an "ordered" chapters.xml.
The original chapter marks are processed as long as the playing time of the m2ts files used is.
Otherwise, a normal chapter.xml is created. The original chapter are complete used.
There are, however, not all chapter marks to function duly.

Changelog chapterEditor 

added &
fixed *
improvement #
layout change %


rev0.29
// XML Format
* The new calculation for the end times at ordered chapters
  now no longer executed when switching between an edition with or without
  ordered chapters.
  - last end time is no longer overwritten

// Multi Editions Editor
& Predefined track names and eac3to options
  - personal favorites
  - saves me the continual enter of the selfsame designations
  - Open it: Double-click on a track or a click
                on the lable - track name or eac3to option
  - Selection: click on a designation

& cutting and muxing together: new cutting mode
  - only one direct remux (Bluray) required  
  - the cutting times are then alternating between start time and
    end time specified
  - last end time can be omitted. The duration of the file
    is then used as the last end time.

& edition ordered
  - if there is only one edition, this can be with or without ordered chapters
    be created
  - when duplicate m2ts were removed, thus an appropriate
    chapters.xml created

# use m2ts once: 
  - adjusted for mpls files which use several different m2ts
  - all duplicate m2ts files are only used once 

% "cutting"- checkbox replaced by a combobox

% added a checkbox "edition ordered"

[Boardlord]

Hi hubblec4,

this a great program! Would you consider adding .cue file support too (chapter --> cue conversion)? This would help those immensely, who like to convert their music DVD/BD to audio only, and listen to it on a portable music player. Thanks for considering!

[hubblec4]

hi Boardlord

I am currently not familiar with the .cue format. If you can send me a few examples, that would be very helpful.

The result should be a .cue-file? (For example, you create chapters in the XML-Format-Editor and save it as .cue-file. thats right?)

[hubblec4]

on it goes with a new update rev0.30

Haali 's TRACKSETEX is a new editor with which you can load predefined track settings on Matroska Menu (initially only for the Haali splitter).

For the MME now "automated tasks" there, thus you can create Matroska menus with a few clicks.

Changelog chapterEditor 

added &
fixed *
improvement #
layout change %


rev0.30
// chapterEditor
& Haali's TRACKSETEX

% inserted small icons in some places

// Haali's TRACKSETEX
& Matroska Support: direct load and save Trackset's

& Track number instead of UID
  - for video, audio and subtitles
  - it is easier to work with track numbers
 
& Track number starts at 1 instead of 0
  - the track number is an index, which usually starts at 0
  - when ticking, the track numbers (#) are increased in all Trackset's by 1

& TRACKSETEX for XML-, Multi-Editions- and Matroska Menu Editor
  - open TRACKSETEX from the respective editor
  - the UID's of all existing editions are transmitted
  - first apply, and then in respective editor save the Trackset's in a Tags or Matroska file 
  - additional storage for each editor separately adjustable
  - "Exit" disables additional storage for the appropriate editor
  - TRACKSETEX close with the "small x-button" don't changes the additional storing

& TrackSet's can be moved by drag and drop.

// XML Format
* delete chapters or editions did not work correctly if 10 editions or more exists
  - completely new and faster procedure 
  - editions are renumbered 

// Multi Editions Editor
* cutting and muxing together:
  - maximum cutting time adjusted (total playing time)
  - adjusted error message
  - Was there only one start time, was missing in the cutting code the end time 
    (total playing time).  

// Matroska Menu
& automated tasks
  - 1. for each Matroska file create an edition
  - 2. create an edition with all Matroska files
  - there is no special menu created edition (which you should do first manually)
  - if no source file is selected, all files are used
  - is a source file is selected it and all subsequent files will be used

* when a menu edition is deleted, the latest standard edition has not been removed

[hubblec4]

A major update rev0.31 is available.

A few mistakes have been corrected and added new features.

There is also a new editor.

DVD2mkv:

I got a few series that "unfortunately" are only on DVD.
After I looked around what is available there,

I found that only what is really good, MakeMKV is. Clear in Germany illegal:-)
It's quite handy as MakeMKV each title changes to mkv's.

Nevertheless, it is automatic too much for me and I would have to continue editing the mkv.
So i decided to make an own DVD2mkv editor.

I have then looked more closely to IFOEdit and extended my DVD parser, so that
the IFO's be analyzed quickly.

to demux the vobs
PgcDemuxMod is used. The link leads to version: mod2
For me, the mod3 not running due to a missing dll.

here the mod3 version

It may happen that PgcDemuxMod subtitles twice extracted, which is not a bug per se.
Then, the subtitles can be displayed in different formats.
Possible values are: 4:3 , wide , letterboxed , pan-scan

There are both extracted sup files in the track display loaded and you can then choose yourself
which you will use.

BDSup2Sub: when demuxing the subtitles are extracted in sup format. mmg/mkv can load idx/sub
format only.

Therefore, the conversion is required if you want to use subtitles.
This is very very fast and in addition will search for "forced" subs.

I initially installed the BDSup2Sub++1.0.2_win32.exe
for this. If someone has not installed Java, it still works.
The Java version, I might even install as an alternative. (Since there are also 2 different versions.)


In the settings there are now two new paths for the two tools.
In addition, you can set some parameters to the tools.

download chapterEditor(rev0.31)

Changelog chapterEditor 

added &
fixed *
improvement #
layout change %


rev0.31
// chapterEditor
& DVD2mkv Editor

* 2 small errors in the INI file

* BluRay Parser: 
  - If there are multiple PlayItems and they have different byte lengths,
    wrong times were determined

// settings
& Tools - settings for the external tools
  - paths - general for all external tools
  - DGIndexNV - parameter
  - PgcDemuxMod - parameter 
 
// Haali's TRACKSETEX
& drag&drop support (Matroska files + Tags.xml)

* Error analysis showed false messages when invalid files have been loaded

// XML Format
* the root node in the TreeView is now selected if no other node was selected
  - thus there is no longer crashes for some functions
  - source code slightly adjusted and improved

# XML Parser: if the language tag (ChapterLanguage) is present but empty,
              then "Undetermined" is used as default

// Multi Editions Editor
& eac3to: PCM/WAV Audio support

* adjusted maximum cutting time for the two cut methods

* eac3to track number was not correct, if there is no chapter in the mpls

# cutting times, mux-parts and mux-playing-time are specified with nanosecond
  - "cutting and muxing together" works then 100% exactly
     for automatic recalculation of chapter marks in the mmg

# DGIndexNV - DGI file:
  - The .dgi file is loaded automatically after it is created.
  - The keyframe time stamps are output with nanosecond

# Chapter.xml: hidden chapters get now also a language

% Cutting: DGIndexNV folder selection removed

// DVD2mkv
  - required:
    PgcDemuxMod(from version 2) 
    BDSup2Sub++1.0.2_win32 (initially only the Windows version)
    MKVToolNix
  - optional: DGIndexNV (for the keyframes)
  - load a dvd drive, a folder with IFO files or IFO itself
  - listing available IFO's / titles and tracks information
  - tracks can be edit: language, compression, default track, track name
  - track order can also be moved by drag and drop again
  - cutting and muxing with the 2 mmg cut methods
  - easy and fast converting DVD-sup's into idx / sub format
    when activating the checkbox
  - automatic search for "forced" subtitles
  - drag&drop: Before you have pressed "Start" is dropped to the input,
    then to the output.
  - Haali's TRACKSETEX
  - personal favorites for the track name: Double-clicking on a track or
    a click on the lable "track name"
  - cutting - DGIndexNV - .dgi file is loaded automatically

[Jim_Pansen]

Would it make sense to have a function to recalculate chapter time codes for speed changed clips?
E.g. if you want make a PAL DVD of a 24p BD you have to recalculate chapters to the new time base.

Thanks for thinking about that

Jim