Log in

View Full Version : MP4 convert 64-bit chunk offset atoms to 32-Bit


sdancer75
18th April 2015, 09:09
Hi,

I have an Mp4 that is bigger than 4GB. This kind of file won't play (plays for about 20 secs and then jumps to the next video) in my Panasonic vierra 42FT60 because I suspect this file uses 64-bit chunk offset atoms.

So, Is there any utility that splits that file in two smaller files that uses 32-bit chunk offsets WITHOUT re-encoding ? Any other solution ?

Regrads,

LoRd_MuldeR
18th April 2015, 12:39
Have you tried MP4Box?

HowTo split/concatenate MP4 files with MP4Box (http://forum.doom9.org/showthread.php?t=93240)

benwaggoner
18th April 2015, 19:52
Hi,

I have an Mp4 that is bigger than 4GB. This kind of file won't play (plays for about 20 secs and then jumps to the next video) in my Panasonic vierra 42FT60 because I suspect this file uses 64-bit chunk offset atoms.

So, Is there any utility that splits that file in two smaller files that uses 32-bit chunk offsets WITHOUT re-encoding ? Any other solution ?
And it's quite possible that your file needs 64-bit offsets; most muxers only use 64-bit if 32-bit isn't big enough. You might need to reencode to something <2^32 bytes.

I've seen all kinds of odd problems with those "older" displays (four years seems like eternity in the media SoC world!). There was another one from a little earlier that had a maximum moov header size that would be violated with really long (like 4+ hours) files. The only solution that worked was to eliminate B-frames, which triggered some simpler header mode.

mp4box is excellent advice. It offers really fine-grained control, and typically muxes with less overhead than, say, ffmpeg. If it can be done through remuxing, that's your best bet.

sdancer75
19th April 2015, 13:32
Have you tried MP4Box?

HowTo split/concatenate MP4 files with MP4Box (http://forum.doom9.org/showthread.php?t=93240)

Yeah ! Splitting the file with Mp4Box worked for me thanx !!!

PS: Does Mp4Box re-allocate the chunk offsets in 32-bit in the splitting process like this ? I suspect that it will not !! Is that is true then the media player indeed supports 64bit offsets and the problem is somewhere else.

sdancer75
19th April 2015, 13:36
And it's quite possible that your file needs 64-bit offsets; most muxers only use 64-bit if 32-bit isn't big enough. You might need to reencode to something <2^32 bytes.

I've seen all kinds of odd problems with those "older" displays (four years seems like eternity in the media SoC world!). There was another one from a little earlier that had a maximum moov header size that would be violated with really long (like 4+ hours) files. The only solution that worked was to eliminate B-frames, which triggered some simpler header mode.

mp4box is excellent advice. It offers really fine-grained control, and typically muxes with less overhead than, say, ffmpeg. If it can be done through remuxing, that's your best bet.

Hi,

Mp4Box split did the job. But I am a little pissed off with panasonic that abandoned their older models without any firmware updates.

Its an expensive model and I bought it just the last year (June 2014) which means that despite the fact this is an 2013 model they still continue to shell it in Greece. They should continue their support at least for about 2 years more or else, why the heck should I pay 2 or 3 times more for a panasonic tv when I can find a plenty cheap nodels like LG's or Samsungs ?

Thanks for your help,

SeeMoreDigital
19th April 2015, 15:27
How about using a different container. Such as .mkv or .m2ts?

benwaggoner
19th April 2015, 23:54
That's the CE world for you. TV's are lucky to get firmware updates more than 18 months after releases sometimes. Particularly for non-Smart TVs



For customers they are becoming platforms, but the vendors historically they've just been products, forgotten after a new model comes out. Things are getting better, but not universally.

sdancer75
20th April 2015, 08:41
That's the CE world for you. TV's are lucky to get firmware updates more than 18 months after releases sometimes. Particularly for non-Smart TVs



For customers they are becoming platforms, but the vendors historically they've just been products, forgotten after a new model comes out. Things are getting better, but not universally.

What is the acronym CE ?

Regards,

nevcairiel
20th April 2015, 08:42
Consumer Electronics, ie. TVs, Set-Top-Boxes (STBs), and all other kind of normal playback devices you find in consumers homes.

sdancer75
20th April 2015, 08:45
For the history. While handbreak generally do the job I noticed that:

1) The 1st part for the video works like it should be.
2) The 2nd part have problems. Fast Forword have problems, does not work at all. Random errors and sometimes moves to next video.
3) I contacted with panasonic. No firmware updates and they recommended me to change container cos mp4 are generally problematics :-)

I will try another splitter or another container like mkv.

benwaggoner
20th April 2015, 18:35
For the history. While handbreak generally do the job I noticed that:

1) The 1st part for the video works like it should be.
2) The 2nd part have problems. Fast Forword have problems, does not work at all. Random errors and sometimes moves to next video.
3) I contacted with panasonic. No firmware updates and they recommended me to change container cos mp4 are generally problematics :-)

I will try another splitter or another container like mkv.
If it doesn't support large .mp4, I'd be doubtful that mkv would be well supported. Transport stream (.ts) could be your best bet. It doesn't have offsets like mp4.

sdancer75
21st April 2015, 08:46
If it doesn't support large .mp4, I'd be doubtful that mkv would be well supported. Transport stream (.ts) could be your best bet. It doesn't have offsets like mp4.

The .ts stream is the old DVD mpeg2 ?

Regards,

SeeMoreDigital
21st April 2015, 09:36
The .ts stream is the old DVD mpeg2 ?

Regards,When it comes to "old DVD" the MPEG-2 video stream is stored within the .vob container (which is a 'Program Stream' container).

The .ts (transport stream) container is most widely used for broadcasting digital television and is able to store a variety of video and audio formats, such as: AVC (MPEG-4 Part-10) video, VC-1 video, MPEG-2 video and HEVC video. Along with MP2 audio, AAC audio, AC3 audio, etc. The Blu-ray disc format uses the more robust .m2ts 'transport stream' container.

By-the-way... According to your TV user manual, it supports playback of .m2ts (and .mkv) contained files.

sdancer75
22nd April 2015, 10:04
When it comes to "old DVD" the MPEG-2 video stream is stored within the .vob container (which is a 'Program Stream' container).

The .ts (transport stream) container is most widely used for broadcasting digital television and is able to store a variety of video and audio formats, such as: AVC (MPEG-4 Part-10) video, VC-1 video, MPEG-2 video and HEVC video. Along with MP2 audio, AAC audio, AC3 audio, etc. The Blu-ray disc format uses the more robust .m2ts 'transport stream' container.

By-the-way... According to your TV user manual, it supports playback of .m2ts (and .mkv) contained files.

Thank you for your time.

My video comes from my Canon XM-1 mini DV camera. Is there any free/license app that converts that type of AVI DV files to m2ts but with an excelent quality ?

Best Regards,

SeeMoreDigital
22nd April 2015, 14:22
Thank you for your time.

My video comes from my Canon XM-1 mini DV camera. Is there any free/license app that converts that type of AVI DV files to m2ts but with an excelent quality ?

Best Regards,
Hmmm... AVI and M2TS are audio/video 'containers', not audio/video formats!

Your Canon XM-1 camcorder captures video to the 'interlaced' Digital Video (DV) format and stores it within the .avi container. So the first thing you need to do is convert your captured DV format to a new video format such as MPEG-2 or MPEG-4 AVC. And because your captured video source is 'interlaced' you also have to decide how you want to 'process' your interlaced' video.

Sufficed to say, the .m2ts container is able to store MPEG-2 or MPEG-4 AVC video regardless of your decision...

sdancer75
24th April 2015, 10:21
Hmmm... AVI and M2TS are audio/video 'containers', not audio/video formats!

Your Canon XM-1 camcorder captures video to the 'interlaced' Digital Video (DV) format and stores it within the .avi container. So the first thing you need to do is convert your captured DV format to a new video format such as MPEG-2 or MPEG-4 AVC. And because your captured video source is 'interlaced' you also have to decide how you want to 'process' your interlaced' video.

Sufficed to say, the .m2ts container is able to store MPEG-2 or MPEG-4 AVC video regardless of your decision...

Thanks for your time,

I knew that AVI/M2TS are containers. Since my TV media player does not support the AVI DV (and not only) I have to convert it. Currently I am using Mp4 codec/container but in big files I have some issues.

So, you suggest to use Mp4 compression and a m2ts container.

The question : What application should I use for that ? Handbreak for example uses only mp4 and mkv. Do you know any good app that will do the compression and package to m2ts at the same time ?

Best Regards,

SeeMoreDigital
24th April 2015, 10:43
I knew that AVI/M2TS are containers. Since my TV media player does not support the AVI DV (and not only) I have to convert it. Currently I am using Mp4 codec/container but in big files I have some issues.

So, you suggest to use Mp4 compression and a m2ts container.
I suggest you use MPEG-4 Part-10 (aka: h.264 or AVC) as your video format and either m2ts or mkv as your container formats - as your TV's manual suggests it supports both ;)

benwaggoner
24th April 2015, 17:44
I suggest you use MPEG-4 Part-10 (aka: h.264 or AVC) as your video format and either m2ts or mkv as your container formats - as your TV's manual suggests it supports both ;)
And unless you specifically shot progressive DV, you need to decide whether to deinterlace or not. Most players other than some mobile device SoCs handle interlaced very well, and that will give you the most accurate archive of your original image.

You could also deinterlace (throwing out half the temporal samples) or bob (making one frame out of each field, preserving everything but increasing decoder requirements, and requiring some relatively advanced processing for best results.

sdancer75
25th April 2015, 11:27
And unless you specifically shot progressive DV, you need to decide whether to deinterlace or not. Most players other than some mobile device SoCs handle interlaced very well, and that will give you the most accurate archive of your original image.

You could also deinterlace (throwing out half the temporal samples) or bob (making one frame out of each field, preserving everything but increasing decoder requirements, and requiring some relatively advanced processing for best results.

Hi,

I am not sure if my Canon-XM1 supports progressive DV (i just digitize my old tapes in this period of time) , so I use deInterlace by default, since my media player PC and TV uses progressive formats for viewing video and I think this is the best result I can get.

I didn't see any bob (in fast I meet this term for the first time) option in my handbreak. I will check it again !

PS:About the de-interlacing procedure..... I thought that it does not throw anything but instead it tries to re-construct the temp samples from the previous or the next image sample. Am I wrong to that ? Because if it throws samples how it keeps the constant frame rate that is about 25fps for European countries ?

Regards,

SeeMoreDigital
25th April 2015, 12:07
I am not sure if my Canon-XM1 supports progressive DV... It doesn't. It captures DV video as 'pure interlaced'.

...so I use deInterlace by default...
Yes, but there are different methods of de-interlacing. My preferred method is to convert each pure interlaced field into a progressive frame. Which as a consequence, doubles the original frame rate. Meaning an 'interlaced' 25.000 fps source becomes 'progressive' 50.000 fps encode.

There was a time when media players struggled to play 50.000 fps and 60.000 fps video but happily those days have gone :)


Cheers

sdancer75
26th April 2015, 09:41
It doesn't. It captures DV video as 'pure interlaced'.

Yes, but there are different methods of de-interlacing. My preferred method is to convert each pure interlaced field into a progressive frame. Which as a consequence, doubles the original frame rate. Meaning an 'interlaced' 25.000 fps source becomes 'progressive' 50.000 fps encode.

There was a time when media players struggled to play 50.000 fps and 60.000 fps video but happily those days have gone :)


Cheers

Thanks,

Ok I agree with the option to keep all frames but I want to be compatible with all players, like TV player, even to DVD format if I want to convert them some time in dvd discs. So I prefer to keep the original fps because I will delete the original tapes or they will be destroyed some time.

So what my needs : I need the best quality that keeps the original characteristics of the original tape and to be compatible to the most players.

The only changes I do, is deInterlacing and soft denoise (using handbreak).

SeeMoreDigital
26th April 2015, 12:13
Ok I agree with the option to keep all frames but I want to be compatible with all players, like TV player, even to DVD format if I want to convert them some time in dvd discs.
I suggest you set your player 'compatibility' sights a little higher. As A/V manufacturers are dropping the production of dedicated DVD players, fast. The Blu-ray specification offers you more video encoding options ;)

So I prefer to keep the original fps because I will delete the original tapes or they will be destroyed some time.
I suggest you keep your original tapes for as long as you possibly can.

So what my needs : I need the best quality that keeps the original characteristics of the original tape and to be compatible to the most players.
Well, if you're serious about having your encodes compatible for use with DVD players (in accordance with the DVD spec.) your hands are tied. You're going to have to use MPEG-2 (in VOB) - that's it!

sdancer75
27th April 2015, 09:19
Thank you all guys !!!

Best Regards,

foxyshadis
28th April 2015, 03:11
Along with the original tapes, which will degrade with time, it'd be a good idea to keep the originals on a hard drive; 4 terabyte drives are barely over $100 now. That way you always have a backup around in case anything happens to one or the other. After all, you don't need to do any deinterlacing at all to get XM1 content on a DVD! (Unless you want to apply post-production effects to it.) You can just encode and author.

As time goes on and more advanced deinterlacing gets faster on new CPUs, it's very handy to be able to go back to the originals for a remaster, as well. Make sure to backup any post-production projects, as well, to save some time.

sdancer75
28th April 2015, 08:26
Along with the original tapes, which will degrade with time, it'd be a good idea to keep the originals on a hard drive; 4 terabyte drives are barely over $100 now. That way you always have a backup around in case anything happens to one or the other. After all, you don't need to do any deinterlacing at all to get XM1 content on a DVD! (Unless you want to apply post-production effects to it.) You can just encode and author.

As time goes on and more advanced deinterlacing gets faster on new CPUs, it's very handy to be able to go back to the originals for a remaster, as well. Make sure to backup any post-production projects, as well, to save some time.

Yes.... you have absolutely right !!!! In the past years I deleted files cos I needed the HD space. Now I am so regret it !!!.

Regards,

benwaggoner
28th April 2015, 22:39
Along with the original tapes, which will degrade with time, it'd be a good idea to keep the originals on a hard drive; 4 terabyte drives are barely over $100 now. That way you always have a backup around in case anything happens to one or the other. After all, you don't need to do any deinterlacing at all to get XM1 content on a DVD! (Unless you want to apply post-production effects to it.) You can just encode and author.

As time goes on and more advanced deinterlacing gets faster on new CPUs, it's very handy to be able to go back to the originals for a remaster, as well. Make sure to backup any post-production projects, as well, to save some time.
Also note that DV can have a lot of padding bits, and PCM audio. You can shrink the size down some with your favorite lossless encoder (which should be 7z LZMA2, natch).

sdancer75
29th April 2015, 07:54
Also note that DV can have a lot of padding bits, and PCM audio. You can shrink the size down some with your favorite lossless encoder (which should be 7z LZMA2, natch).

Yes its a thought, but it still needs a lot of space .....
Anyway, I will keep my original tapes. You never know !

SeeMoreDigital
29th April 2015, 09:02
Yes its a thought, but it still needs a lot of space .....
From what I remember, data-wise it's around 12-13GB an hour when uncompressed. So over 70 hours can be stored on a 1TB HDD. Which is not that bad ;)

sdancer75
29th April 2015, 15:45
From what I remember, data-wise it's around 12-13GB an hour when uncompressed. So over 70 hours can be stored on a 1TB HDD. Which is not that bad ;)

You remember damn well. Its about 13GB / hour.

And.... an 1TB HD space its relatively cheap :thanks:

SeeMoreDigital
29th April 2015, 17:08
I've just remembered another reason why it's a good idea to back-up your DV+PCM.avi camcorder files to HDD's...

Some hardware players fitted with Sigma Designs A/V decoding chip-sets and many Android based media players can actually play DV+PCM.avi files :eek:

benwaggoner
1st May 2015, 17:52
I've just remembered another reason why it's a good idea to back-up your DV+PCM.avi camcorder files to HDD's...

Some hardware players fitted with Sigma Designs A/V decoding chip-sets and many Android based media players can actually play DV+PCM.avi files :eek:
But the biggest reason is that rust glued to a flexible strip of mylar doesn't have a great shelf life in typical home environments.

SeeMoreDigital
1st May 2015, 22:16
But the biggest reason is that rust glued to a flexible strip of mylar doesn't have a great shelf life in typical home environments.Digital information saved onto an analogue medium.... It's a match made in 'digital' heaven.... Where do I sign my pre-nup?