GPAC 0.2.0 out!

[bond]

There are several changes, additions and fixes in gpac 0.2.0, which make the best existing mpeg-4 systems tool even better :)

- GPAC leaves the 2D world and now also supports basic 3D rendering!
- Rendering plugins for 2D (stable) and 2D/3D via OpenGL (quite basic, under development)
- 2D and 3D renderers can now be used without recompiling
- The 3D renderer supports:
# All 2D primitives, Box/Cone/Cylinder/Sphere/IndexedFaceSet/IndexedLineSet, texture mapping and material
# Frustum culling, basic viewpoint handling.
# No lights (except headlight), no user interactions.

- basic Flash (.swf) to BT/XMT/MP4 converter
- Osmo4 is now available under linux through wxWidgets 2.5.2
- support for UTF-16 BT and XMT documents

full changelog since version 0.1.4

02/09/04: JLF: 0.2.0 release

31/08/04: JLF:
- misc fixes on 2D renderer aspect ratio
- committed Osmo4/wxWidgets version in Applications/Osmo4_wx
- fixed 3GP -> MPEG-4 emulation in rtp client (scene size was broken)
- fixed ffmpeg decoder (decoded frame size was just tooo big)
- put zoom & pan back in place in 2D render plugin
- fixed V4Studio (upgrade to wxWidgets 2.5.2)
- added basic file<->plugin association by file extension (cf doc)


22/08/04: JLF:
- removing all conflicting symbols between 2D and 3D renderers plugins (screw up the linux versions)
- committing 2D and 3D renderers
- MP4Box fixes
- updated cfg file doc man pages & makefiles

18/08/04: JLF
- preparing 0.2.0 release:
- massive re-arch of renderer(s) to be able to load at run-time either 2D or 3D renderer, instead of static linking
- fixes related to above (removed shared vars amoung new plugins and core render)
- re-organized development headers
- fixed mem leaks in PNG decoder
- MP42AVI can now dump 3D scenes

22/07/04: JLF:
- updated templates for v5 & v6. WARNING: it seems that some nodes will be removed from v5 (AFX COR) which will invalidate v6 bitstreams
- still more fixes related to scenegraph arch changes
- reworked importers & exporters
- complete regression testing done
- updated new regression test suite (no 3D yet)

07/07/04: JLF
- bug fixes in MediaControl, MediaSensor & inline scene control
- more fixes related to scenegraph arch changes
- cleanup of SWF importer:
* shape importing is OK, gradient so-so (wrong matrix mapping), no bitmap fill
* font & text OK.
* sprites should work
* sound work - sound stream not done yet
there will likely not be any new SWF feature supported, ActionScript & buttons are out of scope for GPAC.
- added swf support from MP4Box (cf -swf switch)

20/06/04: JLF
- more fixes on BIFS/XMT UTF-16 support
- fixed XMT-A syntax of script and proto SF/MFNode field
- fixed avg/max rate compute on large files for AVI and MP3 importers
- made Background2D texturing use hw blitter when possible (2D renderer only)
- fixed inline scene & segment descriptors handling
- fixed encoding of IOD extra descriptors
- configure script fixes

10/06/04: JLF:
- changed all 3D handling, encapsulating all GL calls in a single file
- moved all primitives in 3D renderer to use a single mesh object (rendering done through vertex arrays)
- added IFS, ILS, Sphere
- optimized AVI importer, fixed vbr mp3 in avi import
- changed scenegraph:
* all nodes now keep track of their parents in order to signal sub-tree changes for frustum culling
* no more "SimulationTime" used in scenegraph, using node modif flags instead
* updated 2D and 3D renderer accordingly
- added support for rectangular textures in GL (most graphic cards support this, at least on win32)
- added frustum culling
- added basic support for UTF-16 (LE and BE encoding) format for input BT and XMT
- added SFTime->SFString formating in valuator (current MPEG-4 COR)
- fixed scalable BIFS parsing (updates where by default in base layer)
- fixed nasty video reordering bug - default version currently doesn't have spatial reordering (no codecs using it)

12/05/04: JLF:
- fixed SDL plugin (openGL part) under linux / w32
- fixed makefiles for 2D and 3D
- fixed config file typo: section "System" is now more appropriately called "Systems"
- fixed BIFS decoder bug (was discarding remaining commands in an AU after a REPLACE SCENE BY NULL)

11/05/04: JLF: dev version 0.1.9
- changed source code architecture: rendering code is now in a dedicated static link outside libm4systems
- intergated draft 3D renderer:
- Most 2D features have been ported to the new renderer (missing: viewport, colorTransform and gradients)
- no user interaction, no viewpoint, no background, no lighting, NO ETC !!!!
- Box, cylinder, cone working
- texture mapping working (still images and video)
- changed video plugin API accordingly
- changed graphics API: all path handling (building & flatening , outlining & dashing) moved to authoring subproject
- changed font API: no more graphics driver used to get font outline
- cf install documentation to recompile.
- updated all node tables to COMPLETE BIFS (eg all nodes from v1 to v6)
- updated v6 template & code to final amendment version
- fixed inline scene start/stop when modifying inline URL.
- updated TODO :)

30/04/04: JLF:
- fixed JPEG/PNG import (track width and height were not set)
- DirectDraw plugin resize bug
- uploaded ultra basic SWF convertor (so that it doesn't get lost on my hard drive:)enjoy :)

[PlazzTT]

Looks good, I'd like to try it out. Is there a download link for this?

[bond]

nope, you will have to compile it yourself or ask someone who compiled some older versions if he/she might compile it for you

[BoNz1]

Originally posted by bond

- Rendering plugins for 2D (stable) and 2D/3D via OpenGL (quite basic, under development)


Does this mean that we can now enjoy mpeg4 systems content in any player that has a mp4 splitter that can handle this content?

[LigH]

At least, a link to the project page would have been nice:

http://gpac.sourceforge.net/

Now we hope for any binary distributors being listed here soon ... :sly:

[ac-chan123]

LigH, inthe german doom9 you have more than 10.000 post and here is it 666. Satan, Teufel weiche von mir. ;-)

[bond]

Originally posted by BoNz1
Does this mean that we can now enjoy mpeg4 systems content in any player that has a mp4 splitter that can handle this content?hm, what makes you think so?

[Wedgedkc]

please someone who compiled some older versions, compile new binaries for me. thanks in advance.

[tripnotik]

Originally posted by Wedgedkc
please someone who compiled some older versions, compile new binaries for me. thanks in advance.
While I didn't compile some older version, you can find the binary I made there: http://pages.videotron.com/ericc/MP4Box_0.2.0.zip

[yaz]

@tripnotic
a big thx 4u ! (pls, note that msvc support is needed)
thx
y

[tripnotik]

I just updated the link above with a statically linked version so that it won't complain that msvcr71.dll is not found.

[bond]

thx :)

[Phobos]

thnx a lot

[celtic_druid]

So everyone is only interested in MP4Box? Because I managed to compile most of the plugins, Osmo4, MP42AVI, MP4Client, etc.

[yaz]

Originally posted by celtic_druid
So everyone is only interested in MP4Box? Because I managed to compile most of the plugins, Osmo4, MP42AVI, MP4Client, etc. u're the man ! i'd be pleased if u made them avilable. (they're not on your site, just checked)
thx
y

[gotaserena]

hei, celtic_druid, are you using mingw? Are you having any trouble compiling dx_hw.dll? I'm trying to get Osmo4 to compile but I'm always stuck in some way or another on the use of the directx libraries.

I've got a good heart to supply binaries to the community, once I get past these problems...

[pogo stick]

Thanks Jean Le Feuvre for new version. (If he reading this.)
And thanks Tripnotik for compiling.

Does anyone know if new Osmo4 player have any fixes with 5.1 AAC playback? That's what I am especially looking forward to.

[Phobos]

Originally posted by celtic_druid
So everyone is only interested in MP4Box? Because I managed to compile most of the plugins, Osmo4, MP42AVI, MP4Client, etc.

hey man, id be glad to get osmo4, would you post a link to it pls?

[celtic_druid]

I used MSVC, ICL and mingw/gcc. I will build the NSIS installer and post it later. Maybe without the opendivx plugin.

[gotaserena]

Well, thanks in advance!

And since you are also using mingw... May I bother you with one question? I've managed to compile the applications (sans Osmo4) and the plugins (sans render3d.dll) here, but now after installing wxWidgets the strangest thing happened make now gives the error:

chain.c:25:27: gpac/m4_tools.h: No such file or directory

which is obviously baloney. I tried to change the path in chain.c, check the path in configure and config.mak, to no avail. You know how to fix this, please let me know.

[yaz]

@celtic_druid
many thx 4u !

just checked and ... still no ac3/aac & raw mp4v support :-( the readings suggest mp4creator. not a reliable 'creator', afaik. hmmm ... should do further tests.
anyway, thx again
y

[bond]

yummie, seems there now is basic h.264/avc support in gpac (i assume its not finished till now, but great that jean is working on it :) )

Originally posted by yaz
still no ac3/aac & raw mp4v support :-( the readings suggest mp4creator. not a reliable 'creator', afaik.hm, i wouldnt wait for an ac3-to-mp4 importer, ac3 is not a mpeg technology

about aac-to-mp4 importing: it should prefectly work with mp4creator already

about raw mp4v to mp4: i dont really know how you can produce a raw mpeg-4 asp stream? as good as all normal tools automatically wrap the video stream into a container

[celtic_druid]

XviD's encraw outputs raw m4v streams. Also Skal's commandline encoder to if I recall correctly. Then again you can always use XviD's VFW encoder or Skal's via ffdshow or both with say mencoder.

[pogo stick]

Thanks for compiling, Celtic_druid!

Unfortunately, 5.1 AAC in Osmo4 is still not working right. :(
Originally posted by bond
yummie, seems there now is basic h.264/avc support in gpac (i assume its not finished till now, but great that jean is working on it :) )
H.264 support will be more that great! I checked importing of H.264/AVI produced with FFDShow and VDub. Don’t work yet.

Also merging video with multiple audio files is still missing.
And there is something wrong with mono mp3 importing. It sounds double fast.

[bond]

Originally posted by pogo stick
And there is something wrong with mono mp3 importing. It sounds double fast.would be great if you make a bug report on this on sourceforge :)

[pogo stick]

New dev version 0.2.1 with changes from 20/09/04 that Celtic Druid compiled have no problems with 5.1 AAC playback! :)
Changes since 0.2.0 :

20/09/04: JLF:
- added ElevationGrid, Extrusion, VisibilitySensor, LOD support
- added Sound support (stereo spatializer only) and reworked generic audio renderer for Sound/Sound2D support
- added V5 animators (not complete)
- reworked hardcoded proto mechanism - some doc to come soon
- added hardcoded proto PathExtrusion for any 2D shape extrusion except Bitmap and PointSet2D - eg EXTRUDED TEXT SUPPORT :)
- fixed Win32 large file support in GPAC, needs testing of AVI importer...
- cleaned up multichannel support, fixed faad channel reordering

14/09/04: JLF:
- added background support: sky & ground dome, cube image (6 sides)
- fixed bug on dynamic OD with Background / Background2D

13/09/04: JLF:
- misc fixes in pixelMetrics/meterMetrics in 3D renderer
- added navigation support (WALK/FLY/EXAMINE/ + extra modes a la blaxxun) and user selection in Osmo4/wxOsmo4 and MP4Client
- added animation between viewpoints
- fixed handling of empty boundable stacks (according to VRML): no more default backColor, and real 3D scenes (top=Group or Layer3D) no longer may use orthographic projections
- added normal smoothing for IFS.
- added full lighting support (spot, point and directional)
- added fog and billboard support.
- added basic AVC support in MP4 (only AVCSampleEntry and child atoms)
- full VRML/MPEG-4 interaction sensor support (added ProximitySensor, SphereSensor, PlaneSensor and CylinderSensors). still some work to do on TouchSensor hitNormal & hitTex
- fixed de/encoding of SFNode fields in SFScript (only USE was supported)

08/09/04: JLF:
- fixes in SWF parser: PlaceObject2 and defineShape2.NewStyle bugs, support for soundStream
- added user interaction in 3D renderer (ray casting) in both ortho and projection modes
- frustum is now only recomputed when change in size or viewpoint
- fixed viewpoint in transform handling
- added viewport/viewpoint selection to osmo4/wxOsmo4 GUIs
- fixes of BT parser for VRML support (uncompressed .WRL should now be imported fine)

But strange that both 0.2.0 and dev 0.2.1 versions don't play Bond's "Star Wars" menus sample.:confused:
Osmo4 says:
Decoding Error: Invalid BIFS Node

[pogo stick]

Hello, Celtic Druid!
There is something wrong with javascript support on your compiles or maybe it's something else that I am not aware of. Can you, please, look here (http://forum.doom9.org/showthread.php?threadid=66583&perpage=20&pagenumber=3)?

To everyone who is using Osmo4:
How fluent playback is? I have jerky playback no matter what mp4 I load. CPU usage is low. Audio+video files are jerkier than just video. Am I only one having this problem?

[celtic_druid]

Recompiled js32.dll and updated the 0.2.0 setup.

[Phobos]

Originally posted by celtic_druid
Recompiled js32.dll and updated the 0.2.0 setup.

where can i get it?

[Sharktooth]

http://celticdruid.no-ip.com/xvid/gpac/

[Drachir]

Originally posted by pogo stick

How fluent playback is? I have jerky playback no matter what mp4 I load. CPU usage is low. Audio+video files are jerkier than just video. Am I only one having this problem?

Try if this help a bit: View -> Options -> Media Decoders -> set "Prefered Video Plugin" to "FFmpeg Decoder"

[pogo stick]

Originally posted by celtic_druid
Recompiled js32.dll and updated the 0.2.0 setup.
Thanks!
Originally posted by Drachir
Try if this help a bit: View -> Options -> Media Decoders -> set "Prefered Video Plugin" to "FFmpeg Decoder"
It's not helping. All the same. :(
Does it work for you?

[bond]

osmo4 has problems with some audiocards (like in my case) leading to cracking audio. it might help to play around with the audio settings

[gotaserena]

bond, I've read somewhere that you know of a way of changing PAR of a mp4 file using MP4Box and BT scripting.

I'm currently performing a (anamorphic) backup in linux, and foolishly forgot to pass along the PAR info through mencoder, it would be very useful to know how to do it via MP4Box or any other tool I can use under linux.

Cheers!

[pogo stick]

It's possible using 'Transform2D.scale' in script, but you will have to use system player (Osmo4) to play it with right AR.
I don't know about Linux, but:
Also you can change PAR in bitstream with Moitah's MPEG4Modifier, but then you will have to convert mp4 to avi and back again after changing PAR. And Osmo4 is not using AR info from bitstream.

[pogo stick]

By the way,
I am new to mencoder.
Does it produce mp4 files?
I think not, but... :confused:
I didn't find anything about it on it's site.

[yaz]

Originally posted by pogo stick
... mencoder ... Does it produce mp4 files? ... I didn't find anything about it on it's site. it does not produce mp4. by default it writes to avi. u can specify also some tags (4cc, info-header, par, ...) there' some beta code for using different forms (manpage):
-of <format> (BETA CODE!)
Encode to the specified container format (default: AVI).
NOTE: Use -of help to get a list of available container
formats.
EXAMPLE:
-of avi Encode to AVI.
-of mpeg Encode to MPEG.
-of rawvideo raw video stream (no muxing - one video
stream only)

[gotaserena]

I had no trouble at all using MP4Box to mux .mp4s in linux. Even the picky bits like PAR and 5.1 AAC audio went well with my (also picky) Xcard.

And command pipes are bliss... I´m thinking seriously about migrating off of win...

[bond]

Originally posted by gotaserena
bond, I've read somewhere that you know of a way of changing PAR of a mp4 file using MP4Box and BT scripting.its indeed possible, as pogo stick pointed out and you need to use a systems capable decoder to have the right ar during playback (and afaik the one from gpac is the only one currently available on linux)

the other possibility (as i pointed out in my faq) is to change the ar on the bitstream itself (i dunno what/if tools exist on linux that can do this), but on windows it can be done with mpeg4modifier for example on existing streams
still of course the player would also have to be able to readout the ar flag on the bitstream during playback, as afaik its not mandatory to support this in the mpeg-4 standard

[gotaserena]

Well, thanks to both of you (sorry pogo_stick for not answering this before). Since I cannot compile MPEG4Modifier in linux, I do not know of any way of doing this.

I have still to try running the binary under wine, but I wish that Moitah hasn't discontinued the command-line version.

Oh well, too late now. Accepting a gift and all that...

[bond]

Originally posted by gotaserena
I have still to try running the binary under wine, but I wish that Moitah hasn't discontinued the command-line version.hm afaik the commandline version should do everything already, still its based on m$'s .net stuff you will have to install to run the tool on windows

[Drachir]

@gotaserena

You could try if MPEG4Modifier work with mono (http://www.mono-project.com/about/index.html).

I don't know how much mono has grown - try it.

[gotaserena]

I just tried it, and it doesn't. If I understood any C# I could try to compile the source, but alas, I don't...

[gotaserena]

By the way, does anybody know if MP4Box (or mp4creator) has an option to set the audio delay when muxing? From the looks of it one can do this using .bt scripting but there ought to be an easy switch in the -merge option.

[pogo stick]

GPAC 0.2.1 is out (http://sourceforge.net/forum/forum.php?forum_id=415146)
Lots of new things in this release, most importantly:
* supports for BT/XMT/WRL (and even basic SWF) in the players
* more and more features in 3D renderer (supports all common nodes between MPEG4 & VRML97, plus some more MPEG4 goodies such as layers & composite textures)
* and the usual fixes (MP4Box >2GB file support, new faster & lighter use of ECMAScript, etc..)

And of course the regressions tests have been updated for more 3D fun.

Enjoy.

Originally posted by gotaserena
By the way, does anybody know if MP4Box (or mp4creator) has an option to set the audio delay when muxing?
As far as I know, it is possible using 3ivx muxer and Stream shifter (http://www.trombettworks.com/StreamShifter100Beta.zip).
I usually use BeSweet for AAC encoding and there is delay option -ota( -d ).
But I guess it's not for Linux.

It's also my 200-th post. :)

[gotaserena]

Congrats, pogo stick.

As far as I could tell, there is a way using .bt language, and apparently you don't need Osmo to play the resulting file correctly.

Basically it's a hack from bond's subtitle script (sorry bond). You have to add the command "startTime" in the streams options:


ObjectDescriptor {
objectDescriptorID 20
esDescr [
ES_Descriptor {
ES_ID 2
muxInfo MuxInfo {
fileName "audio.mp4#1"
# the audio track number in audio-only mp4 files is as good as always #1!
# fileName "audio.mp3"
# fileName "audio.avi#audio"
startTime 80
}
}
]
}

will start the audio track 80ms after the video track.

I did not try negative starttimes. However one can get the same effect by delaying the video track, since mp4s usually syncro all tracks wrt track ID 1.

I'll agree it's not the as simple as setting the proper filter configuration in graphedit but it's a way of do things.

[Drachir]

Originally posted by gotaserena
I did not try negative starttimes. However one can get the same effect by delaying the video track, since mp4s usually syncro all tracks wrt track ID 1.
[/B]

All tracks with the same "OCR_ES_ID"(ObjectDescriptor) will be in sync.

[bond]

Originally posted by gotaserena
Basically it's a hack from bond's subtitle script (sorry bond).no need to sy sorry, its cool if people find my stuff usefull, thats why is released them :)

[gotaserena]

Originally posted by pogo stick
GPAC 0.2.1 is out (http://sourceforge.net/forum/forum.php?forum_id=415146)

By the way two project files seems to be missing from the tar ball.
SVGCodeGen.dsp and svg_loader.dsp. Without those I can't compile in msvc.

Compilation of mp4box (and plugins) in mingw still works, though.

[neo75903]

any binaries available for version 0.21?