OpenGl in Avisynth!

[tin3tin]

Here it's descriped how to use OpenGl in Avisynth. Youtube example here.

Unfortunately there is no downloadable plugin file, but the whole idear of adding OpenGl to Avisynth sounds great. Maybe someone with the right plugin writing skills could be inspired to take this even further?

(I know... one of these days I need to take the leap into plugin writing myself).

[Leak]

Originally Posted by tin3tin

Unfortunately there is no downloadable plugin file, but the whole idear of adding OpenGl to Avisynth sounds great. Maybe someone with the right plugin writing skills could be inspired to take this even further?

Well, OpenGL is just a rendering API that by itself doesn't do anything in particular. The blog entry lists code for an AviSynth filter to set up OpenGL to work on the frames the filter gets from AviSynth and how to return back the processed frames, but it's not doing any filtering per se - so it's just a building block, but no full filter.

np: Gold Chains & Sue Cie - Show Us Your Heart (When The World Was Our Friend)

[tin3tin]

Do you think that this is a valid/okay way to add 3D manipulation of clips in Avisynth? (I guess the glut stuff can't be included in a plugin, and it might be a bit dated?) Or do you think there are better ways?

[tin3tin]

Another interresting thing in this line of thought here.

This is a Blender 3D .py script which can make Blender 3D export to a OpenGl friendly format(For every scene exported, a corresponding .C and .H file is generated).

I imagine that this combined with the stuff above it would be possible to use Blender 3D for making 3D transitions in Avisynth.

[tin3tin]

Roy has released the sourcecode:
http://www.morethantechnical.com/200...-for-avisynth/

[tin3tin]

Roy has released the sourcecode:
http://www.morethantechnical.com/200...-for-avisynth/

I've tried several times to get this to work - but still unsuccesful. Could I get one of you C++ enlighted people to check if this code is working, and if it does give me a few pointers on how to make more 3D transitions this way in C++/Avisynth?

[Youka]

This thread is old, but maybe someone helps this.
Create this object in your plugin constructor, use InitGL at beginning of GetFrame and CloseGL at the end. Destroy object in plugin destructor.
No need for GLUT.

Works for me in my plugin avisynth + opengl + lua (similar to Overlua).

[tin3tin]

Looks very interesting, but I'm pretty ignorant when it comes to c++.

[Youka]

Originally Posted by Youka

Works for me in my plugin avisynth + opengl + lua (similar to Overlua).

See here. It's just at the beginning but enough.

[Wilbert]

Can't wait to try it out. Could you make your plugin open source so we can learn from it?

[tin3tin]

Wow, looks brilliant! This must have taken a lot of time to code! Nice examples

Is it possible to process two videoclips in the lua script - for making transitions? Or devide a clip into two clips and make a transition between them?

[Youka]

It's an avisynth plugin because it should use avs functions, like video splitting and merging, too. You can use FLuaG one time for saving video frames to .tga picture files and next round to use this pictures as video sequence or textures in another FLuaG call with another video.

[tin3tin]

I'm trying to look into the Gl functions.

Just a quick question: Is it possible to use a video as a texture on ex. a 3d box?

What do you use for testing the lua scripts(as you wrote somewhere AvsP crashes with there are errors in the Lua script)?

[Youka]

Save a video as .tga pictures and use picture-for-picture as texture for all cube sides - yes, it's possible.

For testing, i'm using AvsP but are careful. MPC hasn't this problem, because it allows error throwing during rendering too (AvsP just at the initialization of the plugin, bad programming fail).

[tin3tin]

Save a video as .tga pictures and use picture-for-picture as texture for all cube sides - yes, it's possible.

That's proberly going to take me some time to figure that stuff out. I guess it's not possible to just add the video to the memory and use it from there(would be faster)? Does this make any sense to you?(I have no clue)

Are there any tutorial/examples on that process you mention of working with video on 3d objects?

[Youka]

Originally Posted by tin3tin

I guess it's not possible to just add the video to the memory and use it from there(would be faster)?

If i would add functions for video importing, encoding, etc. i could write a complete video editing program, but FLuaG is just a video filter with a powerful graphic library.

Originally Posted by tin3tin

Does this make any sense to you?(I have no clue)

I know it. One way to write an avisynth plugin with OpenGL drawing on every frame (all in C++).
An example with the video on the cube in FLuaG:

local w, h = flGetVideoWidth(), flGetVideoHeight()	--Video resolution
local d = 150	--Cube size

--Render function
function Video_Cube(frame_i)
	--Initialize 3D room
	flInit3D(FL_ORTHO, -1000, 1000)
	
	--Just draw the front of polygons (=faster rendering)
	glEnable(GL_CULL_FACE)
	glFrontFace(GL_FRONT)
	
	--Video to texture
	glEnable(GL_TEXTURE_2D)
	local tex = glGenTextures(1)
	glBindTexture(GL_TEXTURE_2D, tex[1])
	glTexParameter(GL_TEXTURE_2D, GL_TEXTURE_MAG_FILTER, GL_LINEAR)
	glTexParameter(GL_TEXTURE_2D, GL_TEXTURE_MIN_FILTER, GL_LINEAR)
	glCopyTexImage2D(GL_TEXTURE_2D, 0, GL_RGB, 0, 0, w, h, 0)
	
	--Clear frame to black
	glClearColor(0, 0, 0, 0)
	glClear(GL_COLOR_BUFFER_BIT)
	
	--Drawing texture with full colors
	glColor(255, 255, 255, 255)
	
	--List drawing of one rectangle with video on it
	local base = glGenLists(1)
	glNewList(base, GL_COMPILE)
		glBegin(GL_QUADS)
			glTexCoord(0, 0); glVertex(-d, d)
			glTexCoord(1, 0); glVertex(d, d)
			glTexCoord(1, 1); glVertex(d, -d)
			glTexCoord(0, 1); glVertex(-d, -d)
		glEnd()
	glEndList()
	
	--Set cube rotation and position to center
	glTranslate(w/2, h/2, 0)
	glRotate(frame_i/2, 1, 1, 0)
	
	--Draw front
	glPushMatrix()
		glTranslate(0, 0, d)
		glCallList(base)
	glPopMatrix()
	
	--Draw back
	glPushMatrix()
		glTranslate(0, 0, -d)
		glRotate(180, 0, 1, 0)
		glCallList(base)
	glPopMatrix()	
	
	--Draw right side
	glPushMatrix()
		glTranslate(d, 0, 0)
		glRotate(90, 0, 1, 0)
		glCallList(base)
	glPopMatrix()	
	
	--Draw left side
	glPushMatrix()
		glTranslate(-d, 0, 0)
		glRotate(-90, 0, 1, 0)
		glCallList(base)
	glPopMatrix()	
	
	--Draw top
	glPushMatrix()
		glTranslate(0, -d, 0)
		glRotate(90, 1, 0, 0)
		glCallList(base)
	glPopMatrix()
	
	--Draw bottom
	glPushMatrix()
		glTranslate(0, d, 0)
		glRotate(-90, 1, 0, 0)
		glCallList(base)
	glPopMatrix()
	
	--Finish
	glDisable(GL_TEXTURE_2D)
	glDeleteLists(base, 1)
end

--Register render function for the whole video
Register("Video_Cube", 0, flGetVideoFrames())

Try it.

Originally Posted by tin3tin

Are there any tutorial/examples on that process you mention of working with video on 3d objects?

Decode a video into memory and load frame-per-frame as texture for an OpenGL 3D object. It's really simple.

[tin3tin]

WOW WOW WOW. That's super powerful!

Maybe I could just make two lua scripts(for transitions). Ex.
- One with the first clip processed (on one side of the box)and the rest of the image transparent.
- Process the second clip (on the other side of the box) with the rest of the image transparent.
- Then overlay those two together on a background.

[tin3tin]

Did a quick test with your Lua script and plugin in DVD slideshow GUI:
(I wish that this forum would allow posting of videos directly in the thread)
http://www.youtube.com/watch?v=ofTm1A3GNN4

[Wilbert]

@Youka,

Could you make your plugin open source so we can learn from it?

[Youka]

Comes next time.