forked from bartvdbraak/blender
4213eca5fc
2 new attributes to ImageViewport and ImageRender object:
depth: set to True to retrieve the depth buffer as an array of float
(not suitable for texture source).
zbuff: set to True to retrieve the depth buffer as a grey scale pixel array
(suitable for texture source).
A new mode 'F' is added to VideoTexture.imageToArray() to allow returning the image
buffer as a one dimensional array of float. This mode should only be used to retrieve
the depth buffer of ImageViewport and ImageRender objects.
Example:
viewport = VideoTexture.ImageViewport()
viewport.depth = True
depth = VideoTexture.imageToArray(viewport,'F')
# show depth of bottom left pixel
# 1.0 = infinite, 0.0 = on near clip plane.
print(depth[0])
581 lines
12 KiB
ReStructuredText
581 lines
12 KiB
ReStructuredText
|
|
Video Texture (bge.texture)
|
|
===========================
|
|
|
|
*****
|
|
Intro
|
|
*****
|
|
|
|
The bge.texture module allows you to manipulate textures during the game.
|
|
|
|
Several sources for texture are possible: video files, image files, video capture, memory buffer, camera render or a mix of that.
|
|
|
|
The video and image files can be loaded from the internet using an URL instead of a file name.
|
|
|
|
In addition, you can apply filters on the images before sending them to the GPU, allowing video effect: blue screen, color band, gray, normal map.
|
|
|
|
bge.texture uses FFmpeg to load images and videos. All the formats and codecs that FFmpeg supports are supported by this module, including but not limited to::
|
|
|
|
* AVI
|
|
* Ogg
|
|
* Xvid
|
|
* Theora
|
|
* dv1394 camera
|
|
* video4linux capture card (this includes many webcams)
|
|
* videoForWindows capture card (this includes many webcams)
|
|
* JPG
|
|
|
|
The principle is simple: first you identify a texture on an existing object using
|
|
the :materialID: function, then you create a new texture with dynamic content
|
|
and swap the two textures in the GPU.
|
|
|
|
The GE is not aware of the substitution and continues to display the object as always,
|
|
except that you are now in control of the texture.
|
|
|
|
When the texture object is deleted, the new texture is deleted and the old texture restored.
|
|
|
|
.. module:: bge.texture
|
|
|
|
.. literalinclude:: ../examples/bge.texture.py
|
|
:language: rest
|
|
:lines: 2-4
|
|
|
|
.. literalinclude:: ../examples/bge.texture.py
|
|
:lines: 6-
|
|
|
|
.. literalinclude:: ../examples/bge.texture.1.py
|
|
:language: rest
|
|
:lines: 2-6
|
|
|
|
.. literalinclude:: ../examples/bge.texture.1.py
|
|
:lines: 8-
|
|
|
|
.. class:: VideoFFmpeg(file [, capture=-1, rate=25.0, width=0, height=0])
|
|
|
|
FFmpeg video source
|
|
|
|
.. attribute:: status
|
|
|
|
video status
|
|
|
|
.. attribute:: range
|
|
|
|
replay range
|
|
|
|
.. attribute:: repeat
|
|
|
|
repeat count, -1 for infinite repeat
|
|
|
|
:type: int
|
|
|
|
.. attribute:: framerate
|
|
|
|
frame rate
|
|
|
|
:type: float
|
|
|
|
.. attribute:: valid
|
|
|
|
Tells if an image is available
|
|
|
|
:type: bool
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: preseek
|
|
|
|
number of frames of preseek
|
|
|
|
:type: int
|
|
|
|
.. attribute:: deinterlace
|
|
|
|
deinterlace image
|
|
|
|
:type: bool
|
|
|
|
.. method:: play()
|
|
|
|
Play (restart) video
|
|
|
|
.. method:: pause()
|
|
|
|
pause video
|
|
|
|
.. method:: stop()
|
|
|
|
stop video (play will replay it from start)
|
|
|
|
.. method:: refresh()
|
|
|
|
Refresh video - get its status
|
|
|
|
.. class:: ImageFFmpeg(file)
|
|
|
|
FFmpeg image source
|
|
|
|
.. attribute:: status
|
|
|
|
video status
|
|
|
|
.. attribute:: valid
|
|
|
|
Tells if an image is available
|
|
|
|
:type: bool
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. method:: refresh()
|
|
|
|
Refresh image, i.e. load it
|
|
|
|
.. method:: reload([newname])
|
|
|
|
Reload image, i.e. reopen it
|
|
|
|
.. class:: ImageBuff()
|
|
|
|
Image source from image buffer
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. method:: load(imageBuffer, width, height)
|
|
|
|
Load image from buffer
|
|
|
|
.. method:: plot(imageBuffer, width, height, positionX, positionY)
|
|
|
|
update image buffer
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: valid
|
|
|
|
bool to tell if an image is available
|
|
|
|
.. class:: ImageMirror(scene)
|
|
|
|
Image source from mirror
|
|
|
|
.. attribute:: alpha
|
|
|
|
use alpha in texture
|
|
|
|
.. attribute:: background
|
|
|
|
background color
|
|
|
|
.. attribute:: capsize
|
|
|
|
size of render area
|
|
|
|
.. attribute:: clip
|
|
|
|
clipping distance
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. method:: refresh(imageMirror)
|
|
|
|
Refresh image - invalidate its current content
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: valid
|
|
|
|
bool to tell if an image is available
|
|
|
|
.. attribute:: whole
|
|
|
|
use whole viewport to render
|
|
|
|
.. class:: ImageMix()
|
|
|
|
Image mixer
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. method:: getSource(imageMix)
|
|
|
|
get image source
|
|
|
|
.. method:: getWeight(imageMix)
|
|
|
|
get image source weight
|
|
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. method:: refresh(imageMix)
|
|
|
|
Refresh image - invalidate its current content
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. method:: setSource(imageMix)
|
|
|
|
set image source
|
|
|
|
.. method:: setWeight(imageMix)
|
|
|
|
set image source weight
|
|
|
|
.. attribute:: valid
|
|
|
|
bool to tell if an image is available
|
|
|
|
.. class:: ImageRender(scene, camera)
|
|
|
|
Image source from render
|
|
|
|
.. attribute:: alpha
|
|
|
|
use alpha in texture
|
|
|
|
.. attribute:: background
|
|
|
|
background color
|
|
|
|
.. attribute:: capsize
|
|
|
|
size of render area
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. method:: refresh(imageRender)
|
|
|
|
Refresh image - invalidate its current content
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: valid
|
|
|
|
bool to tell if an image is available
|
|
|
|
.. attribute:: whole
|
|
|
|
use whole viewport to render
|
|
|
|
.. attribute:: depth
|
|
|
|
use depth component of render as array of float - not suitable for texture source,
|
|
should only be used with bge.texture.imageToArray(mode='F')
|
|
|
|
.. attribute:: zbuff
|
|
|
|
use depth component of render as grey scale color - suitable for texture source
|
|
|
|
.. class:: ImageViewport()
|
|
|
|
Image source from viewport
|
|
|
|
.. attribute:: alpha
|
|
|
|
use alpha in texture
|
|
|
|
.. attribute:: capsize
|
|
|
|
size of viewport area being captured
|
|
|
|
.. attribute:: filter
|
|
|
|
pixel filter
|
|
|
|
.. attribute:: flip
|
|
|
|
flip image vertically
|
|
|
|
.. attribute:: image
|
|
|
|
image data
|
|
|
|
.. attribute:: position
|
|
|
|
upper left corner of captured area
|
|
|
|
.. method:: refresh(imageViewport)
|
|
|
|
Refresh image - invalidate its current content
|
|
|
|
.. attribute:: scale
|
|
|
|
fast scale of image (near neighbour)
|
|
|
|
.. attribute:: size
|
|
|
|
image size
|
|
|
|
.. attribute:: valid
|
|
|
|
bool to tell if an image is available
|
|
|
|
.. attribute:: whole
|
|
|
|
use whole viewport to capture
|
|
|
|
.. attribute:: depth
|
|
|
|
use depth component of viewport as array of float - not suitable for texture source,
|
|
should only be used with bge.texture.imageToArray(mode='F')
|
|
|
|
.. attribute:: zbuff
|
|
|
|
use depth component of viewport as grey scale color - suitable for texture source
|
|
|
|
.. class:: Texture(gameObj)
|
|
|
|
Texture objects
|
|
|
|
.. attribute:: bindId
|
|
|
|
OpenGL Bind Name
|
|
|
|
.. method:: close(texture)
|
|
|
|
Close dynamic texture and restore original
|
|
|
|
.. attribute:: mipmap
|
|
|
|
mipmap texture
|
|
|
|
.. method:: refresh(texture)
|
|
|
|
Refresh texture from source
|
|
|
|
.. attribute:: source
|
|
|
|
source of texture
|
|
|
|
.. class:: FilterBGR24()
|
|
|
|
Source filter BGR24 objects
|
|
|
|
.. class:: FilterBlueScreen()
|
|
|
|
Filter for Blue Screen objects
|
|
|
|
.. attribute:: color
|
|
|
|
blue screen color
|
|
|
|
.. attribute:: limits
|
|
|
|
blue screen color limits
|
|
|
|
.. attribute:: previous
|
|
|
|
previous pixel filter
|
|
|
|
.. class:: FilterColor()
|
|
|
|
Filter for color calculations
|
|
|
|
.. attribute:: matrix
|
|
|
|
matrix [4][5] for color calculation
|
|
|
|
.. attribute:: previous
|
|
|
|
previous pixel filter
|
|
|
|
.. class:: FilterGray()
|
|
|
|
Filter for gray scale effect
|
|
|
|
.. attribute:: previous
|
|
|
|
previous pixel filter
|
|
|
|
.. class:: FilterLevel()
|
|
|
|
Filter for levels calculations
|
|
|
|
.. attribute:: levels
|
|
|
|
levels matrix [4] (min, max)
|
|
|
|
.. attribute:: previous
|
|
|
|
previous pixel filter
|
|
|
|
.. class:: FilterNormal()
|
|
|
|
Filter for Blue Screen objects
|
|
|
|
.. attribute:: colorIdx
|
|
|
|
index of color used to calculate normal (0 - red, 1 - green, 2 - blue)
|
|
|
|
.. attribute:: depth
|
|
|
|
depth of relief
|
|
|
|
.. attribute:: previous
|
|
|
|
previous pixel filter
|
|
|
|
.. class:: FilterRGB24()
|
|
|
|
Returns a new input filter object to be used with :class:`ImageBuff` object when the image passed
|
|
to the ImageBuff.load() function has the 3-bytes pixel format BGR.
|
|
|
|
.. class:: FilterRGBA32()
|
|
|
|
Source filter RGBA32 objects
|
|
|
|
.. function:: getLastError()
|
|
|
|
Last error that occurred in a bge.texture function.
|
|
|
|
:return: the description of the last error occurred in a bge.texture function.
|
|
:rtype: string
|
|
|
|
.. function:: imageToArray(image,mode)
|
|
|
|
Returns a :class:`~bgl.buffer` corresponding to the current image stored in a texture source object.
|
|
|
|
:arg image: Image source object.
|
|
:type image: object of type :class:`VideoFFmpeg`, :class:`ImageFFmpeg`, :class:`ImageBuff`, :class:`ImageMix`, :class:`ImageRender`, :class:`ImageMirror` or :class:`ImageViewport`
|
|
:arg mode: optional argument representing the pixel format.
|
|
You can use the characters R, G, B for the 3 color channels, A for the alpha channel,
|
|
0 to force a fixed 0 color channel and 1 to force a fixed 255 color channel.
|
|
Example: "BGR" will return 3 bytes per pixel with the Blue, Green and Red channels in that order.
|
|
"RGB1" will return 4 bytes per pixel with the Red, Green, Blue channels in that order and the alpha channel forced to 255.
|
|
A special mode "F" allows to return the image as an array of float. This mode should only be used to retrieve
|
|
the depth buffer of the ImageViewport and ImageRender object.
|
|
The default mode is "RGBA".
|
|
|
|
|
|
:type mode: string
|
|
:rtype: :class:`~bgl.buffer`
|
|
:return: A object representing the image as one dimensional array of bytes of size (pixel_size*width*height),
|
|
line by line starting from the bottom of the image. The pixel size and format is determined by the mode
|
|
parameter. For mode 'F', the array is a one dimensional array of float of size (width*height).
|
|
|
|
.. function:: materialID(object,name)
|
|
|
|
Returns a numeric value that can be used in :class:`Texture` to create a dynamic texture.
|
|
|
|
The value corresponds to an internal material number that uses the texture identified
|
|
by name. name is a string representing a texture name with IM prefix if you want to
|
|
identify the texture directly. This method works for basic tex face and for material,
|
|
provided the material has a texture channel using that particular texture in first
|
|
position of the texture stack. name can also have MA prefix if you want to identify
|
|
the texture by material. In that case the material must have a texture channel in first
|
|
position.
|
|
|
|
If the object has no material that matches name, it generates a runtime error. Use try/except to catch the exception.
|
|
|
|
Ex: bge.texture.materialID(obj, 'IMvideo.png')
|
|
|
|
:arg object: the game object that uses the texture you want to make dynamic
|
|
:type object: game object
|
|
:arg name: name of the texture/material you want to make dynamic.
|
|
:type name: string
|
|
:rtype: integer
|
|
|
|
.. function:: setLogFile(filename)
|
|
|
|
Sets the name of a text file in which runtime error messages will be written, in addition to the printing
|
|
of the messages on the Python console. Only the runtime errors specific to the VideoTexture module
|
|
are written in that file, ordinary runtime time errors are not written.
|
|
|
|
:arg filename: name of error log file
|
|
:type filename: string
|
|
:rtype: integer
|