blender/source/gameengine/Ketsji
Benoit Bolsee 42557f90bd BGE performance, 3rd round: culling and rasterizer.
This commit extend the technique of dynamic linked list to the mesh
slots so as to eliminate dumb scan or map lookup. It provides massive 
performance improvement in the culling and in the rasterizer when 
the majority of objects are static.

Other improvements:
- Compute the opengl matrix only for objects that are visible.
- Simplify hash function for GEN_HasedPtr
- Scan light list instead of general object list to render shadows
- Remove redundant opengl calls to set specularity, shinyness and diffuse
  between each mesh slots.
- Cache GPU material to avoid frequent call to GPU_material_from_blender
- Only set once the fixed elements of mesh slot
- Use more inline function

The following table shows the performance increase between 2.48, 1st round
and this round of improvement. The test was done with a scene containing 
40000 objects, of which 1000 are in the view frustrum approximately. The
object are simple textured cube to make sure the GPU is not the bottleneck.
As some of the rasterizer processing time has moved under culling, I present
the sum of scenegraph(includes culling)+rasterizer time

Scenegraph+rasterizer(ms)       2.48      1st round       3rd round

All objects static,            323.0           86.0             7.2
all visible, 1000 in 
the view frustrum

All objects static,            219.0           49.7             N/A(*)
all invisible.

All objects moving,            323.0          105.6            34.7
all visible, 1000 in 
the view frustrum

Scene destruction              40min          40min              4s

(*) : this time is not representative because the frame rate was at 60fps.
      In that case, the GPU holds down the GE by frame sync. By design, the
      overhead of the rasterizer is 0 when the the objects are invisible. 

This table shows a global speed up between 9x and 45x compared to 2.48a
for scenegraph, culling and rasterizer overhead. The speed up goes much
higher when objects are invisible.

An additional 2-4x speed up is possible in the scenegraph by upgrading
the Moto library to use Eigen2 BLAS library instead of C++ classes but
the scenegraph is already so fast that it is not a priority right now.

Next speed up in logic: many things to do there...
2009-05-07 09:13:01 +00:00
..
KXNetwork ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
BL_BlenderShader.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
BL_BlenderShader.h BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
BL_Material.cpp BGE: speed up mesh conversion by avoiding allocation/deallocation of material object on each face. The speed up is minor on optimized builds but considerable on less optimized builds, good for debugging large scene. 2009-04-29 10:06:38 +00:00
BL_Material.h BGE: speed up mesh conversion by avoiding allocation/deallocation of material object on each face. The speed up is minor on optimized builds but considerable on less optimized builds, good for debugging large scene. 2009-04-29 10:06:38 +00:00
BL_Shader.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
BL_Shader.h BGE Python API 2009-04-20 23:17:52 +00:00
BL_Texture.cpp BGE Python API 2009-02-19 13:42:07 +00:00
BL_Texture.h Preparation to VideoTexture: everything but the VideoTexture module itself. 2008-10-31 21:06:48 +00:00
CMakeLists.txt added Geometry as a BGE module, removed its dependency on gen_utils.c 2009-04-30 12:45:13 +00:00
KX_BlenderMaterial.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_BlenderMaterial.h BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_BulletPhysicsController.cpp BGE bug #18091: Hitbox of object X doesn't move along when object X is parented to object Y. 2009-04-30 19:00:17 +00:00
KX_BulletPhysicsController.h BGE bug #18091: Hitbox of object X doesn't move along when object X is parented to object Y. 2009-04-30 19:00:17 +00:00
KX_Camera.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_Camera.h BGE PyAPI 2009-04-28 13:11:56 +00:00
KX_CameraActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_CameraActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_CameraIpoSGController.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_CameraIpoSGController.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_CDActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_CDActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_ClientObjectInfo.h Building the game engine with Solid/Sumo is now optional for scons using WITH_BF_SOLID. 2009-02-25 12:07:51 +00:00
KX_ConstraintActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_ConstraintActuator.h BGE C++ API 2009-04-22 14:42:00 +00:00
KX_ConstraintWrapper.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_ConstraintWrapper.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_ConvertPhysicsObject.h BGE: Add soft body welding parameter to the Advanced Settings panel. The values are very small so I chose to use logarithmic scale. Should be fine, it's an advanced setting after all. 2009-04-27 16:44:02 +00:00
KX_ConvertPhysicsObjects.cpp BGE: Add soft body welding parameter to the Advanced Settings panel. The values are very small so I chose to use logarithmic scale. Should be fine, it's an advanced setting after all. 2009-04-27 16:44:02 +00:00
KX_Dome.cpp supporting warp data files with tabs instead of spaces. 2009-04-30 15:27:38 +00:00
KX_Dome.h Fix for part of bug #18496: issue with light state switching 2009-04-23 13:30:34 +00:00
KX_EmptyObject.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_EmptyObject.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_GameActuator.cpp BGE Py API patch from Mitchell Stokes, adds extra attributes and docs 2009-05-02 02:40:11 +00:00
KX_GameActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_GameObject.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_GameObject.h BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_IInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_IPhysicsController.cpp BGE patch: dynamically update the coumpound parent shape when parenting to a compound object. 2009-01-13 22:59:18 +00:00
KX_IPhysicsController.h BGE Physics 2009-04-14 12:34:39 +00:00
KX_IPO_SGController.cpp remove warnings for the BGE 2009-02-25 03:26:02 +00:00
KX_IPO_SGController.h BGE bug #17657 fixed: dRotY doesn't work properly after 90 degrees rotation. 2008-09-23 20:07:15 +00:00
KX_IpoActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_IpoActuator.h BGE C++ API 2009-04-22 14:42:00 +00:00
KX_IPOTransform.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_IScalarInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ISceneConverter.h Merge of first part of changes from the apricot branch, especially 2008-09-04 20:51:28 +00:00
KX_ISystem.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_KetsjiEngine.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_KetsjiEngine.h BGE performance: 2009-05-01 20:34:23 +00:00
KX_Light.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_Light.h Patch from Mitchell Stokes for KX_Light to use attrdef's 2009-04-21 23:15:18 +00:00
KX_LightIpoSGController.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_LightIpoSGController.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_MaterialIpoController.cpp Win64: please check my changes if you ran across them ;) But should be fine since no additional crashes were reported! 2008-08-17 17:08:00 +00:00
KX_MaterialIpoController.h BGE patch: approve patch #17312: Multiple material IPOs per mesh in BGE. 2008-07-25 13:45:57 +00:00
KX_MeshProxy.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_MeshProxy.h BGE: some more cleanup, remove useless ReplicaSetName(), move code to ProcessReplica. 2009-04-22 16:58:04 +00:00
KX_MotionState.cpp gcc wouldn't compile using a reference 2009-04-07 23:21:30 +00:00
KX_MotionState.h BGE Scenegraph and View frustrum culling improvement. 2009-04-07 22:14:06 +00:00
KX_MouseFocusSensor.cpp [#18681] Mousesensor Over doesn't work in ortho mode of 3dview camera 2009-05-06 12:45:08 +00:00
KX_MouseFocusSensor.h BGE C++ API 2009-04-22 14:42:00 +00:00
KX_NearSensor.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_NearSensor.h BGE: some more cleanup, implement proper GetReplica/ProcessReplica workflow for touch/near/radar sensor. Remove duplicated code. 2009-04-22 18:20:41 +00:00
KX_ObColorIpoSGController.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ObColorIpoSGController.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ObjectActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_ObjectActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_OdePhysicsController.cpp BGE patch: dynamically update the coumpound parent shape when parenting to a compound object. 2009-01-13 22:59:18 +00:00
KX_OdePhysicsController.h BGE: Keep Sumo and ODE in sync with Bullet at API level, fix a compilation problem in MSVC. 2009-04-14 17:22:14 +00:00
KX_OrientationInterpolator.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_OrientationInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ParentActuator.cpp BGE Py API patch from Mitchell Stokes, adds extra attributes and docs 2009-05-02 02:40:11 +00:00
KX_ParentActuator.h BGE Py API patch from Mitchell Stokes, adds extra attributes and docs 2009-05-02 02:40:11 +00:00
KX_PhysicsEngineEnums.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_PhysicsObjectWrapper.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_PhysicsObjectWrapper.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_PhysicsPropertiesobsolete.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_PolygonMaterial.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_PolygonMaterial.h BGE: speed up mesh conversion by avoiding allocation/deallocation of material object on each face. The speed up is minor on optimized builds but considerable on less optimized builds, good for debugging large scene. 2009-04-29 10:06:38 +00:00
KX_PolyProxy.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_PolyProxy.h BGE: some more cleanup, remove useless ReplicaSetName(), move code to ProcessReplica. 2009-04-22 16:58:04 +00:00
KX_PositionInterpolator.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_PositionInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_PyConstraintBinding.cpp python modules in the game engine could point to builtin modules like GameLogic that was cleared. 2009-04-29 23:39:27 +00:00
KX_PyConstraintBinding.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_PyMath.cpp [#18606] Writing to KX_GameObject.orientation causes crash 2009-04-25 07:17:36 +00:00
KX_PyMath.h BGE Python API 2009-04-20 09:13:59 +00:00
KX_PythonInit.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_PythonInit.h added Geometry as a BGE module, removed its dependency on gen_utils.c 2009-04-30 12:45:13 +00:00
KX_PythonInitTypes.cpp moved py controller functions from SCA_PythonController to SCA_IController - the base controller class so python can get the sensors & actuators from any controller (not just SCA_PythonController types) 2009-05-06 09:12:08 +00:00
KX_PythonInitTypes.h SVN maintenance. 2009-04-13 19:33:22 +00:00
KX_RadarSensor.cpp BGE Py API patch from Mitchell Stokes, add distance attribute to the radar sensor, dont use 'continue' because its a python keyword. 2009-05-02 04:53:01 +00:00
KX_RadarSensor.h BGE: some more cleanup, implement proper GetReplica/ProcessReplica workflow for touch/near/radar sensor. Remove duplicated code. 2009-04-22 18:20:41 +00:00
KX_RayCast.cpp BGE Bugfixes (mostly in the py api) 2009-04-05 14:01:49 +00:00
KX_RayCast.h BGE patch: KX_GameObject::rayCast() improvements to have X-Ray option, return true face normal and hit polygon information. 2008-08-27 19:34:19 +00:00
KX_RayEventManager.cpp BGE patch: logic optimization part 2: remove inactive sensors from logic manager. 2008-07-30 17:41:47 +00:00
KX_RayEventManager.h BGE patch: logic optimization part 2: remove inactive sensors from logic manager. 2008-07-30 17:41:47 +00:00
KX_RaySensor.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_RaySensor.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SCA_AddObjectActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_SCA_AddObjectActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SCA_DynamicActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_SCA_DynamicActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SCA_EndObjectActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_SCA_EndObjectActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SCA_ReplaceMeshActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_SCA_ReplaceMeshActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_ScalarInterpolator.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ScalarInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ScalingInterpolator.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_ScalingInterpolator.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_Scene.cpp BGE performance, 3rd round: culling and rasterizer. 2009-05-07 09:13:01 +00:00
KX_Scene.h BGE performance: second round of scenegraph improvement. 2009-05-03 22:29:00 +00:00
KX_SceneActuator.cpp fixes for bugs submitted by BGE users, fixes by myself and Mitchell Stokes 2009-05-03 09:21:58 +00:00
KX_SceneActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SG_BoneParentNodeRelationship.cpp BGE performance: second round of scenegraph improvement. 2009-05-03 22:29:00 +00:00
KX_SG_BoneParentNodeRelationship.h BGE Scenegraph and View frustrum culling improvement. 2009-04-07 22:14:06 +00:00
KX_SG_NodeRelationships.cpp BGE performance: second round of scenegraph improvement. 2009-05-03 22:29:00 +00:00
KX_SG_NodeRelationships.h BGE Scenegraph and View frustrum culling improvement. 2009-04-07 22:14:06 +00:00
KX_SoundActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_SoundActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_StateActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_StateActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_SumoPhysicsController.cpp BGE patch #18051: add localInertia attribute to GameObject. 2009-04-08 16:25:00 +00:00
KX_SumoPhysicsController.h BGE: Keep Sumo and ODE in sync with Bullet at API level, fix a compilation problem in MSVC. 2009-04-14 17:22:14 +00:00
KX_TimeCategoryLogger.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_TimeCategoryLogger.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_TimeLogger.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_TimeLogger.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_TouchEventManager.cpp BGE fix bug #17430: BGE Collide/Touch Sensor interfearing with other unrelated sensor states. The bug was introduced in the recent logic optimization patch. It only affects collision and touch sensors. The bug is fixed by keeping track of registration count. 2008-08-05 16:23:33 +00:00
KX_TouchEventManager.h BGE patch: logic optimization part 2: remove inactive sensors from logic manager. 2008-07-30 17:41:47 +00:00
KX_TouchSensor.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_TouchSensor.h BGE: some more cleanup, implement proper GetReplica/ProcessReplica workflow for touch/near/radar sensor. Remove duplicated code. 2009-04-22 18:20:41 +00:00
KX_TrackToActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_TrackToActuator.h BGE C++ API 2009-04-22 14:42:00 +00:00
KX_VehicleWrapper.cpp python3 compatibility for the BGE api, this only works with scons when WITH_BF_NOBLENDER is enabled. 2009-05-07 05:23:15 +00:00
KX_VehicleWrapper.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_VertexProxy.cpp fix for a problem with setUV2 reported by cthames on blenderartist 2009-05-03 20:47:29 +00:00
KX_VertexProxy.h BGE: some more cleanup, remove useless ReplicaSetName(), move code to ProcessReplica. 2009-04-22 16:58:04 +00:00
KX_VisibilityActuator.cpp ifdef's for future py3 support, after this adding py3 can mostly be done with defines or batch renaming funcs (with the exception of CListValue slicing) 2009-04-29 16:54:45 +00:00
KX_VisibilityActuator.h BGE Python API 2009-04-20 23:17:52 +00:00
KX_WorldInfo.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_WorldInfo.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_WorldIpoController.cpp Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
KX_WorldIpoController.h Patch from GSR that a) fixes a whole bunch of GPL/BL license 2008-04-16 22:40:48 +00:00
Makefile Merge of first part of changes from the apricot branch, especially 2008-09-04 20:51:28 +00:00
SConscript python3 compatibility for the BGE api, this only works with scons when WITH_BF_NOBLENDER is enabled. 2009-05-07 05:23:15 +00:00