100 virtual water fountains (Blender particle systems) in the middle of a virtual water pool are being controlled by depth-map (black/white-video) in their height. Every fountain is lit by a virtual RGB_LED (Blender spotlights), which are controlled by colour map (colour video) in colour and brightness.
Blender runs a Server in Python and is being controlled by a client program written in Java in order to control 3D animations per video.
Difficulties came up when I tried integrating a TCP server, which controls parameters and viewport of blender, into Blender, running stable in a seperate thread of Blender Python runtime. The server crashed a lot.
So, the experiment was a success in that I now know what is possible in this regard.
Documentation about the difficulties of multi-threading in Blender