The company, which specialises in digitally transforming film sets and has offices in the UK, Spain and Australia, believes it has created the first live VFX setup to combine game engine technology with live, high-end VFX and digital cameras to output live on-set visual effects.
Apparently the system uses a VR games engine, which combines the foreground image, the CG background, the matte and the camera tracking data and feeds it to Nuke where the final composition is output.
For the hardware keying, Blackmagic’s Ultimatte 12 is used.
A spokesperson said, “So far, we have created a great tool for pre-visualisation and real-time VFX. It allows us to record live-action foregrounds in real-time, using real props and actors, and digitally bake them within HD, 2K, 360, and 3D virtual worlds.”
“The camera tracking information is captured along with zoom and focus data, and can then be passed directly to Nuke for on-set compositing or saved to be manipulated later.”
Real-time Compositing Demo
Real-time sweeping of the virtual set