Production agency and creative studio Papertown specialises in computer graphics (CGI). Its client, Business Made Simple, a management coaching organisation in North America, had the concept of a management training course based on an analogy suggesting that every business should run like an airplane. Consequently, a plane in a hangar was chosen for the video concept.
Renting and preparing an aircraft for a shoot inside a hangar would have been expensive and impractical. Instead, Papertown proposed shooting the speaker against a green screen and creating the plane, hangar and other items in CGI. They hired Mo-Sys Onset VP Services for expertise and advice on the challenges involved in virtual production.
Virtual Production Studio
Shortly before this project got underway, Mo-Sys Engineering had opened an office in LA specialising in virtual production services as out-sourced support for production companies new to virtual production. The Mo-Sys Onset VP Services team helped Papertown set up a virtual production studio to merge the CGI and real world elements together. This arrangement meant that Papertown could focus on imaging and storytelling without having to organise their own virtual production workflow, or to research virtual techniques on their own.
Mo-Sys specialise in camera tracking, image robotics and virtual production systems, and created StarTracker to deliver precision 6-axis camera tracking, enabling 3D camera movement in a virtual production scene. Combined with highly accurate real-time lens data, the full StarTracker data set, via the Mo-Sys VP Pro system, drives the Unreal Engine’s virtual graphics, so that they accurately emulate the real camera shot.
Mo-Sys VP Pro is a real-time compositor, synchroniser and keyer. It records and uses real-time camera and lens tracking data to create virtual production content. By showing the views and camera angles that the same moves would reveal in Papertown’s 3D environment, virtual scenes become more convincing.
Composite in the Viewfinder
Using StarTracker’s ability to tie the virtual graphics to the real world as he was shooting, the cinematographer could frame each shot visually because the composite image was available in the viewfinder. Mo-Sys VP Pro has its own colour difference keyer, which removed the green screen background to allow it to be replaced with the CG background.
He could see how the lighting of the real and virtual elements worked together, and how well they both would align with his camera angle at any moment. The production team were also able to record the finished output, reducing the need for time-consuming compositing in post.
Papertown was able to shoot the entire three-hour video series, outputting many terabytes of cinematic footage, in only two studio days. “We had no experience of Mo-Sys products before this shoot, but we had the support we needed to quickly put our creative to work,” said Papertown founder and Executive Creative Director Julian Smith. “Being able to use StarTracker, VP Pro and Unreal together extended a great deal of value to our clients, and made our photo-real CGI much more accurate and useful.”
Michael Geissler, CEO of Mo-Sys, said, “Shooting final pixel like this gives a production a tremendous boost. But it can only realistically be done with precision camera and lens tracking, real-time compositing, and a virtual production operator who is familiar with the Unreal Engine.” StarTracker and VP Pro are available now, and Mo-Sys has just released the VP Pro XR server developed specifically forproductions that use LED volumes. www.mo-sys.com