The visual effects team at Double Negative completed a complex sequence set in Monaco on the racing circuit at the Grand Prix for ‘Iron Man 2’. It gave the artists a chance to show their skill in everything from on-site supervision to CG environments and 3D modelling to fight choreography.
|Much of the environment work was focussed on the 'fight area' where the majority of the sequence takes place, involving about 250 shots. This is the waterfront section of the grand-prix circuit between the turns named ‘Tabac’ and ‘Piscine’. Double Negative accompanied the 2nd unit crew to Monaco in May 2009 in the lead-up to the real Grand-Prix to shoot digital stills, collect reference video and gather LIDAR and survey data for the entire circuit, and a large section of the surrounding city and local terrain.
The team, a diverse group of 140 at the peak of production, needed all of this precise information to be able to reconstruct the entire scene with photography and simple models. However the most detailed area, the fight area, was to be modelled in 3D, in which the stands, fencing, barriers, harbour side boats and other elements all came together as a complicated 3D build allowing them more flexibility later in production.
Moving to LA
“We ended up with 7TB of raw stills data, which is a very large amount of data to wrangle,” said Ged. “Somehow, no matter how thorough you are, something always seems to get missed, but on this show there wasn't a great deal we didn't have reference for. All CG shots are really challenging. We ended up doing more than we had planned because the only way to get the shots where they need to be is to keep going until you run out of time. However it all proved vital down the track, to serve as the basis for the digital Monaco.”
The 500 ft long set built in Downey studios was accurately re-created, including the track, barriers, chain-link fence, stands and press-box, all modelled and textured to hold-up full frame. This set build was then further extended to incorporate authentic Monaco surroundings including 15 yachts to populate the visible waterfront. Again, these had to be modelled, textured and dressed to hold-up full frame in shots. Beyond the main fight area the Automobile Club de Monaco Head Quarters and ten background buildings were also created.
Cars and Crowds
Before Whiplash attacks Stark, viewers follow the Historic Grand Prix race through Monaco’s streets. Throughout the race, every car you see is digital. Double Negative created two different, detailed digital versions of each of the 11 cars appearing in the sequence for a total of 22, based on five cars the art department built especially for this sequence and six genuine vintage GP cars brought in to make up the rest of the grid. The non-digital cars are only seen static on the starting line before the race begins. 3D Lead Jenni Eynon handled much of the fight area environment build and the cars.
Throughout the entire Monaco sequence, crowds to populate the Monaco stands and buildings were generated with photographic techniques. First, Gavin Harrison from the team used a 2D sprite system – a procedural system to distribute filmed elements of crowd people - in Houdini. A 3D set up was also used, achieved photographically with 16 stills cameras arrayed around the capture volume. The captured crowds were projected onto geometry constructed using a system called Double Vision, a stereo reconstruction tool that Double Negative developed when working on ‘Quantum of Solace’. It uses a stereo pair of images from a scene to reconstruct its geometry by analysing the slightly offset views of objects in the images. Then to break up the crowds projected onto this geometry, CG agents performing specific actions were added into the crowds.
The whips’ effects, based in Houdini and achieved by effects lead Joe Thornley, also involved an animation phase. Whiplash actor Micky Rourke was more at ease performing with real bull whips in his whip handles than with nothing there, which meant that most shots had this practical element to be painted out, but it also allowed them to see what the animation should show.
Numerous effects passes of different types were needed to gain control in the composite to give it the look they were after. The look also depended on how quickly the whips were moving and how large they were on screen in each shot. Ged said, “Adding to the difficulty was the fact that the whips were electrical and tesla-based – they look very effective when arcing between two stationary objects but as soon as they were thrown around in the fight, the whips’ effect got more complicated.”
The whips also produce other effects such as sparks, molten drops of metal, grounding arcs and show a visible trail when they are swung to strike. The idea was to make them similar to industrial metal cutting equipment, well-integrated into the surrounding environment. They gouge the track surface, slice through several of the racing cars and eventually tear into Iron Man. While the car slices were achieved as practical effects, they required augmentation with photo-real CG sparks, embers, molten metal, smoke, dust and flying chunks of debris.
Their most complex FX task in the movie was showing the whips interacting with Iron Man. This 'Thermite' effect, named after a type of pyrotechnic metal reaction, combined all of the other whip effects to generate smoking, molten metal streaming from Iron Man when the whips wrap around him. VFX artist Eugenie Von Tunzelmann created this in Houdini, where she could develop what it should look like and then set it up as a script for other artists to use across multiple shots. They’ve found that, once artists are familiar with Houdini, they can create effects with less scripting than with Maya.
Mk V armour
The former Iron Man film was used as a reference for this sequence, because the director wanted to maintain the character’s look. But this suit’s behaviour was in fact quite new. They had to make it grow across the actor’s body without letting it feel as though the parts were moving by magic. Eventually they went back to quite a simple, mechanical look that didn’t demand that the audience believe ‘too much’.
Made up of about 3,000 parts, individually modelling, rigging and texturing the components of the suit was daunting, although these tasks could be automated to an extent. As the fight plays out, several stages of visible damage are also called for, all requiring further hand modelling and texturing. “The greater challenge was creating the parts in a form that was usable or available for Renderman. We haven’t found an elegant solution for this problem yet, but we are working on it. For this project, we handled it partially manually and with a lot of scripting,” Ged said.
“During the concept period on this suit, a collection of stills was used to communicate exactly how it would form over him, while making small, invisible cheats. This method got us through the look but we needed to progress into 3D to solve the next stage - the performance aspect of the scene. Defining this performance took some time. The final outcome was a combination of motion capture and keyframing.”
Sometimes for such scenes, they can work directly with the principle photography, but on this scene it was a matter of rotoscoping out Mickey Rourke, re-lensing and changing everything else in the shot. To overcome some of these problems the team developed a collaborative relationship with the cutting rooms and the previs team in LA, changing animation, shot framings, timings and creating new all-CG shots and offering a mini-cut of how the new material might play.
Influences from all collaborators were incorporated - production designers, art department working on characters, environments, testing and structures they plan to build. The previs team examines all of these inputs and starts to build them in Maya in 3D, their core application for characters, environments and props. Motion Builder is their tool for virtual production.
Nick said, “One of our strengths is in stunt choreography, hand to hand combat and helping live actors interact with effects – getting the eyelines and timing right, for example. The final climactic sequence, in which Iron Man and his partner, also in the armour, take on an army of remote controlled drone robots, was especially demanding for this kind of interaction.
“Our earliest view of shots was usually in board form, passed on to us to start creating the sequence. Then the crew went and shot all the plates for the environment and then we would move to postvis. During production, we were handling the visualisation of the sequences right through and finally handing it off to the VFX team.”
Virtual Camera System
‘Iron Man 2’ aimed to put the virtual camera in the hands of the DP and allow him to shoot inside the previs world. “We weren’t quite working to the level reached in ‘Alice and Wonderland’ which was essentially in real time – shooting live actors while seeing the virtual environment they were to appear in – perfecting that is the current goal for on-set visualisation.
Nick would capture these performances as accurately as possible and recreate all of these action beats, two characters at a time, inside Motion Builder to save as master scenes. These scenes represent the action that will be shot from multiple angles. The master scenes are loaded up, played in real time for the DP, who then continues the process with a virtual camera system.
“These shots would go to editorial, where everyone involved could see the clips cut together and start refining the shots with pans and zooms, all prompted by seeing in advance how it would look. Then they could capture the additional footage to craft the movie with.”
“First, plates are tracked through 3D tracking software like Boujou or, more lately, Pixel Farm’s PF Track. Then we use a virtual camera that matches the live action plate and start comping in the previs elements. This provides editorial with more footage that looks more like the complete, original vision, built into the previs and edited down to the frame. Directors can show sequences laid down this way to a studio or test audiences to make sure they that they have a sequence worth post-producing. The cuts can be sent to potential FX vendors, so they can make leaner, more accurate bids for jobs and organise resources.
|Day at the Races
Tony Stark, inventor and character behind the Iron Man armour, owns one of the cars competing in the race. He suddenly decides to pilot the car and race it himself. But with the race well underway, his arch enemy Whiplash walks out onto the track disguised as an official, armed with a pair of lethal electric whips he uses to slice into the race cars.
Tony’s trusty chauffeur and his right-hand girl, Pepper Potts, see the attack on TV and jump into his Rolls-Royce, driving onto the track to rescue him as the race cars stream past. Stark escapes from his own car’s wreckage as the race cars pile up on the track. Whiplash closes in, trapping Tony amid flaming wreckage. The Rolls-Royce zooms around the bend into Whiplash, pinning him against a barrier but he soon recovers and slices the Rolls into pieces before Tony can escape.
Pepper throws Tony a suitcase containing his portable Mark V Iron Man armour. He activates the suit, transforming himself into Iron Man, and tries to bring Whiplash down. But his opponent tears into the Mark V armour and wraps his whips around Iron Man's neck. Iron Man tangles himself further into the whips but finally manages to disable their power system and put Whiplash out of commission.
Chris Edwards views previs as support for directors from early in preproduction to passing off the last shot from previs into the VFX pipeline for post. “The software used now for previs can pull practical technical data from planning sessions and check values for feasibility. For VFX, for example, the data can help them make decisions on which shots can be live action and which should use digital VFX. To some extent it can replace models, storyboarding and figures with more precise information, and it can be a medium that works for art direction, effects, editing and cinematography.
“Maya and Motion Builder files are created, the common file format used in FX studios, so these can be directly handed over to artists. We produce different views of the set, charts, graphs, measurements, illustrating what the camera can cover from different positions." For example in ‘Cloverfield’, they plotted out a complex sequence of handheld camera work that looked spontaneous but was highly choreographed between the actors’ moves and the cameraman.
|Words: Adriene Hurst
Images: Courtesy of Paramount Pictures
and Double Negative