How Laika Uses Intel's AI to Enhance Stop Motion Filmmaking in 'Coraline' and Beyond

Laika, the acclaimed stop-motion animation studio known for hits like Coraline and Kubo and the Two Strings, is at the forefront of integrating innovative technology into its filmmaking process. Following its successful use of 3D printing for the 2012 film ParaNorman, Laika is now leveraging artificial intelligence in collaboration with Intel.

The partnership aims to streamline the cleanup of visual artifacts that traditionally required extensive manual labor from artists. Jeff Stringer, Laika’s director of production technology, highlights the studio's use of 3D-printed shapes for facial performances. While animators meticulously adjust these shapes to create lifelike, emotive characters, the process leaves behind visible seams and artifacts, such as circles around mechanical eyelids. Until now, Laika has utilized manual digital rotopainting and wire removal, a labor-intensive endeavor that consumed significant time and resources.

Initially, Laika even contemplated retaining these artifacts to emphasize the handcrafted nature of their work. However, as they began to eliminate these imperfections, the efficiency of their workflow dramatically improved. "The largest subset of the visual effects team is spent on rotopainting, and it rarely gets the recognition it deserves," said Steve Emerson, visual FX supervisor at Laika. "By streamlining these tasks, we can reallocate resources to enhance the visual experience of our films, allowing our artists to explore new creative avenues."

The Intel-powered machine learning tool integrates seamlessly as a plugin within Nuke, Laika's chosen 3D modeling software. This powerful tool can resolve artifacts in approximately 70 frames (about 3 seconds of footage) in just five minutes and 25 seconds—a dramatic reduction from the previous five to six hours required. While it still requires some artist intervention, such as bounding box setup and model training over several weeks, the efficiency gains are undeniable.

Based on the workload involved with Missing Link, Laika anticipates that the Intel tool could halve cleanup time, freeing up about 2,000 artist days. This newfound efficiency enables the studio to perfect each shot and tackle other time-consuming challenges inherent in stop-motion animation. While embracing digital tools, Laika is committed to enhancing the handcrafted essence of its unique art form rather than replacing it.

Looking ahead, Laika plans to utilize Intel's machine learning plugin for its upcoming unannounced project. While details remain under wraps, the studio’s innovative advancements with AI are set to play a pivotal role in its future creations.