
How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination
By Contributor
Published: March 25, 2021
How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination
target=_blank title=Share on LinkedIn class=share-linkedin> How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination
https://www.tvbeurope.com/production-post/case-study-breaking-new-ground-in-a-galaxy-far-far-away title=Share via Email class=share-email>
At the heart of every project that ILM has utilised performance capture for over the last 25+ years lies a core technology that helps push the boundaries of visual effects: Vicon motion capture systems. It is no exaggeration to say that the collaboration between ILM and Vicon has helped redefine the extent of our imagination.
The latest example of this work is one of ILM's most challenging and ambitious projects ever - The Mandalorian.
Following the Emmy Award-winning season one, the latest season of The Mandalorian pushes the thrilling ride for fans to new heights - all thanks to ILM's ground-breaking StageCraft technology that achieves a giant leap forward in filming techniques.
Working with Vicon, ILM has evolved well beyond traditional VFX motion capture to become a world leader in virtual production.
Turning vision into reality through technology With The Mandalorian, filmmakers Jon Favreau and Dave Filoni have been explicit in their desire to bring Star Wars to the screen in a new way. With the scope and ambition of the series only increasing on the second season it was crucial that the actors and viewers not only experience a huge range of new worlds - but truly believe in the reality of the worlds being created and are able to build emotional connections with the characters.
This ambition has required new filming techniques to be rapidly developed and deployed - chief among them virtual production techniques including camera tracking for in-camera VFX (ICVFX).
Virtual production in its simplest form is the merger of physical and digital worlds. Through a combination of immersive technologies like virtual reality (VR) and augmented reality (AR), as well as ILM StageCraft and real-time render engines, virtual production allows filmmakers to view their projects live on set to quickly react and make changes as needed, rather than having to wait until post production. Virtual production also offers several logistical benefits as it allows for more iterations of scenes or shots to be created with fewer personnel in a shorter space of time, therefore significantly reducing production costs.
Allowing the creative team and the actors themselves to better visualise the environments on shoot day is paramount. Production teams previously had to imagine the final scene while using green screens to shoot, with visuals applied in post-production after the fact.
ILM has invested heavily in leading the way with these techniques - and projects such as The Mandalorian and George Clooney's film, The Midnight Sky has been a tour de force of just what is possible with virtual production.
Motion capture technology in a virtual production pipeline is a crucial component in making these endeavours a reality. Vicon's technology has allowed ILM to recreate the universe of Star Wars in compressed time with 60 different live environments, which they can use over and over again.
Everything from VR scouting, previsualisation, performance capture and in-camera VFX using giant LED walls can make use of Vicon technology in some way.
One of the biggest leaps forward has been real-time capture in the volume itself, which requires high-resolution cameras and large frustums. The latest Vicon hardware has enabled ILM to accurately track cameras on set while moving about no matter if the camera is handheld, on a crane, a Steadicam, or some other support equipment. This has helped to create a 360 degrees virtual production environment at large scale such as ILM's pioneering StageCraft LED volumes, enabling them to capture a whole new category of shots while successfully blending photoreal visual effects with live action, which previously wasn't possible.
Making the impossible, possible for 25 years For Rachel Rose, ILM R&D Supervisor who oversees the studio's developments for virtual production, the success of The Mandalorian and all ILM projects requiring motion capture owes much to the collaboration: Since day one Vicon has enabled us to do things that were never possible before - and that's as true today as it was in the 90s. Vicon's technology and hardware have constantly advanced throughout our relationship, and the processing power available to us with their technology is like no other. We can deploy and always count on Vicon's tech as it's such reliable, robust hardware requiring only a quick calibration.
ILM always looks to collaborate with those who are making best-in-class software/hardware solutions for problems we're solving. If a solution doesn't exist, we'll solve it on our own, but we're not looking to reinvent a solution that's already there. We are incredibly lucky that we have a long-standing relationship with such an innovative company like Vicon. The absolute best thing I can say is that with Vicon I have a powerful performance capture system that just works.
Unleashing a new wave of creativity
With ILM's StageCraft virtual production technology, ILM and Vicon have realised many filmmakers' vision for creating fully digital worlds that are as close to reality as possible.
The Mandalorian is just the start of a new wave of creativity that will be unleashed as film directors explore new ways to take advan
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
21/11/2026
Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Fes...
21/11/2026
Compressor plug-in free for first two weeks
The latest plug-in to join fedDSP's Amps & Pedals line-up has just arrived, and the company are kindly offer...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
21/11/2026
A larger studio puts more distance between the lights and the people who need to look good under them. Brightline Lighting, a manufacturer of energy-efficient l...
21/11/2026
LA JOLLA, CA-Despite its enormous impact on individuals, families and communities, addiction remains an area of significant unmet medical need.
A $7 million gi...
21/11/2026
27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design
Brie Clayton November 20, 2026
0 Comments
Blackmagic Design hardware and software ...
21/11/2026
Qube Cinema Named Technical Partner for 57th International Film Festival of Indi...
20/11/2026
The sports broadcaster's chairman sees the upcoming game as an opportunity t...
20/11/2026
In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...
20/11/2026
A variety of LED displays, integrated broadcast infrastructure covers every angl...
20/11/2026
Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...
20/11/2026
Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...
20/11/2026
Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...
20/11/2026
Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher.
Jean-Hubert Lenotte is appoin...
20/11/2026
After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...
20/11/2026
Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...
20/11/2026
The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...
20/11/2026
Enhancements include a larger compound, an elevated camera count, and a whole lo...
20/11/2026
Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...
20/11/2026
New EQ plug-in aimed at mastering duties
Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...
20/11/2026
Discounts of up to 75% now available
Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...
20/11/2026
New creative looping tool revealed
Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...
20/11/2026
Fairchild recreation gets plug-in counterpart
Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...
20/11/2026
BONDI: 7 Minutes That Changed Australia
16 November, 2026
Media releases
A landmark documentary chronicling the worst terror attack in modern Australian hi...
20/11/2026
Statement regarding SBS non-Executive Director Aaron Fa'Aoso
20 November, 2026
Media releases
Aaron Fa'Aoso has advised that he is stepping down a...
20/11/2026
INVITATION FOR PUBLIC COMMENTS AND OBJECTIONS ON NOMINEES FOR APPOINTMENT TO THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF) The Department of Spor...
20/11/2026
UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share
Warsaw, Poland, November 19, 2026 - Nielsen, a...
20/11/2026
October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...
20/11/2026
How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...
20/11/2026
What Film School Pays and What it Costs: The Federal Numbers
Mark Santos November 20, 2026
0 Comments
Every editor has had the argument about film sch...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...
20/11/2026
Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30
Pierre Jasmin November 19, 2026
0 Comments
Long time friends of the COW are up with a big sale!
Us...
20/11/2026
Avid is offering up to 33% off annual subscriptions!
Brie Clayton November 19, 2026
0 Comments
Hero image courtesy Deposit Photos
Pro Tools
Pro To...
19/11/2026
With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...
19/11/2026
The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone
The future of live sports produ...
19/11/2026
RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...
19/11/2026
SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...
19/11/2026
CTech and Skyline Communications have announced a partnership to deliver integra...
19/11/2026
Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...