Sony Pixel Power calrec Sony

Case study: Breaking new ground in a galaxy far, far away

25/03/2021

How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination

By Contributor

Published: March 25, 2021

How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination

target=_blank title=Share on LinkedIn class=share-linkedin> How Industrial Light and Magic collaborated with Vicon motion capture systems to redefine the extent of our imagination

https://www.tvbeurope.com/production-post/case-study-breaking-new-ground-in-a-galaxy-far-far-away title=Share via Email class=share-email>

At the heart of every project that ILM has utilised performance capture for over the last 25+ years lies a core technology that helps push the boundaries of visual effects: Vicon motion capture systems. It is no exaggeration to say that the collaboration between ILM and Vicon has helped redefine the extent of our imagination.

The latest example of this work is one of ILM's most challenging and ambitious projects ever - The Mandalorian.

Following the Emmy Award-winning season one, the latest season of The Mandalorian pushes the thrilling ride for fans to new heights - all thanks to ILM's ground-breaking StageCraft technology that achieves a giant leap forward in filming techniques.

Working with Vicon, ILM has evolved well beyond traditional VFX motion capture to become a world leader in virtual production.

Turning vision into reality through technology With The Mandalorian, filmmakers Jon Favreau and Dave Filoni have been explicit in their desire to bring Star Wars to the screen in a new way. With the scope and ambition of the series only increasing on the second season it was crucial that the actors and viewers not only experience a huge range of new worlds - but truly believe in the reality of the worlds being created and are able to build emotional connections with the characters.

This ambition has required new filming techniques to be rapidly developed and deployed - chief among them virtual production techniques including camera tracking for in-camera VFX (ICVFX).

Virtual production in its simplest form is the merger of physical and digital worlds. Through a combination of immersive technologies like virtual reality (VR) and augmented reality (AR), as well as ILM StageCraft and real-time render engines, virtual production allows filmmakers to view their projects live on set to quickly react and make changes as needed, rather than having to wait until post production. Virtual production also offers several logistical benefits as it allows for more iterations of scenes or shots to be created with fewer personnel in a shorter space of time, therefore significantly reducing production costs.

Allowing the creative team and the actors themselves to better visualise the environments on shoot day is paramount. Production teams previously had to imagine the final scene while using green screens to shoot, with visuals applied in post-production after the fact.

ILM has invested heavily in leading the way with these techniques - and projects such as The Mandalorian and George Clooney's film, The Midnight Sky has been a tour de force of just what is possible with virtual production.

Motion capture technology in a virtual production pipeline is a crucial component in making these endeavours a reality. Vicon's technology has allowed ILM to recreate the universe of Star Wars in compressed time with 60 different live environments, which they can use over and over again.

Everything from VR scouting, previsualisation, performance capture and in-camera VFX using giant LED walls can make use of Vicon technology in some way.

One of the biggest leaps forward has been real-time capture in the volume itself, which requires high-resolution cameras and large frustums. The latest Vicon hardware has enabled ILM to accurately track cameras on set while moving about no matter if the camera is handheld, on a crane, a Steadicam, or some other support equipment. This has helped to create a 360 degrees virtual production environment at large scale such as ILM's pioneering StageCraft LED volumes, enabling them to capture a whole new category of shots while successfully blending photoreal visual effects with live action, which previously wasn't possible.

Making the impossible, possible for 25 years For Rachel Rose, ILM R&D Supervisor who oversees the studio's developments for virtual production, the success of The Mandalorian and all ILM projects requiring motion capture owes much to the collaboration: Since day one Vicon has enabled us to do things that were never possible before - and that's as true today as it was in the 90s. Vicon's technology and hardware have constantly advanced throughout our relationship, and the processing power available to us with their technology is like no other. We can deploy and always count on Vicon's tech as it's such reliable, robust hardware requiring only a quick calibration.

ILM always looks to collaborate with those who are making best-in-class software/hardware solutions for problems we're solving. If a solution doesn't exist, we'll solve it on our own, but we're not looking to reinvent a solution that's already there. We are incredibly lucky that we have a long-standing relationship with such an innovative company like Vicon. The absolute best thing I can say is that with Vicon I have a powerful performance capture system that just works.

Unleashing a new wave of creativity

With ILM's StageCraft virtual production technology, ILM and Vicon have realised many filmmakers' vision for creating fully digital worlds that are as close to reality as possible.

The Mandalorian is just the start of a new wave of creativity that will be unleashed as film directors explore new ways to take advan
LINK: https://www.tvbeurope.com/production-post/case-study-breaking-new-grou...
See more stories from tvb

Most recent headlines

24/12/2025

Carr Lays Out FCCs 'Key Wins in 2025'

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

24/12/2025

CES: Cineverse Unveils New Features for Cinesearch

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

24/12/2025

IES, AES Promote Graham Kirk, Brienne Willcock

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

24/12/2025

Ad Tech and CTV Experts Forecast 2026's Biggest Trends

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

24/12/2025

December 23, 2025

Scripps Research study links sleep variability with sleep apnea and hypertension How consumers' digital activity trackers could enable personalized health s...

23/12/2025

How guilas Cibaeas Dominican Winter League Games Are Locally Produced for Global Audience

How guilas Cibae as Dominican Winter League Games Are Locally Produced for Glob...

23/12/2025

CAMB.AI Enables European Athletics to Offer Multi-Language Support

CAMB.AI Enables European Athletics to Offer Multi-Language SupportPlan is to eventually offer translation into all languages spoken in EuropeBy Ken Kerschbaumer...

23/12/2025

Analysis: As Sports Media Values Trend Negative, Scarcity and Quality Are King

Analysis: As sports media values trend negative, scarcity and quality are king By Callum McCarthy, Editor-at-Large Monday, December 22, 2025 - 14:08 Print ...

23/12/2025

ESPN, Disney, and NBA Return to the Animated Altcast Fray With Second Edition of Dunk the Halls'

ESPN, Disney, and NBA Return to the Animated Altcast Fray With Second Edition of...

23/12/2025

End the Year on a High Note and Donate to the Sports Broadcasting Fund Today!

End the Year on a High Note and Donate to the Sports Broadcasting Fund Today! By Ken Kerschbaumer, Editorial Director Tuesday, December 23, 2025 - 12:25 pm ...

23/12/2025

Find Your Perfect Holiday Romance Listen With These Swoon-Worthy Audiobooks

The year is winding down, the weather outside is frightful, and it's the perfect time to escape into a story that warms the heart. For listeners looking for...

23/12/2025

L3Harris Receives Letter of Intent from Kratos Defense for Production of Large Hypersonic Solid Rocket Motors

A Zeus motor is hot fire tested at L3Harris' Camden, Arkansas, solid rocket ...

23/12/2025

FCC Bans All New Foreign-Made Drones

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

Gray Media Renews Its NBC Affiliation Agreements

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

Lightware to showcase breakthrough Google Meet and TPN MM...

Lightware will exhibit several major product innovations at ISE 2026, including the new USB-C BOOSTER-V1, Google Meet. integration for various Taurus UCX models...

23/12/2025

Nielsen, Roku Expand Measurement Partnership

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

PwC: Streaming Market Shifting to 'Scale and Sustainability'

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

Inside the Gray Innovation Lab

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

ESPN Renews Deal for Heisman Trophy Coverage

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

Gray Media to Acquire WBBJ from Bahakel Communications

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

23/12/2025

Taking the Stage at Carnegie Hall-On a Global Scale

Taking the Stage at Carnegie Hall-On a Global Scale Boston Conservatory Orchestra students reflect on their epic concert marking the 80th session of the UN Gene...

23/12/2025

Boost Performance with a System Effectiveness Review

Experience the power of WO Automation for Radio's newest service, the System Effectiveness Review. Designed to help you achieve more, a System Effectiveness...

23/12/2025

VEON's Beeline Kazakhstan and Rakuten Symphony Collaborate to Advance Next-Generation Connectivity and Digital Infrastructure

23 Dec 2025 VEON's Beeline Kazakhstan and Rakuten Symphony Collaborate to A...

23/12/2025

How Steamy Can It Get? Single's Inferno' Season 5 Premieres January 20, Previews All-Out Flirting War in Sizzling Teaser

Back to All News How Steamy Can It Get? Single's Inferno' Season 5 Pre...

23/12/2025

33 Million Global Viewers on Netflix Watched Jake Paul vs. Anthony Joshua's Epic Six-Round Battle

Back to All News 33 Million Global Viewers on Netflix Watched Jake Paul vs. Ant...

23/12/2025

December 22, 2025

New technique lights up where drugs go in the body, cell by cell Scripps Research scientists developed a technique that maps drug binding in individual cells th...

22/12/2025

SVG New Sponsor Spotlight: Presidio's Neerav Shah on the Role of Its Captivate and Resonate Platforms in Sports Production

SVG New Sponsor Spotlight: Presidio's Neerav Shah on the Role of Its Captiva...

22/12/2025

Hitting the Bullseye: Sky Sports Readies Itself for the Biggest PDC World Darts Championship to Hit Ally Pally Yet

Hitting the bullseye: Sky Sports readies itself for the biggest PDC World Darts ...

22/12/2025

Unique Skillset: Bringing New Directors to the World of Darts at The Worlds with Sky Sports

Unique skillset: Bringing new directors to the world of darts at The Worlds with...

22/12/2025

Gravity Media Prepares for a Flight of Fancy With the PDC World Darts Championship 2025 for Sky Sports

Gravity Media prepares for a flight of fancy with the PDC World Darts Championsh...

22/12/2025

One Hundred and Eighty: Gravity Media on Hitting the Production Bullseye at the World Darts Championship 2025

One hundred and eighty: Gravity Media on hitting the production bullseye at the ...

22/12/2025

The Famous Group's Jon Slusser on Fascinating Fans Through Immersive Content Experiences

The Famous Group's Jon Slusser on Fascinating Fans Through Immersive Content...

22/12/2025

ESPN's Meg Aronowitz on Continuing High-Quality Broadcasts of Collegiate Sports, Expanding Growth of Internal Production Team

ESPN's Meg Aronowitz on Continuing High-Quality Broadcasts of Collegiate Spo...

22/12/2025

ESPN Takes Data-Driven Storytelling to New Heights with MNF Playbook with Next Gen Stats' NFL Altcasts

ESPN Takes Data-Driven Storytelling to New Heights with MNF Playbook with Next ...

22/12/2025

A Decade of Giving: Fest & Flauschig' Christmas Circus Celebrates Record Turnout and Generosity

For a decade, popular German podcast Fest & Flauschig has hosted an annual Chris...

22/12/2025

Paramount and Netflix Boast Double-Digit Gains in Nielsen's November Media Distributor Gauge

Paramount Scores Largest Share Increase Among Distributors as Paramount and CBS...

22/12/2025

Nielsen and Roku Expand Strategic Measurement Partnership

New multi-year deal integrates Roku's data to fuel Nielsen's measurement suite Roku gains access to Nielsen's streaming ratings, showing The Roku C...

22/12/2025

Allen Media Group to Deploy Infillion TrueX for Streaming Services

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

22/12/2025

Berklee Wrapped 2025: Our Top News and Stories

Berklee Wrapped 2025: Our Top News and Stories A look back at a year highlighted by faculty milestones, major film and television projects, Bob Dylan's ho...

22/12/2025

Marine Biological Laboratory Explores Human Memory With AI and Virtual Reality

The works of Plato state that when humans have an experience, some level of change occurs in their brain, which is powered by memory - specifically long-term me...

22/12/2025

Space42 and LatConnect 60 Expand Access to Advanced Geospatial Intelligence

Partnership integrates complementary satellite data and AI analytics to enhance security, infrastructure, and environmental monitoring solutions for global cust...

22/12/2025

Simplify Playlist Management with Workflows in WO Automation for Radio

Workflows allow you to create a sequence of planned events which may be added to your template(s) or inserted directly into your sequential or background playli...

22/12/2025

Sky extends PGA TOUR partnership until 2029, as Sky Sports remains the unrivalled home for golf fans in the UK and Ireland

Monday 22 December 2025 Sky extends PGA TOUR partnership until 2029, as Sky Spo...

22/12/2025

Global Anime Hits and New Releases Take Center Stage at Jump Festa 2026

Back to All News Global Anime Hits and New Releases Take Center Stage at Jump Festa 2026 Entertainment 22 December 2025 GlobalJapan Link copied to clipboar...

22/12/2025

Christmas with Oliver Callan on RT

Siobh n McSweeney, Rory McIlroy, Elon Musk, Catherine Connolly, Jim Gavin, Ivan Yates and Traitor Paudie Moloney lead new characters for Callan Kicks the Year 2...

22/12/2025

Monaghan's McKenna family crowned Ireland's Fittest Family 2025

Winner announced in the picturesque surroundings of Wicklow's Avondale Tower and Treetop Walk Andrew Trimble wins the show in his first series as coach Th...

22/12/2025

RT lyric fm Choirs for Christmas 2025 Winners Announced

The 2025 winners have been announced today, Sunday 21 December, for Ireland's largest choral competition Choirs for Christmas hosted by RT lyric fm. Ove...

21/12/2025

Legoshi and Haru's Story Reaches Its Finale: BEASTARS Final Season Part 2' Premieres March 2026, Main Trailer Out Now

Back to All News Legoshi and Haru's Story Reaches Its Finale: BEASTARS Fin...