Sony Pixel Power calrec Sony

Dreaming in Virtual Reality

12/04/2016

The Hunger Games: Mockingjay, Katniss leads an invasion with a handheld hologram device, and Beetee sits before a multi-panel computer display in order to hack into the Capitol. Tony Stark puts his Iron Man helmet on, and hundreds of relevant graphics animate to life: maps locating nearby enemies, flight controls, suit diagnostics, and holographs all help to tell the stories in Iron Man and The Avengers. Floor-to-ceiling glass/holographic displays enable James Franco to explain how a new drug will make apes smarter in Rise of the Planet of the Apes.

Jayse Hansen has gained international attention for designing some of the most iconic fictional user interfaces in film history. His work specializes in revealing the details beneath the surface of machines, computers and hero devices' such as holographic tablets in Ender's Game, or the creation of new superhero gear using holographic tables in Disneys Big Hero 6. In the film Pixels, look closely for his many '80s video game nods and easter eggs hidden in the advanced military UIs.

In addition to designing for the fictional film world, Hansen has also consulted and designed for various real-world software companies in VR and AR, as well as the US Department of Defense on strategies to use his outside-the-limits design thinking to dramatically increase efficiency for dealing with immense amounts of time-sensitive, mission-critical information.

Hansen's work is featured in the April/May 2016 issue of Computer Graphics World, while more of his designs can be found on his website at www.jayse.tv. Here, he continues the discussion about his workflow and this unique genre of computer graphics.

You've provided fictional user interface (FUI) graphics to memorable scenes in some of today's most beloved films. Can you tell us what an FUI is, and how the story influences your designs?

FUI graphics are used in instances where a character in a film is interacting with a computer or display technology of some kind. The technology can be worn on the head as a heads-up display (HUD), like in Iron Man when he puts his helmet on and is surrounded by hundreds of relevant data graphics, or a hologram, like when Hiro assembles the armor for Baymax in Big Hero 6 , or in The Force Awakens when R2-D2 and BB-8 project their holograms of the map to Luke Skywalker. These elements are all designed, modeled, and animated by a small, specialized team of VFX artists. They both rely on and support the narrative of the film. They are always designed to move the story along in some dynamic and interesting way.

FUI graphics seems to be a specialty within visual effects content creation. How did you start designing this way?

Ive actually been obsessed with screens in movies and TV since I was a child, but I didnt know it was someones job to actually create these things. When I met Mark Coleran (who coined the term FUI and is a master at it creating content in films like Bourne Identity, The Island, Mission Impossible, and so on) I knew that was the direction I wanted to dive into with full force. It fits my love of research, pixel perfection, and super creative thinking. Its really an awesome job!

In a film, you are called in to create designs at different phases of production, both preproduction and postproduction. Can you tell us about that?

It differs with the needs of each film. On Mockingjay , I was designing and animating on set with Cantina Creative in Atlanta. The director, Francis Lawrence, wanted to have all designs live on set, not only for lighting, but more importantly so that the actors had something they could emotionally react to since a big part of that film was told through the screens. Sometimes the director will want something that cant be done practical on set, such as Katnisss (Jennifer Lawrence's) mini hologram that she carries with her through the film to locate President Snows traps, or when Han Solo (Harrison Ford) and Rey (Daisy Ridley) are walking through BB-8s hologram on the Millennium Falcon in The Force Awakens . In that case, Ill get brought back in postproduction. For The Force Awakens , for instance, I was brought on board VFX master Andrew Kramers excellent team at Bad Robot to help design and animate key moments after the film was shot.

How do you approach an empty digital canvas, so to speak? Can you tell us more about your workflow?

That empty canvas is both exciting and terrifying, so Ive worked out a few ways that I tackle it. I always start on paper. I allow myself to draw really badly and just get ideas out because even a scribble is less terrifying than a blank page. Then it becomes really apparent what I need to research and it flesh out. I'll also look at hardware for shapes and re-imagine those as software. Then I go straight to Illustrator from paper, and straight from Illustrator to After Effects for compositing and animation, and then back and forth between Cinema 4D and After Effects to add dimensionality.

The topic of virtual reality and augmented reality in entertainment content creation are trending topics at the moment. Are VR and AR graphics created in the same way but just viewed differently?

Somewhat, both tend to be assembled in a real-time game engine, such as Unity. But the needs and purposes of each can be dramatically different. In VR, for instance, you are blocking out your world and substituting it with an artificial reality. So a complete world needs to be built. In AR, its more about the integration of your physical world with digital content. A company I consult for, called Meta (getameta.com), is doing the most amazing things right now and really leading the pack in this early development of fully immersive AR. Theyre allowing you to fully interact with your digital content. The digital content can be fanciful, like a lifelike dinosaur that runs acr
LINK: http://www.cgw.com/Press-Center/In-Focus/2016/Dreaming-in-Virtual-Real...
See more stories from cwg

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

22/11/2026

Synthoid: Browser-based modular synth

Try out modular synthesis for free If you're looking for a way to explore modular synthesis without having to spend any money, then it's worth takin...

21/11/2026

Give Me the Ball! Serves a Powerful Portrait of Billie Jean King

Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Fes...

21/11/2026

fedDSP introduce Kami

Compressor plug-in free for first two weeks The latest plug-in to join fedDSP's Amps & Pedals line-up has just arrived, and the company are kindly offer...

21/11/2026

Can a Democratic Congress Revive Public Media Funding?

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

21/11/2026

ATSC's Jerry Whitaker, Zandra Clarke Receive SMPTE Honors

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

21/11/2026

Brightline Lighting Introduces the MOD2 Increasing the Re...

A larger studio puts more distance between the lights and the people who need to look good under them. Brightline Lighting, a manufacturer of energy-efficient l...

21/11/2026

Scripps Research awarded $7M to catalyze pain and addiction initiative

LA JOLLA, CA-Despite its enormous impact on individuals, families and communities, addiction remains an area of significant unmet medical need. A $7 million gi...

21/11/2026

27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design

27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design Brie Clayton November 20, 2026 0 Comments Blackmagic Design hardware and software ...

21/11/2026

Qube Cinema Named Technical Partner for 57th International Film Festival of India

Qube Cinema Named Technical Partner for 57th International Film Festival of Indi...

20/11/2026

ESPN's Jimmy Pitaro on Super Bowl LXI: A Yearlong Story That Features a Game'

The sports broadcaster's chairman sees the upcoming game as an opportunity t...

20/11/2026

SVG GameDay, Ep. 40: New York Mets Brendan McKeon - Firing Up Fans in Flushing

In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...

20/11/2026

Back at Belmont Park, Part 1: Historic Venue's Renovation Puts a Premium on the Fan Experience

A variety of LED displays, integrated broadcast infrastructure covers every angl...

20/11/2026

RAF Partners with Migu Video to Bring RAF15 Main Event to China

Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...

20/11/2026

Apple TV Becomes U.S. Home of F1 Academy Beginning in 2027

Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...

20/11/2026

mnchen.tv Relies on Riedel Technology for New Production Center

Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...

20/11/2026

Eutelsat Announces Three Executive Committee Appointments

Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher. Jean-Hubert Lenotte is appoin...

20/11/2026

Seven Melbourne Selects RTS and Magna Systems for Comms Upgrade at New Facility

After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...

20/11/2026

Brazil's TV 3.0 Rollout Shows VVC Moving from Standards Work to Commercial Deployment

Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...

20/11/2026

NBC Sports and The Soccer Tournament Agree to Two-Year Extension for TST 2027 and 2028

The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...

20/11/2026

Back at Belmont Park, Part 2: NYRA Reaps Benefits of Reimagined Track With Expanded Broadcast Capabilities

Enhancements include a larger compound, an elevated camera count, and a whole lo...

20/11/2026

With Women's Sports Programming Skyrocketing, Content and Production Strategy Are Evolving

Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...

20/11/2026

Lemur Audio release Dorothe

New EQ plug-in aimed at mastering duties Lemur Audio's latest plug-in has just arrived, delivering a characterful EQ that's aimed primarily at maste...

20/11/2026

Soundtoys Black Friday Sale

Discounts of up to 75% now available Soundtoys' annual Black Friday sale is now live, with discounts of up to 75% applied across the company's range...

20/11/2026

SoundGhost release Fragment

New creative looping tool revealed Described as a cycling audio fragmenter , the latest addition to the SoundGhost range draws its inspiration from tape ph...

20/11/2026

Heritage Audio's Herchild 670 goes virtual

Fairchild recreation gets plug-in counterpart Heritage Audio's Herchild 670 offers a meticulous hardware recreations of the much-loved Fairchild 670 and...

20/11/2026

BONDI: 7 Minutes That Changed Australia

BONDI: 7 Minutes That Changed Australia 16 November, 2026 Media releases A landmark documentary chronicling the worst terror attack in modern Australian hi...

20/11/2026

Statement regarding SBS non-Executive Director Aaron Fa'Aoso

Statement regarding SBS non-Executive Director Aaron Fa'Aoso 20 November, 2026 Media releases Aaron Fa'Aoso has advised that he is stepping down a...

20/11/2026

PUBLIC NOTICE FROM THE DEPARTMENT OF SPORT, ARTS AND CULTURE

INVITATION FOR PUBLIC COMMENTS AND OBJECTIONS ON NOMINEES FOR APPOINTMENT TO THE COUNCIL OF THE NATIONAL FILM AND VIDEO FOUNDATION (NFVF) The Department of Spor...

20/11/2026

TVP Claims Top Spot in Poland's Content Distributor Rankings

UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share Warsaw, Poland, November 19, 2026 - Nielsen, a...

20/11/2026

The Gauge: Poland | October 2026

October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...

20/11/2026

FIFA Finds Few U.S. Networks Interested in 2030 World Cup Broadcast Rights

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives what is slowing them down

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...

20/11/2026

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 Coverage

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...

20/11/2026

What Film School Pays and What it Costs: The Federal Numbers

What Film School Pays and What it Costs: The Federal Numbers Mark Santos November 20, 2026 0 Comments Every editor has had the argument about film sch...

20/11/2026

3D Sound Specialist Turns to Nugen Halo Upmix

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

World's First Hybrid Film Production Platform Debuts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

NBC Adds New Stats Feature for Premier League

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Hearst TV Names Shawnda Adams to Lead KOCO-TV Oklahoma City

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

FCC Modernizes Drone Communications, Detection Rules

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

OBSBOT Unveils 2 New PTZR Cameras

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

New DigitalGlue Mac App Identifies Media Production Hurdles

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Beam Dynamics Introduces MCP for Faster, Smarter Technolo...

Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...

20/11/2026

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30 Pierre Jasmin November 19, 2026 0 Comments Long time friends of the COW are up with a big sale! Us...

20/11/2026

Avid is offering up to 33% off annual subscriptions!

Avid is offering up to 33% off annual subscriptions! Brie Clayton November 19, 2026 0 Comments Hero image courtesy Deposit Photos Pro Tools Pro To...

19/11/2026

Live From the UFL Draft: League's First Live Draft Broadcast Is Set To Innovate, Bring Viewers Close to the Action

With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...

19/11/2026

SVG Students To Watch: Niamh Campbell, Seton Hall University

The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone The future of live sports produ...

19/11/2026

RED Connect Adds Native Colorfront Color Management for Live RED Camera Feeds

RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...

19/11/2026

SMPTE Publishes Engineering Report on Content Provenance and Authenticity

SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...

19/11/2026

CTech and Skyline Communications Partner on Integrated SATCOM Operations for Defense

CTech and Skyline Communications have announced a partnership to deliver integra...