Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

15/05/2026

And The Winners of the 2026 Spotify Podcast Awards in Mexico Are

Last night, the Spotify Podcast Awards in Mexico returned to the country's capital. Now in its second year, the evening honors creators whose voices are hel...

15/05/2026

Music Expo (San Francisco) becomes MONO Music Conference

Rebranded show announced Ahead of their 2026 return, Music Expo have announced that they have now officially changed their name to the MONO Music Conference...

15/05/2026

Buzzing Bugs Audio Devices introduce the Bolster

Fuzz pedal joins UK companys line-up UK-based pedal makers Buzzing Bugs Audio Devices have recently unveiled their latest creation, the Bolster. Said to pay...

15/05/2026

Join Calrec at MPTS 2026

Join Calrec at MPTS 2026 | May 13-14 | Stand A40 | Olympia, London We're looking forward to meeting up with customers and partners at this year's Media ...

15/05/2026

UKTV joins forces with BritBox and Sony Pictures Television for a co-commission of Chocolate Wars (w/t)

The six-part series is a co-commission with BritBox and Sony Pictures Television...

15/05/2026

Why Trusted Measurement Matters More Than Ever in Retail Media

Against that backdrop, IAB UK has added retail media to its Gold Standard. Jan Pitt, Commercial Director at ABC, spoke with Liv McCullagh, Retail Media Lead at ...

15/05/2026

RT's statement on Derek Mooney's Earnings for the Years 2020-2023

Further to RT 's statement released yesterday and in the interest of full transparency, with the full permission of Derek Mooney, we are now publishing the ...

14/05/2026

Spotify Expands Music Access for Young Listeners, Extending Managed Accounts to Free Tier

At Spotify, we're focused on making every listening experience feel intentio...

14/05/2026

Spotify Brings Nashville's Songwriting Community Together for Mental Health Summit

Spotify recently welcomed songwriters, artists, executives, and music students t...

14/05/2026

Sonuscore update Lux Orchestral Strings

New articulations, ostinatos, Motion Scoring Articulation Sets & more Sonuscore's flagship cinematic string library has just been treated to a significa...

14/05/2026

Pr Recording & Residence

World-class studio opens on T rkiye's Aegean coast P r Recording & Residence have announced their official opening, introducing a new world-class reside...

14/05/2026

Nugen Audio update DialogCheck

Now supports channel layouts up to 9.1.6 Nugen Audio have just released an update for their AI-powered dialogue intelligibility and compliance tool. Set to ...

14/05/2026

UVI release Orchestral Suite 2

New recordings & one-key chord tool UVI have just announced the release of Orchestral Suite 2, a ground-up redesign of their all-in-one symphonic orchestra ...

14/05/2026

Rob Papen launch eXplorer 11

Two new arrivals & expanded factory content Rob Papen's all-encompassing plug-in and virtual instrument collection has just been treated to another upda...

14/05/2026

FSK Audio release QRonicle

Embed QR codes into DAW sessions FSK Audio's latest plug-in doesn't process audio, but serves as an organisational tool that allows QR codes to be e...

14/05/2026

Rohde & Schwarz transforms spectrum complexity into situational awareness and effective countermeasures at AOC Europe 2026

Rohde & Schwarz transforms spectrum complexity into situational awareness and ef...

14/05/2026

Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled uncrewed operations

Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled...

14/05/2026

Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO Technical Interoperability Exercise 2026

Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO...

14/05/2026

Code of Silence wins Best Drama Series at the 2026 BAFTA's!

Code of Silence has won the BAFTA for Best Drama Series at Sunday night's ceremony at the Royal Festival Hall. The series, starring Rose Ayling-Ellis and w...

14/05/2026

Vivid Broadcast builds remote production network around Calrec

Vivid Broadcast was embracing remote production long before it became the industry norm. Now, with Calrec's True Control 2.0-enabled Argo M and Type R conso...

14/05/2026

Comscore Reports First Quarter 2026 Results

Comscore Reports First Quarter 2026 ResultsRESTON, Va., May 14, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evaluating...

14/05/2026

RT TOP TEN HIGHEST EARNING PRESENTERS 2025

RT is today publishing the earnings of its top 10 highest-earning presenters for 2025, ahead of the publication of RT 's Annual Report 2025 later this year...

14/05/2026

UKTV Highlights: Saturday May 30th - May 5th June

What can I watch on UKTV and stream on U this week? This week on UKTV and the free streaming service U, viewers can watch a range of new and returning programm...

14/05/2026

Izuka Hoyle to return in Sky Original thriller Prisoner, with season two confirmed

The high-stakes chase thriller from Oscar- and BAFTA-nominated writer Matt Charm...

14/05/2026

Discover hidden havens for city wildlife as Back From The Brink returns for a fifth season

Back From The Brink airs Sunday 17 May and Sunday 24 May at 6.30pm on RT One an...

13/05/2026

VEON Delivers Strong Start to 2026 - 1Q26: Revenue: +17.0%, EBITDA +17.7%, Digital Surges +57.7% to 25.2% of Total Revenue

13 May 2026 VEON Delivers Strong Start to 2026 1Q26: Revenue 17.0%, EBITDA 17...

13/05/2026

How a neon windmill from A League of Their Own ended up in a dogs home

Thousands of props donated from Skys longest-running original seriesWednesday 13 May 2026 How a neon windmill from A League of Their Own ended up in a dogs'...

13/05/2026

Inter Venezuela Taps Harmonic for PON-Based Mobile Backhaul Service to Support 5G Growth

SAN JOSE, Calif. - May 13, 2026 - Harmonic (NASDAQ: HLIT) today announced that I...

13/05/2026

Tradfluencer - The Sharon Shannon Story

A definitive portrait of one of Ireland's most influential musicians New TV documentary airs Monday 18 May on RT One and RT Player at 9.35pm Watch the...

12/05/2026

It's Your Party of the Year(s): A Look Back at Your Entire Music History on Spotify

Spotify is where fans and artists come together, turning discovery into somethin...

12/05/2026

Black Lion Audio introduce the Auteur 8DAT

Features patented Marco-MMC clocking technology Black Lion Audio's latest release combines the company's expertise in clocking with their renowned p...

12/05/2026

Reason 14 now available

New Track Panel, sequencer upgrades & more Following their recent public beta release, Reason Studios have announced the full release of Reason 14. With the...

12/05/2026

Rohde & Schwarz presents its advanced solutions for power electronics testing at PCIM Expo 2026

Rohde & Schwarz presents its advanced solutions for power electronics testing at...

12/05/2026

Ad-Hoc News: aconnic AG announces improved fund raising plan to support business and refinance debt

aconnic AG (ISIN: DE000A0LBKW6), Munich, has developed a modified fund raising p...

12/05/2026

FOX Announces Schedule for 2026-27 Season

FOX Announces Schedule for 2026-27 Season FOX'S POWERFUL NEW SERIES PIPELINE FUELS A BREAKOUT SEASON WITH RETURNING HITS AND BOLD NEW STORYTELLING ACROSS ...

12/05/2026

Increasing Data Demand, Excellent Networks and Solid Financial Results - Magyar Telekom's Q1 2026 financial results

Customer demand for data continues to grow in the first quarter of 2026 at Magya...

12/05/2026

Wales takes the spotlight in Skys new thrillerPrisoner

The latest drama underscores Sky's continued investment in regional production and Welsh creative talent.Tuesday 12 May 2026 Wales takes the spotlight in S...

11/05/2026

Eurovision at 70: The Biggest Hits, Artists, and Trends From the Iconic Song Competition

As Eurovision fans gear up to celebrate the 70th anniversary of the iconic song ...

11/05/2026

Pelo Spotify, artistas brasileiros geraram aproximadamente R$ 2 bilhes em royalties em 2025

Pela primeira vez na hist ria, o Brasil figura entre os oito maiores mercados de...

11/05/2026

Bastl Instruments showcase the Kalimba

New desktop instrument focused on tactile performance Bastl Instruments have announced the Kalimba, a new desktop instrument that combines physical modellin...

11/05/2026

1010music release the blackbox 2

Compact sampling workstation gains new features 1010music have announced the blackbox 2, a new version of their compact standalone sampler designed for DAWl...

11/05/2026

KOMA Elektronik Monoplex Eurorack sequencer

Performance-focused sequencer with microtonal control Berlin-based KOMA Elektronik have announced Monoplex, a new 42HP Eurorack sequencer designed for hands...

11/05/2026

IK Multimedia launch the Tonex One+

Boasts wireless control from mobile devices The latest iteration of IK Multimedia's compact amp and effects modelling pedal expands on the capabilities ...

11/05/2026

Transfigured Orchestra Vol 3: Cinema Brass from Sonora Cinematic

Spans traditional orchestral and experimental sounds Sonora Cinematic have recently released the third instalment in their Transfigured Orchestra series, de...

11/05/2026

SUPERBOOTH 2026 Video Show Reports

Our exhibition coverage Watch all our SUPERBOOTH 2026 video coverage in one place. Check back to this page regularly as we will be updating with more video ...