Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

05/03/2026

Harmonic Accelerates Streaming and Broadcast Transformations at the 2026 NAB Show

SAN JOSE, Calif. - March 5, 2026 - At the 2026 NAB Show, Harmonic (NASDAQ: HLIT)...

05/03/2026

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximic Political Audiences

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximi...

04/03/2026

Spotify A/Presenta Brings Fans Closer to Artists' Creative Process in Latin America, Starting With ROSALA

For many fans, a song's backstory can be just as compelling as the final pro...

04/03/2026

Spotify Kicks Off Our 20th Anniversary at SXSW With a Celebration of Artists, Creators, and Fans

In 2006, Spotify was founded on the belief that technology could bring artists a...

04/03/2026

Spotify and Coca-Cola Saddle Up for a Rhinestone Cowboy Experience at the Houston Rodeo

Spotify is back on the ground for the Houston Livestock Show and Rodeo, and we&#...

04/03/2026

Spotify Doubles Down on Investments in Australian Fan Discovery of Homegrown Aussie Talent

Spotify had an energizing week in Sydney, Australia, filled with powerful conver...

04/03/2026

FKA twigs and Jordan Hemingway Explore the Making of HARD' in Episode Two of Directed By'

Earlier this year, we launched Directed By, a documentary-style series that pull...

04/03/2026

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance In a joint 6G AI proof-of-concept demonstration, the CMX500 one-box tester from ...

04/03/2026

SES publishes 2025 Annual Report

Luxembourg, 3 March 2026 - SES S.A. has today published its 2025 Annual Report, following the announcement of the company's full year financial results for ...

04/03/2026

Transforming Africa's Future Farmers: Satellite-Enabled IoT Powers Data-Driven Agribusinesses

Luxembourg, March 3, 2026 - SES, a leading space solutions company, along with I...

04/03/2026

VEON Partners with GSMA Innovation Fund to Accelerate Digital Innovation in Pakistan and Bangladesh

04 Mar 2026 VEON Partners with GSMA Innovation Fund to Accelerate Digital Innov...

04/03/2026

VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open RAN, AI Collaboration

04 Mar 2026 VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open...

04/03/2026

Sky Sports unveils plans for 2026 Formula 1 coverage

Wednesday 4 March 2026 Sky Sports unveils plans for 2026 Formula 1 coverage Sky Sports is preparing for one of the most highly anticipated F1 seasons in recen...

03/03/2026

How Multi-Format Readers' Are Redefining Reading in the UK's National Year of Reading

For many, finding time or headspace to pick up a book can feel out of reach, but...

03/03/2026

Rohde & Schwarz and Realtek demonstrate first test solution for Bluetooth LE High Data Throughput (HDT)

Rohde & Schwarz and Realtek demonstrate first test solution for Bluetooth LE Hi...

03/03/2026

Clear-Com Supplies Cloud-based Communications System for SaxaVord Spaceport

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

03/03/2026

Full Year 2025 Results

Luxembourg, 2 March 2026 -- SES S.A. fully consolidates Intelsat from 17 July 2025 and announces financial results for the year ended 31 December 2025 FY25 Pe...

03/03/2026

RT is Supporting 20 Arts and Cultural Events all over Ireland this March

RT is proud to support a rich and diverse programme of arts and cultural events taking place across Ireland throughout March 2026. This month brings a remarkab...

03/03/2026

VEON and MeetKai Expand Collaboration to Explore Sovereign AI Infrastructure Partnerships

03 Mar 2026 VEON and MeetKai Expand Collaboration to Explore Sovereign AI Infra...

03/03/2026

Ryan Reynolds and Rob Mac land first ever live commentary gig exclusively on Sky Sports for Wrexham vs Swansea

Tuesday 3 March 2026 Ryan Reynolds and Rob Mac land first ever live commentary ...

03/03/2026

The Dyers Caravan Park reopens for a second season after a hit launch on Sky

Tuesday 3 March 2026 The Dyers' Caravan Park reopens for a second season after a hit launch on Sky The Dyers' Caravan Park JPEG (510KB) Sky books a ...

03/03/2026

Vyve Broadband Selects Harmonic for Network Modernization

Harmonic's cOS Virtualized Broadband Platform Simplifies Network Operations, Lowers Hardware Dependency and Enables Seamless DOCSIS and Fiber Growth SAN JO...

03/03/2026

Comscore to Announce Fourth Quarter and Full Year 2025 Financial Results

Comscore to Announce Fourth Quarter and Full Year 2025 Financial ResultsRESTON, VA, March 3, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for plannin...

03/03/2026

2026-01-30

Self-taught on iMovie, Hanagami transitioned to Final Cut Pro in 2009, discovering that professional tools could give him full creative control over how his wor...

03/03/2026

RT Media Sales: Spry Finance renews Marty In The Morning lyric fm sponsorship for a fourth year

RT Media Sales has announced Spry Finance has renewed it's sponsorship of M...

02/03/2026

Rohde & Schwarz demonstrates FR1-FR3 carrier aggregation, advancing 6G readiness

Rohde & Schwarz demonstrates FR1-FR3 carrier aggregation, advancing 6G readiness Rohde & Schwarz and Qualcomm Technologies, Inc. have reached another pivotal ...

02/03/2026

aconnic and Arqit join forces to present the first quantum-safe industrial OT security gateway firewall at Mobile World Congress 2026

aconnic AG (ISIN: DE000A0LBKW6), Munich, and Arqit Quantum Inc. (Nasdaq: ARQQ, A...

02/03/2026

SES and Africa Mobile Network Reach Milestone: Connecting 5.8 Million in DRC, Expanding Rural Coverage

Luxembourg, February 26, 2026 - SES and Africa Mobile Network (AMN) have expande...

02/03/2026

Saturday Night Live UK announces writing team

Monday 2 March 2026 Saturday Night Live UK announces writing team L-R: Jonno Johnson; Charlie Skelton; Celya AB; Omar Badawy; Gr inne Maguire; Laura Claxton; ...

27/02/2026

Gorillaz Invites Fans Into Its World With Exclusive Spotify Experience and London Mural Quest

Since its inception, Gorillaz has been known for blending art with genre-bending...

27/02/2026

Find Your Next Great Listen With Spotify's New Audiobook Charts

This week, Spotify introduced Audiobook Charts for the U.S. and U.K. The charts make it easy to discover your next favorite book by showing what's popular a...

27/02/2026

Rohde & Schwarz and Viasat to collaborate on NB-NTN IoT test plan for connectivity via satellite

Rohde & Schwarz and Viasat to collaborate on NB-NTN IoT test plan for connectivi...

27/02/2026

Designing AI based features in the MSC

In media technology, big features often steal the spotlight - AI integrations, cloud transformations, automation frameworks. But for the people who use these to...

27/02/2026

Has Video outgrown your DAM?

Digital Asset Management systems sit at the heart of most marcoms operations. They centralise content, organise it, and make it discoverable. Integrated with th...

27/02/2026

NAB

The AI Wild West comes to NAB 2026 and Blue Lucy is bringing the Sheriff The AI Wild West is here, and media organisations are feeling the heat. On Booth W23...

27/02/2026

No-holds-barred feature documentary Billy Idol Should Be Dead coming to Sky Arts on 26 March

A deeply personal, uncompromising portrait of the legendary punk rock iconFriday...

27/02/2026

RT Media Sales: SIRO to sponsor Home of the Year on RT One

One of Ireland's favourite lifestyle shows Home of the Year, returns for its 12th series and will be proudly sponsored by SIRO. The brand-new series will ai...

27/02/2026

Our Farm: A GIY Story lands on RT One and RT Player from March 3

Our Farm: A GIY Story lands on RT One and RT Player from March 3 From walled garden to community farm, new six-part series captures the unfiltered realities...

27/02/2026

Seachtain na Gaeilge 2026 ar RT

Note: English version included below the Irish language version. Seachtain na Gaeilge 2026 ar RT A Ghaeilge mo cheol th ' T feachtas athnuaite i n...

26/02/2026

Rohde & Schwarz awarded contract by Israel Airports Authority for QPS201 security scanners

Rohde & Schwarz awarded contract by Israel Airports Authority for QPS201 securit...

26/02/2026

Rohde & Schwarz highlights its unique CMX500 one-box tester tailored for NTN testing at MWC Barcelona 2026

Rohde & Schwarz highlights its unique CMX500 one-box tester tailored for NTN tes...

26/02/2026

Rohde & Schwarz high-efficiency transmitter powers next-gen broadcast services in Serbia

Rohde & Schwarz high-efficiency transmitter powers next-gen broadcast services i...