Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Europe Stories

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

07/08/2025

Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, Redefining In-Car Entertainment Experience

July 8 2025, 22:30 (PDT) Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, R...

18/07/2025

The Sky Arts Awards Are Back, Live From The Roundhouse This September

Friday 18 July 2025 Credit: Marc Sethi The Sky Arts Awards will return on 16 September, once again taking place at the iconic Roundhouse in London. Produced b...

18/07/2025

2025-07-18

This month, players can dive into special crossover events featuring SpongeBob SquarePants in Snake.io+ and Crossy Road Castle, available exclusively on Apple A...

18/07/2025

Hurling Fans Flock Together for a Night of Craic agus Ceol on RT's Up For The Match this Saturday night

Up for the Match brings the fun, the passion-and a bit of Riverdance- tomorrow n...

17/07/2025

Audiobooks+ Brings More Choice and Flexibility to Spotify Premium Subscribers

Spotify's goal with audiobooks is to help grow the publishing industry and create the best possible experience for booklovers, which is why we're launch...

17/07/2025

SES Receives All Required Regulatory Approvals to Complete Intelsat Acquisition

Luxembourg, 14 July 2025 - SES received the final regulatory approvals for the SES-Intelsat transaction, including the US Federal Communications Commission. O...

17/07/2025

Riedel Communications Powers Handa Opera on Sydney Harbour with Integrated Network and Comms Solutions

Wuppertal July 17, 2025 Riedel Communications Powers Handa Opera on Sydney Har...

17/07/2025

Fox Corporation Executives to Discuss Fourth Quarter and Full Year Fiscal 2025 Financial Results Via Webcast

Fox Corporation Executives to Discuss Fourth Quarter and Full Year Fiscal 2025 F...

17/07/2025

Dalet Showcases the Tools and Vision to Lead Media and Entertainment's Next Chapter at IBC 2025

Dalet, a leading technology and service provider for media-rich organizations, w...

17/07/2025

Tune into summer on RT Radio 1 | A season of stories, sounds, and something for everyone

The summer is here and RT Radio 1 has unveiled a lively seasonal lineup, packed...

16/07/2025

Spotify's Editors Pick Their Best Podcasts of the Year (So Far)

Spotify's podcast editorial team is always on the hunt for shows and episodes that spark conversation, push boundaries, and keep us coming back for more. As...

16/07/2025

Clear-Com's EQUIP Boosts Ride Efficiency, Safety, and Communication at Merlin Theme Parks

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

16/07/2025

IBC 2025

Join us at IBC this September and take control of your content. Discover how we're bringing a new level of purpose and precision to the application of AI in...

16/07/2025

Sky and ITV extend multi-year content and platform partnership

Wednesday 16 July 2025 Sky and ITV today announced an extension of their long-standing partnership, which will see ITV's content and services remain seamle...

16/07/2025

Living with the Lions: What really happens on tour

Sky Sports lifts the lid on Lions life with hilarious behind-the-scenes mockumentaryWednesday 16 July 2025 To view this content, please enable our use of cooki...

16/07/2025

2025-07-16

CULVER CITY, CALIFORNIA Apple TV+ today earned a record-breaking 81 Emmy Award nominations across 14 hit Apple Original titles for this year's 77th Emmy Awa...

15/07/2025

Open Call: Resilience Incubator for Independent Media in Brazil and Colombia

Independent media outlets in Brazil and Colombia are invited to apply for a new programme aimed at strengthening the long-term resilience of journalism in the f...

15/07/2025

A travs de una nueva colaboracin, usuarios de DiDi en nueve pases de Latinoamrica podrn acceder a Spotify Premium

Spotify une fuerzas con DiDi, la app l der en servicios de movilidad, delivery y...

15/07/2025

SES Successfully Prices 1 Billion Dual-Tranche Bond Offering with Strong 5.5x Oversubscription

NOT FOR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN THE UNIT...

15/07/2025

U&GOLD to bring Fawlty Towers: The Play to TV audiences for the first time

U&GOLD has acquired the broadcast rights for Fawlty Towers: The Play (1x120'). Recorded during the show's run at the West End with its original cast, Fa...

15/07/2025

TV SIM builds for the future with high efficiency transmitter from Rohde & Schwarz

TV SIM builds for the future with high efficiency transmitter from Rohde & Schwa...

15/07/2025

Harmonic to Showcase Breakthrough Video Streaming and Broadcast Delivery Innovations at IBC2025

Harmonic's Hybrid, AI-Powered and Live Sports Streaming Innovations are Key ...

15/07/2025

The Next Level 4099 CORE+ Instrument Microphone

The well-known and well-loved 4099 has been completely revamped. It features amazing CORE+ technology, which eliminates distortion and extends dynamic range, a ...

15/07/2025

Comscore Partners with HyphaMetrics to Launch Advanced Person-Level Audience Measurement and CTV Program-Level Reporting

Comscore Partners with HyphaMetrics to Launch Advanced Person-Level Audience Mea...

15/07/2025

All Ireland Football semi-finals and Tailteann Cup Final draw large audiences to RT

Peak audiences of over half a million tune into both Kerry v Tyrone and Donegal ...

15/07/2025

PROTON Announces Production Facility Expansion Ahead of IBC2025

PROTON Announces Production Facility Expansion Ahead of IBC2025 posted: 15/07/2025 Proton Announces Production Facility Expansion Ahead of IBC2025 Alongs...

14/07/2025

RT Launches New Look Weather Forecasts

Enhancing Public Service Broadcasting with Innovation, Accuracy & Sustainability New regional detail and local towns featured...

11/07/2025

Superman' Filmmaker James Gunn Reveals the Playlists Inspired by Your Favorite Characters

If you've ever wondered what might be playing in Clark Kent's headphones...

11/07/2025

AI and Multimedia Authenticity Standards Collaboration

AI and Multimedia Authenticity Standards Collaboration launches two papers to guide the future of AI integration, today at the AI for Good Global Summit The...

10/07/2025

Taliban repression silences award-winning Afghan woman journalist

The current holder of the prestigious Thomson Foundation Young Journalist of the Year Award has been forced to stop reporting over fears for her safety in Afgha...

10/07/2025

A New Report Puts Aussie Artists in the Spotlight

Spotify is turning up the volume on Australian music with a multipronged initiative designed to highlight the dominance of Australian artists on the global stag...

10/07/2025

Spotify Toasts Oasis's Return With Exclusive Ways for Fans to Get Closer to the Music That Defined a Generation

This is not a drill: Oasis is back on the road-marking its first live performanc...

10/07/2025

Spotify and Youth Music Open Doors for Future Artists

The music industry depends on fresh ideas, bold voices, and emerging talent. Yet across the U.K., too many young musicians lack the space to develop their craft...

10/07/2025

VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing

10 Jul 2025 VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing Kyiv, New York, Dubai, and Philadelphia - July 10, 2025 - VEON Ltd. (Nasdaq:...

10/07/2025

From Treehouses to the Deep Sea: A First Look at Sky Kids New Adventures

Thursday 10 July 2025 The Very Small Creatures Jaime's Treetop Tales Emerald BooSnoo! Christmas Mashup Pip & Posy's Spooktacular Party The Very Sm...

10/07/2025

Millions of Sky customers set to enjoy even bigger rewards as Sky VIP loyalty programme gets a major upgrade

Thursday 10 July 2025 Brand new rewards are coming to Sky customers, with free ...

10/07/2025

Comscore Achieves Full JIC Certification for National TV Measurement Including Persons-Based Data

Comscore Achieves Full JIC Certification for National TV Measurement Including...

09/07/2025

Sky becomes UKs fastest major broadband provider with launch of new 5 Gbps Full Fibre speed and WiFi 7 hub

Wednesday 9 July 2025 Sky Broadband now has the UK's fastest broadband spee...

09/07/2025

2025-07-09

CUPERTINO, CALIFORNIA Apple today announced Jeff Williams will transition his role as chief operating officer later this month to Sabih Khan, Apple's senior...

08/07/2025

MediaSafe Africa: A New Digital Safety Resource for Journalists

In an era where digital threats to journalists are becoming increasingly aggressive and widespread, MediaSafe Africa launches as a vital online resource to help...

08/07/2025

Spotify's Our Game, Our Sound' Campaign Champions Community and Joy in Women's Football

This summer, as the energy builds for one of the biggest moments in women's ...

08/07/2025

Richard Watsham to depart UKTV following highly successful 14-year tenure

UKTV today announces that Richard Watsham, Chief Creative Officer at UKTV and Global Director of Acquisitions for BBC Studios/UKTV, has decided to step down fro...

08/07/2025

Harmonic Sets DOCSIS 4.0 Record with 14 Gbps Downstream Speed at CableLabs Interoperability Event

SAN JOSE, Calif. - July 8, 2025 - Harmonic (NASDAQ: HLIT) today announced a reco...

08/07/2025

Arvato Systems optimizes customer communication with AOK Niedersachsen

Arvato Systems Optimizes Customer Communication with AOK Niedersachsen New project in the statutory health insurance sector Arvato Systems and AOK Niedersach...