Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Europe Stories

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

04/07/2025

Spotify Partners With The Reading Agency to Bring the Summer Reading Challenge to Life Through Audio

The Summer Reading Challenge has inspired children across the U.K. to embrace a ...

04/07/2025

Official trailer revealed for new season of BAFTA-winning Sky Original comedy Mr Bigstuff, coming 24 July

Friday 4 July 2025 Watch the trailer here https://youtu.be/Od5WpvWmDr8 Further...

04/07/2025

Join RT Radio 1 for The Pitch, a new series exploring the heart of Ireland's GAA Clubs

The Pitch comes to RT Radio 1 airwaves this Sunday at 7pm. The Pitch is a brand...

03/07/2025

Introducing: New Carts

For our Vario-Jib, as well as for a repertoire of weights, we now have carts that make transport easier...

03/07/2025

Introducing: Slider Drive Unit

One of our latest innovations: Slider Drive Unit! Our Vario Slider not only comes with improvements and new features, but also with its own drive unit! Our i...

03/07/2025

Introducing: ARRI EVO 360

The 360 EVO lives up to its name: 360-degree rotation not only on the pan axis, but also on the roll axis, enables filmmakers to take their creative visions eve...

03/07/2025

Panther at BSC EXPO 2025

What a buzzing few days at BSCExpo in London! We were thrilled to connect with so many talented professionals from the world of cinematography. A huge thank ...

03/07/2025

"The whole rig had to be detachable mid-episode

ADOLESCENCE - Shot with Panther Tower"The whole rig had to be detachable mid-episode Netflix limited drama series Adolescence has been gaining attentio...

03/07/2025

** MEDIA ALERT ** Shonen Jump Store Hosting Los Angeles Pop-up During Anime Expo 2025

** MEDIA ALERT ** Shonen Jump Store Hosting Los Angeles Pop-up During Anime Exp...

03/07/2025

Sky Arts Unveils New Mozart Season, Celebrating the Legacy of Classicals Greatest Maestro

Thursday 3 July 2025 David Harewood and Matthew Broome in Mozart: Genius for Hi...

03/07/2025

Sky announces 2025 Sky WNT Fund Recipients

The Sky WNT Fund supports Womens National Team players with a 30,000 bursaryThursday 3 July 2025 Sky Ireland has announced the four recipients of the 2025 Sky...

02/07/2025

NAB 2025: Calrec expands ecosystem providing ultimate flexibility

Calrec expands ecosystem at NAB 2025 giving broadcasters access to dynamic workflows and ultimate flexibility Helping broadcasters meet the shifting needs of me...

02/07/2025

VEON Raises USD 200 Million in Private Bond Placement

02 Jul 2025 VEON Raises USD 200 Million in Private Bond Placement Dubai, July 1, 2025: VEON Ltd. (Nasdaq: VEON), a global digital operator ( VEON ), announces ...

02/07/2025

Dom Chinea opens his Cornish Workshop for new series on U&YESTERDAY and U

Brand new factual series follows mechanic and self-taught engineer Dom Chinea as he makes the move of his life to the far west of Cornwall UKTV today announces...

02/07/2025

Rohde & Schwarz acquires ZES ZIMMER Electronic Systems GmbH and expands its T&M portfolio for power electronics

Rohde & Schwarz acquires ZES ZIMMER Electronic Systems GmbH and expands its T&M ...

02/07/2025

Riedel Communications Launches RefSuite Ecosystem for Sports Officiating, Coaching, and Production

Wuppertal July 2, 2025 Riedel Communications Launches RefSuite Ecosystem for S...

02/07/2025

ABC Appoints New Chair

Andrew will serve as Chair of ABC alongside his role at NED, APL Media, where he supports the executive team with strategic insight and global expansion plans. ...

01/07/2025

ITV Celebrates Best Sunday of 2025 with Code of Silence

The launch of Code of Silence, coupled with the Britains Got Talent semi final, gave ITV its best Sunday night of 2025. The first episode of the new crime dr...

01/07/2025

Romola Garai joins Shaun Evans in ITV thriller BETRAYAL, as filming begins in the North West

ITV and Mammoth Screen have announced the start of filming for Betrayal, a gripp...

01/07/2025

Movicom Selects Clear-Com to Power Communications for Global Live Events

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

01/07/2025

KIT Plugins release NOIZ One Vox

Vocal-processing plug-in joins NOIZ Hub series Launched in 2024, KIT Plugins' NOIZ Hub series was created with the aim of providing a range of professio...

01/07/2025

7 Day Mastering: New course from Mastering.com

New self-paced learning programme announced Mastering.com have announced the availability of a new online course designed to cover the fundamentals of maste...

01/07/2025

cetecom advanced certifies Rohde & Schwarz test solution for the verification of Next Generation eCall functionality

cetecom advanced certifies Rohde & Schwarz test solution for the verification of...

01/07/2025

Teresa Smith Announced as Commissioning Editor for Factual Entertainment

RT has announced that Teresa Smith has been appointed Commissioning Editor with responsibility for Factual Entertainment following a public competition. This s...

01/07/2025

RT is Supporting 26 Arts and Cultural Events across Ireland this July

This July, RT is delighted to support Galway International Arts Festival, Earagail Arts Festival in Donegal, Belfast TradFest and 23 other arts and cultural ev...

30/06/2025

Discover Weekly Turns 10: Celebrating 100 Billion+ Tracks Streamed and a Decade of Personalized Discovery

There's nothing quite like the magic of finding music that feels made just f...

30/06/2025

Spotify's Editors Pick Their Best Songs of the Year (So Far)

When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...

30/06/2025

The Forsytes Season 2 Commissioned by MASTERPIECE on PBS

Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season [June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...

30/06/2025

Qu-Bit announce the Bloom v2

Eurorack sequencer module reimagined California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...

30/06/2025

Techivation launch T-De-Esser Pro Mk2

Improved dynamic behaviour, improved audio quality & more Techivation have announced the release of an upgraded edition of their very first premium plug-in,...

30/06/2025

German premiere with live flight demonstration: German industry team showcases electromagnetic combat from the air

German premiere with live flight demonstration: German industry team showcases e...

30/06/2025

The Focusrite Summer Sale is now on

The Focusrite Summer Sale is now on Don't miss unbeatable deals on Scarlett, Vocaster, and more. Whether you're an artist, a producer, or a podcaste...

30/06/2025

Yellowstone origin story 1923 starring Harrison Ford and Helen Mirren comes to RT One and RT Player

All 8 episodes of Season 1 of 1923 will be available on RT Player from Tuesday ...

30/06/2025

Thales 2025 Global Cloud Security Study Reveals Organizations Struggle to Secure Expanding, AI-Driven Cloud Environments

Facebook Twitter LinkedIn 52% report AI security spending is displacing tr...

30/06/2025

Thales Alenia Space to develop SOLiS very-high-throughput laser communications demonstrator

Facebook Twitter LinkedIn Cannes, June 30th, 2025 - Thales Alenia Space, t...

29/06/2025

Roland introduce the Mood Pan

Handpan-inspired instrument announced Roland have announced the launch of the Mood Pan, a unique electronic hand percussion instrument that has been designe...

28/06/2025

Scaler 3.1 update from Scaler Music

Music theory plug-in updated Three months on from the release of the latest version of their renowned music theory plug in, Scaler Music have launched an up...

27/06/2025

Spotify Launches K-Pop Performance Video Series . . . Next Up, TWS

K-Pop remains one of the biggest genres globally, and many fans just can't get enough of it. That's why Spotify has launched a new series of K-Pop perf...

27/06/2025

Family Cybersecurity CEO: Protecting Kids, Parents, and My Sanity From Scams

In our latest blog post, Rafael Rivera highlights the rising threat of online scams, and the important role cybersecurity plays in protecting families across ge...

27/06/2025

Klevgrand introduce Walls reverb plug-in

From grounded realism to bending, impossible geometries Klevgrand have announced the release of a new algorithmic reverb plug-in which they say deconstruct...

27/06/2025

GIK Acoustics: Room EQ Wizard Tutorial

Learn to use REW for room analysis Acoustic treatment is one of the most important factors in any studio, and with the extensive range of products available...

27/06/2025

Soundtheory release Kraftur Focus

Second edition of parallel clipper plug-in announced Soundtheory have announced the launch of Kraftur Focus, a new edition of their parallel clipper plug-in...

27/06/2025

Thales and KONGSBERG to establish new major Defence communications joint venture in Norway

Facebook Twitter LinkedIn Thales, a global high-tech leader, and Kongsberg...

27/06/2025

RTL Group to acquire Sky Deutschland

Friday 27 June 2025 Combination of RTL Deutschland and Sky Deutschland (Germany, Austria, Switzerland) to create a unique proposition in entertainment, sports ...

26/06/2025

AgileTV will develop the TV service for LIWEST in Austria

Bilbao Linz, June 26th 2025 - AgileTV, a European leader in TV and video technology solutions, has signed an agreement this week with the Austrian telco LIWES...

26/06/2025

Ad-hoc News: aconnic AG places capital increase and postpones publication of annual report until completion of the transaction

aconnic AG (ISIN: DE000A0LBKW6), Munich, has resolved, based on the decisions ma...

26/06/2025

KRK launch Kreate Series monitors

Three new entry-level models introduced Catering to everything from casual listening to professional content creation, KRK's new Kreate Series monitors ...