
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
15/05/2026
Last night, the Spotify Podcast Awards in Mexico returned to the country's capital. Now in its second year, the evening honors creators whose voices are hel...
15/05/2026
Rebranded show announced
Ahead of their 2026 return, Music Expo have announced that they have now officially changed their name to the MONO Music Conference...
15/05/2026
Fuzz pedal joins UK companys line-up
UK-based pedal makers Buzzing Bugs Audio Devices have recently unveiled their latest creation, the Bolster. Said to pay...
15/05/2026
Join Calrec at MPTS 2026 | May 13-14 | Stand A40 | Olympia, London We're looking forward to meeting up with customers and partners at this year's Media ...
15/05/2026
The six-part series is a co-commission with BritBox and Sony Pictures Television...
15/05/2026
Against that backdrop, IAB UK has added retail media to its Gold Standard. Jan Pitt, Commercial Director at ABC, spoke with Liv McCullagh, Retail Media Lead at ...
15/05/2026
Further to RT 's statement released yesterday and in the interest of full transparency, with the full permission of Derek Mooney, we are now publishing the ...
14/05/2026
At Spotify, we're focused on making every listening experience feel intentio...
14/05/2026
Spotify recently welcomed songwriters, artists, executives, and music students t...
14/05/2026
New articulations, ostinatos, Motion Scoring Articulation Sets & more
Sonuscore's flagship cinematic string library has just been treated to a significa...
14/05/2026
World-class studio opens on T rkiye's Aegean coast
P r Recording & Residence have announced their official opening, introducing a new world-class reside...
14/05/2026
Now supports channel layouts up to 9.1.6
Nugen Audio have just released an update for their AI-powered dialogue intelligibility and compliance tool. Set to ...
14/05/2026
New recordings & one-key chord tool
UVI have just announced the release of Orchestral Suite 2, a ground-up redesign of their all-in-one symphonic orchestra ...
14/05/2026
Two new arrivals & expanded factory content
Rob Papen's all-encompassing plug-in and virtual instrument collection has just been treated to another upda...
14/05/2026
Embed QR codes into DAW sessions
FSK Audio's latest plug-in doesn't process audio, but serves as an organisational tool that allows QR codes to be e...
14/05/2026
Rohde & Schwarz transforms spectrum complexity into situational awareness and ef...
14/05/2026
Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled...
14/05/2026
Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO...
14/05/2026
Code of Silence has won the BAFTA for Best Drama Series at Sunday night's ceremony at the Royal Festival Hall.
The series, starring Rose Ayling-Ellis and w...
14/05/2026
Vivid Broadcast was embracing remote production long before it became the industry norm. Now, with Calrec's True Control 2.0-enabled Argo M and Type R conso...
14/05/2026
Comscore Reports First Quarter 2026 ResultsRESTON, Va., May 14, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evaluating...
14/05/2026
RT is today publishing the earnings of its top 10 highest-earning presenters for 2025, ahead of the publication of RT 's Annual Report 2025 later this year...
14/05/2026
What can I watch on UKTV and stream on U this week?
This week on UKTV and the free streaming service U, viewers can watch a range of new and returning programm...
14/05/2026
The high-stakes chase thriller from Oscar- and BAFTA-nominated writer Matt Charm...
14/05/2026
Back From The Brink airs Sunday 17 May and Sunday 24 May at 6.30pm on RT One an...
13/05/2026
13 May 2026
VEON Delivers Strong Start to 2026 1Q26: Revenue 17.0%, EBITDA 17...
13/05/2026
Thousands of props donated from Skys longest-running original seriesWednesday 13 May 2026
How a neon windmill from A League of Their Own ended up in a dogs'...
13/05/2026
SAN JOSE, Calif. - May 13, 2026 - Harmonic (NASDAQ: HLIT) today announced that I...
13/05/2026
A definitive portrait of one of Ireland's most influential musicians
New TV documentary airs Monday 18 May on RT One and RT Player at 9.35pm
Watch the...
12/05/2026
Spotify is where fans and artists come together, turning discovery into somethin...
12/05/2026
Features patented Marco-MMC clocking technology
Black Lion Audio's latest release combines the company's expertise in clocking with their renowned p...
12/05/2026
New Track Panel, sequencer upgrades & more
Following their recent public beta release, Reason Studios have announced the full release of Reason 14. With the...
12/05/2026
Rohde & Schwarz presents its advanced solutions for power electronics testing at...
12/05/2026
aconnic AG (ISIN: DE000A0LBKW6), Munich, has developed a modified fund raising p...
12/05/2026
FOX Announces Schedule for 2026-27 Season FOX'S POWERFUL NEW SERIES PIPELINE FUELS A BREAKOUT SEASON WITH RETURNING HITS AND BOLD NEW STORYTELLING ACROSS ...
12/05/2026
Customer demand for data continues to grow in the first quarter of 2026 at Magya...
12/05/2026
The latest drama underscores Sky's continued investment in regional production and Welsh creative talent.Tuesday 12 May 2026
Wales takes the spotlight in S...
11/05/2026
As Eurovision fans gear up to celebrate the 70th anniversary of the iconic song ...
11/05/2026
Pela primeira vez na hist ria, o Brasil figura entre os oito maiores mercados de...
11/05/2026
New desktop instrument focused on tactile performance
Bastl Instruments have announced the Kalimba, a new desktop instrument that combines physical modellin...
11/05/2026
Compact sampling workstation gains new features
1010music have announced the blackbox 2, a new version of their compact standalone sampler designed for DAWl...
11/05/2026
Performance-focused sequencer with microtonal control
Berlin-based KOMA Elektronik have announced Monoplex, a new 42HP Eurorack sequencer designed for hands...
11/05/2026
Boasts wireless control from mobile devices
The latest iteration of IK Multimedia's compact amp and effects modelling pedal expands on the capabilities ...
11/05/2026
Spans traditional orchestral and experimental sounds
Sonora Cinematic have recently released the third instalment in their Transfigured Orchestra series, de...
11/05/2026
Our exhibition coverage
Watch all our SUPERBOOTH 2026 video coverage in one place. Check back to this page regularly as we will be updating with more video ...