LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.
Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect
Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.
Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.
One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight
Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.
LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.
Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.
This process was executed continuously and maintained identical lighting conditions at both locat
Most recent headlines
27/01/2021
From 28th January to 25th March, Plug-in Collective members can download DAW Cassette - which otherwise retails for $40 - for free, and get a 40% discount in th...
27/01/2021
Ten public service broadcasters join EBU initiative to give audiences access to ...
27/01/2021
Russell Wise is Senior Vice President of Sales and Marketing at Digital Nirvana.
Author:BROADCASTPRO ME Media companies are in a race to create volumes of com...
27/01/2021
SAN JOSE, Calif., January 26, 2021 --- Cisco has scheduled a conference call for Tuesday, February 9, 2021, at 1:30 PM (PT); 4:30 PM (ET) to announce its second...
27/01/2021
Big Thiefs Adrianne Lenker Encourages Students to Find Their Own Currency of Suc...
27/01/2021
Dusko Goykovich Receives Berklee Master of Global Jazz Award Goykovich, whose rich melodic phrasing influenced numerous players in global jazz, was honored fo...
27/01/2021
Over 250 Students and Alumni Perform Justin Timberlakes Say Something Watch the monumental #BerkleeTogether Concert Series event on January 27 at 8:00 p.m. ET.
...
27/01/2021
Jennifer Lopez's Performance at President Biden's Inauguration Orchestra...
27/01/2021
Partnership unlocks the power of IP contribution from anywhere with the MediaCen...
27/01/2021
ERA DIGITAL MUZIK AWARDS (EDMA) 2020' MENGUMUMKAN PEMENANG DI NORMA BAHARU
Date Released:27 Jan 2021
Share
Tweet
MENGENAI EDMA 2020'
Malam kemu...
27/01/2021
Genelec The Ones' power Morten Lindberg's stunning immersive studio posted: 27/01/2021
In the world of immersive music recording, no-one has done...
27/01/2021
One-of-a-Kind Dejero App Simplifies Broadcast Setup for Reporters and Anchors Wo...
27/01/2021
Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV ...
27/01/2021
Tegna named Jonathan Forsythe managing editor, giving him responsibility for expanding its Verify brand of reporting aimed at stopping the spread of misinformat...
27/01/2021
Karen Bailey was promoted to executive VP of original programming at Starz....
27/01/2021
The E.W. Scripps Co. named Jon Marks chief research officer for its new national television network business, effective immediately....
27/01/2021
Nielsen and station owner American Spirit Media said they reached an agreement to provide certain services in some of the markets where American Spirit operates...
27/01/2021
Time spent streaming in the fourth quarter jumped 44% from a year ago, according to Conviva's State of Streaming report....
27/01/2021
AT&T reported a loss in the fourth quarter as the pandemic continues to impact the company's media operations....
27/01/2021
A survey by TiVo found that some viewers were subscription hopping, adding and dropping the growing array of video streaming services as those viewers spend m...
27/01/2021
Commercials in the upcoming Super Bowl are virtually sold out, according to spokesperson for ViacomCBS....
27/01/2021
Video ad platform Unruly said it launched a suite of self-service tools that let publishers package, price and sell programmatic over-the-top and connected TV i...
27/01/2021
Computer monitors with professional level performance are now available for a small fraction of the traditional price. We asked four freelance content creator...
27/01/2021
According to the BBC, using green hydrogen instead of diesel twinset generators ...
27/01/2021
New production arm will be led by Katie Hearn and focus on outside production and live streams
By Jenny Priestley
Published: January 27, 2021
New productio...
27/01/2021
Written on 27 Jan 2021
The collaboration will enable high-performance connecti...
27/01/2021
Ottawa, Canada, January 27th 2021 - While Chinese communities traditionally look forward to their New Year festivities in February, Chinese broadcaster CCTV sti...
27/01/2021
Ottawa, Canada, January 26th 2021 - The South American broadcast market has seen many changes over the last decade, with new channels and platforms springing up...
27/01/2021
Mo-Sys forges AR partnership with VividQ
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=https://cr...
27/01/2021
Archiware releases Version 6.0 of the P5 Software Suite with LTFS as Native Arch...
27/01/2021
Rohde & Schwarz Supports Egyptian National Media Authority in Major DVB-T2 Trans...
27/01/2021
ATEME Makes Video-Compression History with Emmy Awards Triple Crown
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb...
27/01/2021
Ma Rainey's Black Bottom Cinematography (with Tobias Schliessler ASC) GCS256
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c56...
27/01/2021
Post Break's How To PNYA Highlights the Organization's Work in Helping...
27/01/2021
Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV ...
27/01/2021
SMPTE Earns Two 2020 Emmy Awards for Technology and Engineering
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg...
27/01/2021
CBC Radio Vice President Brian Maloney was inducted into the Specs Howard School of Media Arts Hall of Fame on November 14, 2020.
CBC Radio Vice President Bria...
26/01/2021
LONDON-IBC is now accepting submissions for the Accelerator Media Innovation Program 2021, which highlights R&D projects that attempt to solve business and tech...
26/01/2021
ATLANTA-TiVo and Pindrop, a voice authentication and fraud detection company, have announced a partnership with the goal of providing streamlined content discov...
26/01/2021
LOS ANGELES-The County of Los Angeles Department of Public Health has issued an updated guideline for TV production protocols during the COVID-19 pandemic, as L...
26/01/2021
WASHINGTON-After raising more than $80.9 billion thus far, the FCC's C-band auction is set to continue with the assignment phase scheduled to begin on Feb. ...
26/01/2021
LOS ANGELES-The Television Academy Foundation is launching a new internship program designed to promote diversity in the unscripted/reality TV sector of the ent...
26/01/2021
NEWARK, N.J.-Panasonic's Kairos next-generation IT/IP live production platform was recently installed at LiveX, a production and broadcast company, as an ef...
26/01/2021
Epistemix Software Modeling Offers Insights on Fan Attendance Variables on COVID...
26/01/2021
Flowics Powers Live Graphics, Content for Linear and Digital Broadcasters By Kristian Hernandez, Associate Editor
Tuesday, January 26, 2021 - 10:45 am
Prin...
26/01/2021
NESN Keeps Its Eye on the 4K HDR Ball With Launch of New Studio The 4K HDR-ready studio launches ahead of 4K HDR Red Sox game productions in 2021 By Jason Dach...
26/01/2021
Park City, UT - Sundance Institute today announced the latest additions to the programming slate of the 2021 Sundance Film Festival, which kicks off Thursday, J...
26/01/2021
SHORTLISTS ANNOUNCED
Today the World Photography Organisation announces the shortlisted photographers in the Student and Youth competitions of the Sony World P...
26/01/2021
New 50.1-megapixel (approx., effective) full-frame stacked Exmor RS CMOS image sensor in combination with an upgraded BIONZ XR imaging processing engine with ...
LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.
