Sony Pixel Power calrec Sony

ARRI synchronizes video and light for the LIPS research project

28/10/2020

LIPS stands for Live Interactive PMSE (Program Making and Special Events) Services. It is a research project funded by the German Federal Ministry for Economic Affairs and Energy (BMWi), in which several industrial and institutional partners work together on a professional production network. It is about the synchronization of audio, video, and light with extremely low latency to create the most immersive user experience possible. The LIPS project aims to interactively and immersively link live events performed at different locations by using new platforms and technical possibilities. The overall goal is to identify-based on newly developed IP-based audio/video production equipment-solutions to improve the access and participation of rural areas on creative, cultural, and political operation of metropolitan areas and vice versa. LIPS also makes significant contributions to inclusion, since it provides solutions which allow people with disabilities who are unable to travel to participate holistically and immersively in events.

LIPS consortiumTo improve the immersive audio/visual experience for the connected users and to develop the technological background for connecting and merging various devices and locations into one production network, several parties had to bring in their individual know-how. Therefore the LIPS consortium was founded in 2018. It consists of the companies Sennheiser, TVN, Smart Mobile Labs, and ARRI, as well as the institutions Leibnitz University Hannover, Fraunhofer Heinrich Hertz Institute, and Friedrich Alexander University Erlangen-Nuremberg. Each partner has a different focus for the project. ARRI was responsible for cameras and lighting with equipment and services, explains Hermann Popp, Systems Architect at ARRI and technical project manager for LIPS. Within ARRI, numerous colleagues were involved with fundamental contributions.

Numerous ARRI colleagues were involved with LIPS, including Hermann Popp, Systems Architect

Use case networked music performance As a use case, the idea of realistic joint performances of musicians at remote geographic locations was born. One part of the student band-piano (Victor Ardelean Montelongo) and bass (Hans Koennecke)-was based at the University for Music and Theater Munich (HMTM), the other-drums (Max Dost), guitar (Julian Scarcella), and keyboards (Lukas Blecks)-570 kilometers (354 miles) north in Wedemark, near Hannover, at the Sennheiser headquarters. The playing of the LIPS Brothers took place in joint sessions, so-called field tests, which were transmitted via internet. A virtual window between the two linked rooms was created, which allows a visually and audibly plausible look in almost real-time into the other locations. In addition to the broadcast of video and audio, the lighting at both locations was also continuously adjusted. The goal was to achieve the most immersive and authentic linking of these two exercise rooms. All participants should always have the same impression, says Hermann Popp.

Both locations were equipped with the same setup and were connected via Wide-Area-Network with a data transfer rate of 1 Gbps. In both directions, six audio channels and one video stream as well as the lighting control information were transmitted.

One part of the student band was based in Munich (pictured), the other 570 kilometers (354 miles) north in Wedemark. Two ARRI SkyPanels S60-C provide a solid baselight

Camera and display An immersive bidirectional image path with low latency was required. This related to the camera as well as the display at each side. The software and firmware of the cameras were specifically designed for LIPS by ARRI. These R&D cameras contain the same sensor and image processing like ARRI standard products with color filters matching characteristics of human eye receptors and high contrast capabilities. But they provide native all-IP functionality for image transfer, synchronization, and control. Each sends its image stream out of a 10-Gb/s-capable-Ethernet-copper-cable and, at the same time, receives the remote image stream over IP. A ProRes codec inside the cameras is used for image compression and decompression. Decompressed images were passed to a large format display via a synchronous serial digital interface (SDI) socket. Both cameras in Munich and Wedemark were synchronized via the Precision Time Protocol (PTP) and used the typical protocol stack for media production: Ethernet, IP, UDP, RTP, a media wrapper, and the compressed video payload. With the media wrapper MXF Live, data consistency and a seamless transition across stream and file was achieved.

LIPS aims a calibrated, linear image path from scene to image reproduction. With respect to displays, this required a defined and constant relation between a digital input value and the corresponding output luminance. The standard SMPTE ST 2084 defines a suited relation over a wide dynamic range and with an efficient perception-based quantization. After testing various kinds of displays large-format OLED displays were selected. They are able to provide this characteristic in a constant and adequate way.

Lighting Immersive integration of separate locations is essentially supported by matched lighting. At LIPS, natural available light was maintained as much as possible to preserve a natural vivid live environment and to avoid a studio feeling. To achieve this, available light, the spectral power distribution of light at each location, was measured and processed by a central lighting control. A common target value for both locations with respect to lighting color coordinates and lighting intensity was calculated. The target was achieved by adding some minimal artificial lighting. This was calculated specifically for each site.

This process was executed continuously and maintained identical lighting conditions at both locat
LINK: https://www.arri.com/en/company/arri-news/news-stories/news-stories-20...
See more stories from arri

Most recent headlines

27/01/2021

PLUG-IN COLLECTIVE: DAW CASSETTE

From 28th January to 25th March, Plug-in Collective members can download DAW Cassette - which otherwise retails for $40 - for free, and get a 40% discount in th...

27/01/2021

Ten public service broadcasters join EBU initiative to give audiences access to trusted news from across Europe

Ten public service broadcasters join EBU initiative to give audiences access to ...

27/01/2021

Russell Wise is Senior Vice President of Sales and Marketing at Digital Nirvana.

Russell Wise is Senior Vice President of Sales and Marketing at Digital Nirvana. Author:BROADCASTPRO ME Media companies are in a race to create volumes of com...

27/01/2021

Cisco Schedules Conference Call for Q2FY21 Financial Results

SAN JOSE, Calif., January 26, 2021 --- Cisco has scheduled a conference call for Tuesday, February 9, 2021, at 1:30 PM (PT); 4:30 PM (ET) to announce its second...

27/01/2021

Big Thiefs Adrianne Lenker Encourages Students to Find Their Own Currency of Success

Big Thiefs Adrianne Lenker Encourages Students to Find Their Own Currency of Suc...

27/01/2021

Dusko Goykovich Receives Berklee Master of Global Jazz Award

Dusko Goykovich Receives Berklee Master of Global Jazz Award Goykovich, whose rich melodic phrasing influenced numerous players in global jazz, was honored fo...

27/01/2021

Over 250 Students and Alumni Perform Justin Timberlakes Say Something

Over 250 Students and Alumni Perform Justin Timberlakes Say Something Watch the monumental #BerkleeTogether Concert Series event on January 27 at 8:00 p.m. ET. ...

27/01/2021

Jennifer Lopez's Performance at President Biden's Inauguration Orchestrated by Berklee Alum

Jennifer Lopez's Performance at President Biden's Inauguration Orchestra...

27/01/2021

Avid and Haivision Deliver on Secure Remote IP Contribution in Live Production Environments

Partnership unlocks the power of IP contribution from anywhere with the MediaCen...

27/01/2021

ERA DIGITAL MUZIK AWARDS (EDMA) 2020' MENGUMUMKAN PEMENANG DI ...

ERA DIGITAL MUZIK AWARDS (EDMA) 2020' MENGUMUMKAN PEMENANG DI NORMA BAHARU Date Released:27 Jan 2021 Share Tweet MENGENAI EDMA 2020' Malam kemu...

27/01/2021

Genelec The Ones' power Morten Lindberg's stunning immersive studio

Genelec The Ones' power Morten Lindberg's stunning immersive studio posted: 27/01/2021 In the world of immersive music recording, no-one has done...

27/01/2021

One-of-a-Kind Dejero App Simplifies Broadcast Setup for Reporters and Anchors Working From Home

One-of-a-Kind Dejero App Simplifies Broadcast Setup for Reporters and Anchors Wo...

27/01/2021

Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV Awards: Greatest of All Time

Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV ...

27/01/2021

Jonathan Forsythe Named Managing Editor at Tegna

Tegna named Jonathan Forsythe managing editor, giving him responsibility for expanding its Verify brand of reporting aimed at stopping the spread of misinformat...

27/01/2021

Starz Promotes Karen Bailey to Executive VP, Original Programming

Karen Bailey was promoted to executive VP of original programming at Starz....

27/01/2021

Jon Marks Named Research Head for Scripps' National Nets

The E.W. Scripps Co. named Jon Marks chief research officer for its new national television network business, effective immediately....

27/01/2021

American Spirit Adds Nielsen Services in Some Markets

Nielsen and station owner American Spirit Media said they reached an agreement to provide certain services in some of the markets where American Spirit operates...

27/01/2021

Time Spent Streaming Grew 44% in 4th Quarter: Conviva

Time spent streaming in the fourth quarter jumped 44% from a year ago, according to Conviva's State of Streaming report....

27/01/2021

AT&T Reports Loss in Fourth Quarter

AT&T reported a loss in the fourth quarter as the pandemic continues to impact the company's media operations....

27/01/2021

Subscription-Hopping' Noted by TiVo During COVID

A survey by TiVo found that some viewers were subscription hopping, adding and dropping the growing array of video streaming services as those viewers spend m...

27/01/2021

ViacomCBS Says Super Bowl Ads Are Virtually Sold Out'

Commercials in the upcoming Super Bowl are virtually sold out, according to spokesperson for ViacomCBS....

27/01/2021

Unruly Launches Self-Service Sales Tools for CTV, OTT

Video ad platform Unruly said it launched a suite of self-service tools that let publishers package, price and sell programmatic over-the-top and connected TV i...

27/01/2021

Monitoring creative production during lockdown

Computer monitors with professional level performance are now available for a small fraction of the traditional price. We asked four freelance content creator...

27/01/2021

BBC's Winterwatch is world's first large scale OB solely powered by green hydrogen

According to the BBC, using green hydrogen instead of diesel twinset generators ...

27/01/2021

Matchroom Sport launches media production arm

New production arm will be led by Katie Hearn and focus on outside production and live streams By Jenny Priestley Published: January 27, 2021 New productio...

27/01/2021

ColinaNet and SES Networks to Offer Enhanced Internet and Wi-Fi Services Via Satellite across Peru

Written on 27 Jan 2021 The collaboration will enable high-performance connecti...

27/01/2021

China Media Group Brings First Extended Reality New Year Gala to Life With Ross

Ottawa, Canada, January 27th 2021 - While Chinese communities traditionally look forward to their New Year festivities in February, Chinese broadcaster CCTV sti...

27/01/2021

Chilefilms Chooses Ross for New Regional Studio Hub

Ottawa, Canada, January 26th 2021 - The South American broadcast market has seen many changes over the last decade, with new channels and platforms springing up...

27/01/2021

Mo-Sys forges AR partnership with VividQ

Mo-Sys forges AR partnership with VividQ data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=https://cr...

27/01/2021

Archiware releases Version 6.0 of the P5 Software Suite with LTFS as Native Archive Format on LTO

Archiware releases Version 6.0 of the P5 Software Suite with LTFS as Native Arch...

27/01/2021

Rohde & Schwarz Supports Egyptian National Media Authority in Major DVB-T2 Transmission Network Expansion

Rohde & Schwarz Supports Egyptian National Media Authority in Major DVB-T2 Trans...

27/01/2021

ATEME Makes Video-Compression History with Emmy Awards Triple Crown

ATEME Makes Video-Compression History with Emmy Awards Triple Crown data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb...

27/01/2021

Ma Rainey's Black Bottom Cinematography (with Tobias Schliessler ASC) GCS256

Ma Rainey's Black Bottom Cinematography (with Tobias Schliessler ASC) GCS256 data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c56...

27/01/2021

Post Break's How To PNYA Highlights the Organization's Work in Helping NY Post Pros Thrive During Covid and Beyond

Post Break's How To PNYA Highlights the Organization's Work in Helping...

27/01/2021

Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV Awards: Greatest of All Time

Crew in a Box Uses Pocket Cinema Camera 6K and ATEM Mini Pro for MTV Movie & TV ...

27/01/2021

SMPTE Earns Two 2020 Emmy Awards for Technology and Engineering

SMPTE Earns Two 2020 Emmy Awards for Technology and Engineering data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg...

27/01/2021

CBC Radio's Maloney Inducted Into Specs Howard Hall of Fame

CBC Radio Vice President Brian Maloney was inducted into the Specs Howard School of Media Arts Hall of Fame on November 14, 2020. CBC Radio Vice President Bria...

26/01/2021

IBC 2021 Opens Accelerator Innovation Program Submission Window

LONDON-IBC is now accepting submissions for the Accelerator Media Innovation Program 2021, which highlights R&D projects that attempt to solve business and tech...

26/01/2021

TiVo, Pindrop Partner on Voice Enabled Personalization Tech

ATLANTA-TiVo and Pindrop, a voice authentication and fraud detection company, have announced a partnership with the goal of providing streamlined content discov...

26/01/2021

LA Updates COVID-19 Protocols for Production

LOS ANGELES-The County of Los Angeles Department of Public Health has issued an updated guideline for TV production protocols during the COVID-19 pandemic, as L...

26/01/2021

C-Band Auction Set to Move Into Assignment Phase

WASHINGTON-After raising more than $80.9 billion thus far, the FCC's C-band auction is set to continue with the assignment phase scheduled to begin on Feb. ...

26/01/2021

TV Academy Announces Reality TV Diversity Internship Program

LOS ANGELES-The Television Academy Foundation is launching a new internship program designed to promote diversity in the unscripted/reality TV sector of the ent...

26/01/2021

Panasonic Kairos Boosts LiveX 4K Broadcast Production

NEWARK, N.J.-Panasonic's Kairos next-generation IT/IP live production platform was recently installed at LiveX, a production and broadcast company, as an ef...

26/01/2021

Epistemix Software Modeling Offers Insights on Fan Attendance Variables on COVID-19 Infection Rate

Epistemix Software Modeling Offers Insights on Fan Attendance Variables on COVID...

26/01/2021

Flowics Powers Live Graphics, Content for Linear and Digital Broadcasters

Flowics Powers Live Graphics, Content for Linear and Digital Broadcasters By Kristian Hernandez, Associate Editor Tuesday, January 26, 2021 - 10:45 am Prin...

26/01/2021

NESN Keeps Its Eye on the 4K HDR Ball With Launch of New Studio

NESN Keeps Its Eye on the 4K HDR Ball With Launch of New Studio The 4K HDR-ready studio launches ahead of 4K HDR Red Sox game productions in 2021 By Jason Dach...

26/01/2021

Latest Additions to Sundance Film Festival Talks & Events

Park City, UT - Sundance Institute today announced the latest additions to the programming slate of the 2021 Sundance Film Festival, which kicks off Thursday, J...

26/01/2021

STUDENT AND YOUTH COMPETITIONS 2021

SHORTLISTS ANNOUNCED Today the World Photography Organisation announces the shortlisted photographers in the Student and Youth competitions of the Sony World P...

26/01/2021

Groundbreaking Alpha 1 Camera Marks a New Era in Professional Imaging

New 50.1-megapixel (approx., effective) full-frame stacked Exmor RS CMOS image sensor in combination with an upgraded BIONZ XR imaging processing engine with ...