"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Most recent headlines
20/04/2019
Fans of Cape Town's now defunct theme park Ratanga Junction have received some good news in the form of an announcement by Canal Walk Shopping centre.
The ...
20/04/2019
Mamelodi Sundowns manager Pitso Mosimane appears to have conceded the title race to Orlando Pirates whom he feels are favourites to claim the title now.
Pirate...
20/04/2019
ClayPaky Launches The First Beam Moving Light With A Laser Source At Prolight So...
20/04/2019
Caves du Manoir upgrades with DiGiCo SD12 posted: 19/04/2019
For 40 years, the Caves du Manoir in Martigny, Valais (Switzerland) have been used for cultural...
20/04/2019
CBS got the top spot in Thursday ratings, with The Big Bang Theory leading to a 1.1 in viewers 18-49, per the Nielsen overnights, and a 5 share. In second was A...
20/04/2019
Just weeks after long-time Access executive producer Rob Silverstein was transitioned off of the entertainment magazine, co-host Natalie Morales also is departi...
20/04/2019
WCIU Chicago will become the CW affiliate in DMA No. 3 starting September 1. The station is owned by Weigel Broadcasting.
The current CW affiliate in Chicago i...
20/04/2019
It's Friday night and that can only mean one thing; cash dollar bills (not really) are ready to be won in the Powerball draw.
Powerball and Powerball Plus ...
20/04/2019
The 2019 Two Oceans Marathon has had quite a few disruptions before the gun has even gone off. The route of the ultra event had to be changed due to the threat ...
20/04/2019
Weather data provided by the South African Weather Service. For a detailed forec...
20/04/2019
3D Storm receives NAB2019 Top EMEA Distributor Award from NewTek posted: 19/04/2019
At NAB 2019 show 3D Storm received an award as Top EMEA Distributor for ...
20/04/2019
in the wild
Apr 19, 2019
All around the world, content creators are inspiring us. You know how much we love it!
View this post on Instagram
A post shared...
19/04/2019
April marks Arab Heritage Month in the U.S. To celebrate, we're featuring Arab American artists, comedians, and actors in our key Yalla Araby playlist. We k...
19/04/2019
2019 NAB Awards Roundup: Grass Valley, Panasonic, Ross Video, Quantum, and More ...
19/04/2019
Behind the Mic: ABC, ESPN Deploy Full Armada of On-Site Talent for Next Week'...
19/04/2019
NAB 2019 Reflections: SportZcast's Mike Connell Envisions Vast Expansion Int...
19/04/2019
NAB 2019 Reflections: EVS's Sebastien Verlaine, Nicolas Bourdon Lay Out IP, ...
19/04/2019
NAB Reflections: Panasonic's Mike Bergeron on 8K ROI and the Smart Studio Automated production and AR technology are also part of the studio design By Ken ...
19/04/2019
Sportradar, SportsGrid To Launch Free, 24-Hour Sports-Betting Network By Jason Dachman, Chief Editor
Friday, April 19, 2019 - 10:10 am
Print This Story
St...
19/04/2019
NAB 2019 Reflections: ChyronHego CEO Marco Lopez on the Importance of Sports-Ven...
19/04/2019
NAB 2019 Reflections: Object Matrix's Jonathan Morgan on the Power of Object...
19/04/2019
NAB 2019 Perspectives: The Switch's Charles Conroy Says Traditional Sports B...
19/04/2019
NAB 2019 in Review: The Major Trends and Surprises From the Big Broadcast Show i...
19/04/2019
ZAYAN BAYAR BIL KEPERLUAN PEMINAT
Date Released:19 Apr 2019
Share
Tweet
Masalah pembayaran bil memberi tekanan dan membebankan anda? Sertai ZAYAN BAYAR u...
19/04/2019
Even though Internet Protocol (IP)-based systems are still in a phase where standards need to evolve and necessary features need to be consolidated, the opportu...
19/04/2019
BCA Events 2012.
Events 2013.
BCA Events 2013
Interra Systems Expands D...
19/04/2019
If you've ever played a large venue like a sports arena, you know that reverb is a completely different animal than what the audience hears. You hear your i...
19/04/2019
19 April, 2019 - 08:03
The National Film and Video Foundation, an agency of the Department of Arts and Culture is pleased to announce that the call for Cycl...
19/04/2019
19 April, 2019 - 08:03
Hellocomputer Johannesburg has successfully pitched for and signed as the agency on record for A E Networks Africa, the global media ...
19/04/2019
Adlib adds sonic magic to O2 Academy Glasgow with Academy Music Group posted: 19/04/2019
Adlib's installation team has delivered another excellent tou...
19/04/2019
4Wall Invests in Kinesys posted: 19/04/2019
Leading North American Lighting and Video rental specialist 4Wall Entertainment has invested in new Kinesys au...
19/04/2019
Complete workflow solutions from Datavideo at NAB 2019 posted: 19/04/2019
The HS-3200: This feature rich machine has 12 inputs who are all accepting a mix...
19/04/2019
NOTE: Additional reporting by AFP, Super Rugby Highlights appear courtesy of SANZAAR.
New Zealand's Hurricanes recovered their puff after a shaky start Fri...
19/04/2019
Please note that this article contains graphic images which might upset sensitive viewers.
Eight men and a woman were nailed to crosses while hundreds of baref...
19/04/2019
Photo courtesy of ABC
Fox has renewed the comedy Last Man Standing for 2019-2020. Tim Allen stars in the show. Next season will be Last Man's second on Fox...
19/04/2019
Fox has canceled the first-year comedy Rel and the sophomore drama The Gifted. Rel debuted Sept. 30, a multi-camera comedy from 20th Century Fox Television. It ...
19/04/2019
Drama Strange Angel debuts season two on CBS All Access June 13. The period drama centers on Jack Parsons, who straddled the worlds of science and the occult, p...
19/04/2019
EPL Fixtures on 20 April *All times SAST
Manchester City vs Tottenham 13:30
Manchester City and Tottenham contest a repeat of their midweek Champions League...
19/04/2019
Weather data provided by the South African Weather Service. For a detailed forec...
19/04/2019
VIZ MEDIA ANNOUNCES NEW ANIME AND MANGA RELEASES FOR APRIL
BORUTO: NARUTO NEXT GENERATIONS Blu-ray/DVD Arrives Alongside MY HERO ACADEMIA And NIER:AUTOMATA No...
19/04/2019
VIZ ORIGINALS TO HOST PORTFOLIO REVIEWS AT LEADING 2019 POP CULTURE CONVENTIONS
Opportunity For Artists And Writers To Show Their Works To The Team Behind VIZ&...
18/04/2019
Nokia Corporation
Stock Exchange Release
April 18, 2019 at 9:00 (CET 1)
Noki...
18/04/2019
SMPTE Announces 2014 Honorees and Award Winners
Annual SMPTE Honors & Awards Ceremony Highlights Vision, Ingenuity, Perseverance, and Dedication to Motion Pi...
18/04/2019
InfoComm 2019June 12-14, 2019 Orlando, Florida USA BOOTH: 4029
About ApantacApantac LLC is a leading designer and developer of high quality, cost effective ima...
18/04/2019
This award, entitled My Afghanistan, was launched in honour of Shah Marai, chief photographer of Agence France-Presses Kabul bureau killed in a suicide attack o...
18/04/2019
Apr 18 2019
NEW YORK, N.Y. - April 18, 2019 - Jose Andino has been named to the newly created role of Senior Vice President, Human Resources, CBS News, it was...
18/04/2019
KDDI CORPORATION
OKINAWA CELLULAR TELEPHONE COMPANY
April 11,2019
KDDI CORPOR...
18/04/2019
Harris Corporation (NYSE:HRS), the largest aerospace and defense company headqua...
18/04/2019
Berklee has named Philip Lima as assistant chair of the Voice Department. Lima is a baritone vocalist who has garnered critical acclaim for his performances on ...
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
