"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Most recent headlines
22/09/2018
Disney Channel has ordered a third season of DuckTales, which has its second season premiere Oct. 20. The series starts David Tennant as Scrooge McDuck, Danny P...
22/09/2018
CBS scored highest in Thursday prime ratings, riding a fresh Big Brother to a 1.2 in viewers 18-49, per the Nielsen overnights, and a 6 share. The broadcasters ...
22/09/2018
Season three of Mysteries of the Abandoned starts on Science Channel Oct. 2. The show investigates some of the world's most amazing engineering marvels, wh...
22/09/2018
Georgie Hurford-Jones
Endemol Shine North America has renewed its contract with Georgie Hurford-Jones and given her the new title of senior VP, unscripted orig...
22/09/2018
The Deuce, HBO's drama about the pornography industry in New York in the 1970s and 1980s, will be done after its third season. Season two started Sept. 9.
...
22/09/2018
Extron has released its pro AV over IP range of products. We bring you an exclusive, in depth look at what sets the Extron NAV apart from other competitors on t...
22/09/2018
Rycote, a UK manufacturer of microphone windshields and suspension systems has been acquired by Vitec.
Audio capture is an integral element in the creation of...
22/09/2018
Save 20% on Reference 4 products, ends Sunday
Acoustics / Studio Design
Monitoring
Sonarworks software has been widely lauded for its ability to correct th...
22/09/2018
AT&T SportsNet Announces Vegas Golden Knights Broadcast Schedule and New Insider...
22/09/2018
Inside NBC Sports' All-Encompassing Audio Production for Sunday Night Footba...
22/09/2018
CHALLENGE
Located in the heart of Washington, D.C., the George Washington University Law School (GW Law) has an enrollment of about 2,000 students. Lectures ar...
22/09/2018
Years ago, musician John DeLore decided to expand his professional life into the world of radio and podcasting, beginning a trajectory that led him to working c...
22/09/2018
iabm.tv Interview Darrell Bilton at IBC 2018 20/09/2018
News, Top Stories
Boxx TV Director, Darrell Bilton, sat down for an interview with iabm.tv at IBC ...
22/09/2018
Sep 21
IMT Vislink Highlights from IBC 2018
IMT Vislink wrapped up a very successful appearance at IBC this week in Amsterdam. IBC is one of the two leading...
22/09/2018
NPRs Tiny Desk concert series has spotlighted hundreds of groups over the past decade, performing original material at the desk of All Songs Considered host Bob...
21/09/2018
South Africa's official selection to the 91st Annual Academy Awards (Oscars)...
21/09/2018
The Project where MassMotion was born: New York's Fulton Center scoops anoth...
21/09/2018
Local Newscast Viewership Increases During Hurricane Florence WASHINGTON, DC -- Nearly one million more residents in the Charlotte, Greensboro and Raleigh area...
21/09/2018
S o Paulo, September 20th, 2018 - Netflix, the world's leading internet ente...
21/09/2018
The untitled project will be directed by long-time collaborators Henry Joost and...
21/09/2018
Hollywood, California, September 21, 2018 - Netflix, the worlds leading online entertainment service, announced today the start of production of its new origina...
21/09/2018
We kindly ask that you link to www.netflix.com/ajandthequeen in your coverage
...
21/09/2018
METLIFE INVESTMENT MANAGEMENT ORIGINATES RECORD $7.0 BILLION IN PRIVATE PLACEMEN...
21/09/2018
Brexit, exodus and asylum, trade wars, digitalization, terror or EU-expansion - these are just a few of the topics confronting Europe over the last 12 months.
...
21/09/2018
Meet the nominees for new Music Moves Europe Talent Awards...
21/09/2018
BACKHANG WITH THE GANG WHEN E!S NEW TOPICAL SERIES LADYGANG PREMIERES SUND...
21/09/2018
Published: Fri 21 Sep 2018
- Emma Willis returns to host
- The Blind Auditions...
21/09/2018
Published: Fri 21 Sep 2018
Robert Peston's political magazine show moves to Wednesday nights next week - to provide viewers with a fresh, intelligent and l...
21/09/2018
Multiplayer first-person shooters can be both exciting and nerve-racking. So, it helps to have a knowledgeable player by your side with suggestions.
That's...
21/09/2018
Peter Hunt (second from left) collecting his InAVation Award for Project Manager/Consultant of the Year in 2017
Hewshott International has passed the annual IS...
21/09/2018
Rycote, a UK manufacturer of microphone windshields and suspension systems has been acquired by Vitec.
Audio capture is an integral element in the creation of...
21/09/2018
The Shepard Tone (aka Barberpole) is an audio illusion where a tone always seems to keep rising (or falling). You may have heard it before-to build tension in m...
21/09/2018
--
Blackmagic Design today announced that New Zealand's Department of Post...
21/09/2018
When we last checked in with Victoria Alonso, producer and executive vice president of physical production at Marvel Studios, she was receiving the prestigious ...
21/09/2018
Europe is growing at the fastest rate accounting for 52 per cent of the total 4K boxes in 2017
Author:
Colby RamseyPublish date:
Sep 21, 2018
The global ins...
21/09/2018
Six popular productions will also return this Autumn
Author:
Colby RamseyPublish date:
Sep 21, 2018
BBC Studioworks is providing full studio and technical s...
21/09/2018
Race pitted BATCAM Drive, BATCAM Drone, Steadiseg, Sky Cart, Ref Cam and Umpire Cam against one another
Author:
Jenny PriestleyPublish date:
Sep 21, 2018
Sk...
21/09/2018
-- --
Facebook
Twitter
Google
Pinterest
Sony Australia has welcomed NEP Australia's significant expansion of its 4K inventory, equipment and servic...
21/09/2018
-- --
Facebook
Twitter
Google
Pinterest
The shortlisted projects that competed at Lagos Comic Con (in no particular order) were:
Ringa Mzansi represen...
21/09/2018
Cape Town International Film Market & Festival 2017
-- --
Facebook
Twitter
Google
Pinterest
The 2018 edition of the Cape Town International Film Marke...
21/09/2018
-- --
Facebook
Twitter
Google
Pinterest
The 8th annual Durban Gay & Lesbian Film Festival is taking place from today, Friday, 21 to Sunday, 30 Septembe...
21/09/2018
21 September, 2018 - 08:03
This Heritage Month, Toyota South Africa and its long-standing agency, FCB Joburg, have created a beaded billboard' with the...
21/09/2018
--
Facilis, a leading international supplier of cost-effective, high performan...
21/09/2018
MOTHER'S DAY - filming drama with AMIRA The ARRI AMIRA has a well-earned reputation as a tough and adaptable documentary camera, and as a tool for wildli...
21/09/2018
Jason Coari, director, Scale-out Storage Solutions at Quantum, on how post production workflow optimisation can help power successful collaboration
Author:
Co...
21/09/2018
Based on the DC Comics character of the same name, The CW's new series Black Lightning follows the retired superhero and current high school principal Jef...
21/09/2018
Dark, a German sci-fi thriller series, debuted on Netflix's streaming service last December. It spans six decades with story lines set in 1953, 1986, and 20...
21/09/2018
The sixth film in the franchise, Mission: Impossible - Fallout has been called a culmination of all of the previous films in the series, with characters returni...
21/09/2018
There have been many iterations of the story of Winnie the Pooh over the years since English author A. A. Milne introduced the stuffed character to readers in h...
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
