"What we wanted to do was to build a file system that would support any resolution at any number of streams"
Author:
ContributorPublish date:
Aug 16, 2018
The M&E industry is one of the fastest evolving sectors. The rapid progression of frame rates and video revolution has a considerable impact on production and post-production teams, and their storage and capacity requirements. Throughout the production process, a film increases from approximately 10 TB to roughly 350 TB and the number of workstreams with users working on the same dataset grows rapidly.
To solve this data storage challenge, Technicolor created a scalable and future-proof storage infrastructure using Excelero NVMesh to provide workstations with access to high bandwidth and low latency performance that accommodates streaming, editing and reel presentation at any time.
Future-proofing post-production storage
Like many data centre and infrastructure teams at production and post-production houses, Technicolors IT department along with engineering director Amir Bemanian, were struggling to keep up with the rapid evolution from one resolution to the other.
4K is becoming the default resolution and 8K is on the horizon, and frame rates are increasing from 24 and 30 frames per second to 48fps and even 60fps. The additional storage capacity and thus also bandwidth that is needed for higher frame rates increases linearly: doubling the frame rate from 30fps to 60fps also doubles the storage needs. And increasing the resolution from 2K to 4K quadruples the storage requirements. When a studio switches from 2K 30fps to 4K 60fps, the post-production house also needs to be prepared to store and stream eight times the volume of data, which is a substantial increase.
On top of this, there are also possible investments in extra cameras, additional visual effects, High Dynamic Range (HDR), colour depth, and more. Yet another challenge for post-production workflows is avoiding dropped frames, caused by insufficient performance and high latencies, which impacts the technical quality of an asset and results in on-screen motion.
A common problem is that many companies in the M&E industry such as Technicolor, retain infrastructures which are typically based on a Fibre Channel network with storage arrays serving tens of workstations. This means that the speed to ingest data to the workstations from the Fibre Channel storage arrays is simply too slow and does not scale. At Technicolor, workstreams had to be duplicated in order for multiple people to work on the dataset at the same time.
In order to be better prepared for current and future storage and streaming needs, Amir Bemanian and his team at Technicolor began exploring new "future-proof" storage and network architectures. "What we wanted to do was to build a file system that would support any resolution at any number of streams," explains Bemanian. "And that was essentially impossible until 2017 where we saw an alignment of technologies: the networking, the PCIE slot, the NVMe drives and also the software - from Excelero - that glued it all together. This combination of technologies enabled us to do storage in a very different way to traditional methods.
The IT infrastructure required to feed dozens of workstations of 4K files at 24 fps is mind-boggling and that doesn't even consider what storage demands we'll face with 8K or even 16K formats, Bemanian continues. It's imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage that Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.
Excelero's NVMesh for Any-K workflows
NVMesh software-defined block storage features Elastic NVMe, a distributed block layer that allows any application to utilise pooled NVMe storage devices across a network at local speeds and latencies. Distributed NVMe storage resources are pooled with the ability to create arbitrary, dynamic block volumes that can be utilised by any host running the NVMesh block client. These virtual volumes can be striped, mirrored or both while enjoying centralised management, monitoring and administration. In short, applications can enjoy the latency, throughput and IOPS of a local NVMe device while at the same time getting the benefits of centralised, redundant storage. NVMesh is deployed as a virtual, distributed non-volatile array and supports both converged and disaggregated architectures, giving customers full freedom in their architectural design.
By deploying Excelero NVMesh and six standard NVMe servers powered by Intel 3D NAND flash, Technicolor achieved 4K streaming at 60fps to over 50 workstations concurrently. Delivering 99.8 per cent of local NVMe storage server performance across the network, the solution offers twice the performance of competing solutions at 50 per cent of the cost and requires a much lower data centre footprint.
After an initial proof of concept, the storage solution was brought into production within four weeks for use with a major Hollywood feature film. So far, three projects have been run successfully on the software-defined system.
A major benefit is that the architecture has created an optimal environment where multiple members of the post-production team can simultaneously view and work on the same data set. Bemanian concludes: "It has generated a positive and productive end user experience.
Europe Stories
04/09/2025
Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...
08/05/2025
As expected, continued weak demand from key sales markets and declining economic...
08/05/2025
A new three-part series is coming to BBC iPlayer and BBC One
(Image: The Christie Archive Trust)
The BBC has announced Agatha Christie's Endless Night, a...
08/05/2025
08 May 2025
VEON Shareholders Re-elect Board at 2025 AGM, Founder Augie Fabela ...
08/05/2025
Comedy and entertainment channel U&Dave bring back their #1 ranked programme of ...
08/05/2025
Expect even more chaos this July with Harriet Webb leading the returning cast, p...
08/05/2025
TenneT relies on Arvato Systems for market communication
Energy industry: Impressive market communication know-how and system integration expertise
G tersloh...
08/05/2025
When Taiki Hamamoto, 22, came across a Hanafuda deck at his local game shop, he was intrigued. He had grown up playing the traditional Japanese card game with f...
08/05/2025
The Liveline is now open , said Joe Duffy earlier today, as he previewed this af...
08/05/2025
RT , in association with the BBC, Screen Ireland and Cineflix Rights has reveale...
07/05/2025
Discovering music should feel effortless and fun. That's why Spotify continu...
07/05/2025
FOX Doubles Down on the Laughs Renewing Comedies Animal Control, Starring Joel M...
07/05/2025
07 May 2025
VEON's QazCode Signs MoU with Seekr to Develop AI-Powered Solut...
07/05/2025
UKTV has ordered a feature length documentary celebrating the life of Britain...
07/05/2025
Wednesday 7 May 2025
Shaun the Sheep fans are in for a baaaarilliant treat in 2...
07/05/2025
Rohde & Schwarz to highlight innovative broadcast technologies at CABSAT 2025 Rohde & Schwarz will showcase its latest energy-efficient transmitters and 5G Br...
07/05/2025
The Importance of Workflow Efficiencies in Post-Production Wednesday, 14 May
14:40
FilmLight sits down with Sam Lempp, head of business development for Nara, ...
07/05/2025
RT News is pleased to announce the appointment of RT journalist, Fergal O'Brien, as its new Business Correspondent.
In his new role, Fergal will be repor...
06/05/2025
In Colombia, music isn't just background noise-it's center stage. It'...
06/05/2025
En Colombia, la m sica no suena de fondo: es el centro del escenario. Es el cora...
06/05/2025
At Spotify, we always seek ways to connect users with their next favorite podcas...
06/05/2025
Since Spotify's 2019 launch in India, the growth of the country's local ...
06/05/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
06/05/2025
Comscore Reports First Quarter 2025 ResultsRESTON, Va., May 6, 2025 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evaluating ...
06/05/2025
Live from Studio 1 at 7pm, Tuesday May 6
Iconic trad-fusion group K LA will be ...
06/05/2025
Rohde & Schwarz hosts RF Testing Innovations Forum 2025, helping design engineer...
06/05/2025
LONDON, UK, May 6, 2025 /PRNewswire/ -- Today at the company s annual THINK event, IBM (NYSE: IBM) is unveiling new hybrid technologies that break down the long...
06/05/2025
Apple today introduced Tap to Pay on iPhone in Bulgaria, Finland, Hungary, Liechtenstein, Poland, Portugal, Slovakia, Slovenia, and Switzerland, enabling millio...
06/05/2025
Ahead of Pride Month, Apple is introducing a new Apple Watch Pride Edition Sport Band, watch face, and iPhone and iPad wallpaper to celebrate the strength and b...
06/05/2025
First episode airs this Friday at 8pm on RT One and RT Player with Doireann N Ghlac in presenting
Guests include Barry Murphy, Brooke Scullion, Bryan Dobso...
05/05/2025
As Europe gears up for the Eurovision Song Contest 2025, Spotify is celebrating the spirit of unity and musical legacy with a new series of Spotify Singles. Fiv...
05/05/2025
As part of the restructuring of its loss-making Carbon Fibers business unit, SGL Carbon has decided to close its production site in Lavradio (Portugal). Lavradi...
05/05/2025
Comscore Launches Certified Deal IDs in Magnite's SSP, Bringing Trusted Cont...
02/05/2025
Updated May 2: In a victory for consumers, artists, creators, and authors, Apple...
02/05/2025
Since 2022, Spotify and FC Barcelona have brought the worlds of music and footba...
02/05/2025
With more than 678 million users worldwide tuned in to Spotify, we're at the heart of music and culture. Our unrivaled global community of artists, songwrit...
02/05/2025
Data Communications Company has announced its partnership with IBM to modernise ...
02/05/2025
Comscore at the 20th Annual Needham Technology, Media, & Consumer Conference RESTON, Va., May 2 2025: Comscore (Nasdaq: SCOR), a trusted partner for planning, t...
02/05/2025
02 May 2025
VEON to release 1Q25 trading update on May 15, 2025 Dubai, May 2, 2025 - VEON Ltd. (NASDAQ: VEON), a global digital operator, today confirms that t...
02/05/2025
CUPERTINO, CALIFORNIA Apple today announced financial results for its fiscal 2025 second quarter ended March 29, 2025. The Company posted quarterly revenue of $...
02/05/2025
Well-known faces pushed to their limits in Uncharted with Ray Goggins...
01/05/2025
As Tanzania approaches a pivotal election year marked by both promise and concern over the impact of artificial intelligence (AI) on media, more than 300 journa...
01/05/2025
After four years of lectures, study sessions, exams, and parties, college senior...
01/05/2025
Prochazka knows the power of relationships, so it has always been important to him that ATEC Pro be renowned for more than just supplying great equipment. Becom...
01/05/2025
Munster and Connacht Football Finals onThe Sunday Game Live
Final two days of t...
01/05/2025
Voice actor and producer Mark Yoshimoto Nemcoff shares his first impressions of the DPA 2017 Shotgun Microphone, from real-world auditions to side-by-side compa...
01/05/2025
With my previous console, Freeman recalls, I always had to run a Waves server for EQ and compression, but when I switched to DiGiCo, I found it was such an op...
01/05/2025
Stream all episodes ofLook Who's Hangry from April 29
An RT Player Original in partnership with Heinz...
01/05/2025
Here is your host, Patrick Kielty!
T naiste, Minister for Foreign Affairs and T...
"What we wanted to do was to build a file system that would support any resolution at any number of streams"
