Colour grading meets machine learning
Martin Tlaskal February 13, 2024
0 Comments
In the ever-evolving landscape of film and TV post-production, machine learning (ML) has become a pivotal force with a magnitude of ML models for image processing released every single day.
At FilmLight, we're continuously monitoring the market and our customers' requirements; we work hard to update and improve our technology so it's always moving forward and providing a platform that fulfils the colourists' needs.
This is demonstrated in the latest version of our grading software, Baselight 6.0, which we launched at the end of last year. The platform benefits from several years of development which bring colourists major gains in productivity and creativity, including an improved and modernised timeline, a new primary grading tool, X Grade, and a unique new look development tool, Chromogen.
For the first time, the latest Baselight release also includes ground-breaking ML-based tools and features. Our main goal was to come up with a platform to allow us to do two things.
Firstly, where we felt it would be beneficial to our customers, we wanted to be able to train our own ML models and integrate them deeply inside Baselight. But we also wanted to create a platform which allows us to easily and quickly integrate external models into Baselight - allowing ourselves and our customers to stay on the cutting edge of the latest trends and technology in this field.
Face Track
Face Track is the first example of our own ML-based model which, following years of research and development (led by Patrice Lacour, Software Developer), has been deeply integrated inside Baselight 6.0.
Face Track was born out of a recognition of the significant amount of time colourists spend on tasks like facial match grading and digital beauty work. Our goal was to create a tool that streamlines and enhances this process, saving the colourist time and increasing productivity.
Previous methods of face tracking involved using trackers, such as area or planar trackers, which, while effective in basic scenarios, faltered when faced with complex facial structures or occlusions.
Face Track works by first detecting all faces in a scene. It will then track each face through time, determining its pose. It will essentially unwrap the skin of the face into a constant coordinate space, or UV space. This space becomes the canvas for colourists to make corrections or enhancements, and the beauty of it is that these corrections are automatically applied to 3D geometry. This means that colour corrections are applied consistently to the face, regardless of how the face moves.
But the benefits don't stop there. Because the system knows about faces and poses, the colourist can copy and paste their enhancements across multiple scenes, sequences or entire episodes. It will make a best guess' at matching faces and while it may not be perfect, it will get the colourist 90-95% of the way there, allowing them to focus on finessing the creative aspects rather than time consuming manual tasks.
The feedback so far has been phenomenal, and many customers have already used the beta version of Baselight 6.0 to complete productions - because, once they saw the tools and the efficiencies it provided, they didn't want to return to previous versions of the software.
Flexi
Recognising that we can't create all models ourselves, we have also introduced Flexi architecture into Baselight 6.0.
Many new ML-based models are being released every day with licenses allowing commercial use. However, they're all written in Python, which means it's not easy or fast to integrate them into most apps.
Flexi is a new architecture in Baselight 6.0, which allows us and our customers to integrate external ML models written in Python into the Baselight environment. This flexibility enables users to adapt and run various open-source models within Baselight, providing endless possibilities for experimentation and creative exploration.
For example, using our Flexi architecture we've been able to integrate the popular MiDaS depth mapper into Baselight. MiDaS has been a world regarded open-source depth mapper and, although perhaps not state of the art today, it is a good example of how an external ML model can be integrated. An accurate depth mapper produces an estimation of the per-pixel depth of an image and allows the user to apply Bokeh - a cinematic blur of the background - to produce beautifully natural looking shots with a more filmic depth of field. By taking the current version of MiDaS, including a Flexi Python script, and slightly altering the wrapper script, we were able to get it running inside Baselight in under a day.
February 6, 2024LumaFusion for Android Adds Real Time Scopes for Color WorkflowsGood news for LumaFusion for Android editors! A major new update to
February 5, 2024Films That Defined My Journey As A Colour AssistantIn film, the subtle art of colour grading often goes unnoticed and
For some models, we may choose to integrate them more deeply into Baselight, but for others we may publish the API and allow our customers - many of whom have their own internal scripting teams - to integrate models of interest directly into their Baselight system as required. These models are computationally expensive, requiring a lot of GPU and memory, so doing it this way allows them to use Baselight's caching and rendering system and allow real-time interaction.
Our vision with Flexi is to keep up with the rapid advancements in machine learning. We want to make it easy for our users to incorporate the latest and most innovative models into Baselight. Whether it's image segmentation, video in-painting, or other revolutionary or creative video-centric applications, Flexi aims to be the bridge between open-sou
Most recent headlines
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
28/11/2025
Nadia Fall attends the 2025 Sundance Film Festival premiere of Brides at the Egyptian Theatre on January 24, 2025, in Park City, Utah. (Photo by Donyale West/...
28/11/2025
It's easy to ignore those little red update available badges. But when it ...
28/11/2025
WASHINGTON Federal Communications Commission has released a tentative agenda for the December Open Commission Meeting scheduled for Thursday, December 18, 2025 ...
28/11/2025
The Professional Fighters League is looking to super-serve fans of mixed martial...
28/11/2025
Fubo has released in beta on select Roku devices a new feature that lets users display up to four simultaneous streams at once....
28/11/2025
The WNBA playoffs and Week 4 of the NFL regular season highlight the list of live sports events airing on television this weekend....
28/11/2025
The 32nd class of honorees to the B+C Hall of Fame took to the stage at New York's Ziegfeld Ballroom on September 26 for a gala induction event. Click below...
28/11/2025
We hold in our hands the very last Next Text for Next TV, the weekly back-and-fo...
28/11/2025
DirecTV said it made a deal with EchoStar to buy EchoStar's video businesses, including satellite-TV provider Dish TV and virtual MVPD Sling TV, for $1 plus...
28/11/2025
The Broadcasting+Cable Hall of Fame, the premier industry event paying tribute to the influencers, innovators and shining lights of broadcast, cable and streami...
28/11/2025
Friday 28 November 2025
Sky Sports x Slawn drop limited-edition football jersey...
28/11/2025
Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds t...
28/11/2025
Unwrapped: The Toy Show Appeal - airing this Sunday on RT One and RT Player- s...
27/11/2025
LONDON Vizrt has added several AI-driven advanced features offering improved speed, intelligence and accuracy in the newest version of its media asset managemen...
27/11/2025
Prime Video has launched AI-powered video season recaps in a beta version for select English-language Prime Original series in the U.S., a move Amazon is callin...
27/11/2025
Back to All News
Netflix's Raat Akeli Hai: The Bansal Murders Marks a Grand...
27/11/2025
27 Nov 2025
GSMA brings M360 Eurasia 2026 to Samarkand in partnership with VEON...
27/11/2025
Tahar Rahim and Izuka Hoyle star in the gripping six-part Sky Original from Acad...
27/11/2025
Thursday 27 November 2025
Sky Arts Reveals the Nation's Greatest Basslines - and Queen Reign Supreme
The UK's most iconic basslines have been revealed...
27/11/2025
Back to All News
Stranger Things 5': Prepare for One Last Adventure With O...
27/11/2025
The media industry has a paradox at its core. It's an industry built on light, color and imagination, yet behind the scenes, it's powered by one of the ...
27/11/2025
Rating reflects rating progress across areas including policies, diversity & inclusion, health & safety and Net Zero leadership
Winchester, UK, 27 November 202...
27/11/2025
What are the industry standards for Retail Media? Kathryn explains that certification is based on the IAB Europe Retail Media Measurement Standards and the IAB ...
27/11/2025
World champion boxer and Irish sporting icon Katie Taylor will be in studio this...
27/11/2025
Roblox, one of the world's most popular online gaming platforms for primary ...
27/11/2025
Black Friday is leveling up. Get ready to score one of the biggest deals of the season - 50% off the first three months of a new GeForce NOW Ultimate membership...
26/11/2025
SVG Sit-Down: Prime Video EP Mike Muriano Previews Massive Black Friday Slate Fe...
26/11/2025
A cinematic snow sculpture at the 1995 Sundance Film Festival. Photo by Randall Michelson...
26/11/2025
Book podcasts are booming. On Spotify, you'll find everything from celebrity book clubs to deep dives with bestselling authors. And in markets where audiobo...
26/11/2025
Mumbai, November 24, 2025: In a first-of-its-kind initiative, JioStar, in collab...
26/11/2025
LONDON Factual content producer ITN Productions has launched a new low-latency IP gallery for news bulletins....
26/11/2025
MIAMI TelevisaUnivision said it struck a new multiyear distribution agreement with YouTube TV that includes distribution of TelevisaUnivision's U.S. network...
26/11/2025
OpenDrives, Inc., a leader in software-defined data storage and data services, today announced the launch of the Atlas Corporate Creative Solution. This new Atl...
26/11/2025
Disguise, the industry-leading company powering the world's biggest live performances, is partnering with pioneering LED wall manufacturer DVS to give atten...
26/11/2025
HighField AI, the pioneer in agentic and multimodal automation for broadcast and media production, today announced the expansion of its global channel partner n...
26/11/2025
As high-stakes Premier League fixtures approach and additional premium content launches, with MONO positioning themselves to dominate Thailand's sports stre...
26/11/2025
Hosting a wide variety of events from high-intensity NHL games to complex live music concerts and major entertainment productions, Montreal's 21,000 capacit...
26/11/2025
Vizrt, the leader in live production technology revolutionizing viewer engagement and experience, releases AI-driven advances focusing on speed, intelligence, a...
26/11/2025
ITN Productions, an award-winning factual content producer, today launched a new low-latency IP gallery for news bulletins. Responsible for delivering a leading...
26/11/2025
Ikegami reports ongoing advances throughout 2025 in developing and delivering coordinated television production solutions that maximize quality, versatility and...
26/11/2025
Following the Nov. 21 blackout of NBCUniversal channels on Fubo, the two sides have traded barbs about their inability to reach a new carriage deal....
26/11/2025
LONDON As TV sports rights become increasingly important for both broadcasters and streamers, Ampere Analysis predicts global investment in the genre will surpa...
26/11/2025
LOS ANGELES Vubiquity said it has achieved the Amazon Web Services (AWS) Media & Entertainment Competency as part of the AWS Partner Network (APN). This designa...
26/11/2025
WASHINGTON The Federal Communications Commission's Enforcement Bureau said it has entered into a consent decree with Comcast calling for the cable company t...
26/11/2025
Berklee Named to the Hollywood Reporters Top Music Schools List The publication highlights the college's screen scoring program, industry partnerships, and ...
26/11/2025
Back to All News
Animated Series Love Through a Prism' Casts New Light on ...
26/11/2025
Back to All News
NALIP Unveils Fifth Cohort of Director Incubator
Social Impact
26 November 2025
United States
Link copied to clipboard
The National Assoc...
26/11/2025
YouView Achieves Greenly Gold Certification for SustainabilityNov 26, 2025
YouView is proud to announce a Gold Certification award from Greenly for our perform...
Colour grading meets machine learning 
