A Simple Guide to Formats and Codecs
09/04/2020
Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.
UNDERSTANDING THEM
Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.
Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.
The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.
LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.
Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.
In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.
WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.
Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.
Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.
The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: | https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs... |
See more stories from tvtechnology |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
24/04/2024
UKTV's pay TV channel Alibi joins forces with S4C and All3Media International for new legal crime drama series Mudtown
Cast set to star include Erin Richards and Tom Cullen Wednesday 24 April 2024 ...
24/04/2024
K-Hip-Hop's Biggest Names Take Center Stage on KrOWN X HAN 2024'
This month marked the return of Spotify's HAN, our collaborative program that brings the unique sounds and culture of Korean hip-hop to the world through ex...
24/04/2024
RADAR Italy Returns With 6 Artists Transforming the Country's Music Landscape
As Spotify's program to spotlight rising talent from around the world, RADAR...
24/04/2024
Spotify Partners With Les Flammes Music Awards To Celebrate French Rap
Spotify is once again teaming up with Les Flammes, the only music awards dedicated to rap, R&B, Afrobeats, and popular culture in France. Spotify helped create...
24/04/2024
Taylor Swift's THE TORTURED POETS DEPARTMENT' Becomes Spotify's Most-Streamed Album in One Week
Records smashed. History made. It's been just five days since Taylor Swift u...
24/04/2024
SBS marks Earth Day as The Cook Up with Adam Liaw becomes first Australian show to have its carbon footprint validated through SSA
SBS marks Earth Day as The Cook Up with Adam Liaw becomes first Australian show ...
24/04/2024
Save money every day with SBS's Ricardo Gonalves and Peggy Giakoumelos on new Cost of Living Secrets podcast
Save money every day with SBS's Ricardo Gon alves and Peggy Giakoumelos on n...
24/04/2024
Authentic Perspectives
The first feature film from writer-director Shaun Seneviratne, Ben and Suzanne: A Reunion in 4 Parts depicts the struggle between love and duty as Ben (Sathya S...
24/04/2024
Melanie Georgieva Joins Panalux as Long Form Sales Director
LONDON, England (24 April 2024) Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision'...
24/04/2024
Deutsche Telekom Powers New MagentaTV Service With Broadpeak's Cloud DVR Solution
April 24, 2024 -- Deutsche Telekom Powers New MagentaTV Service With Broadpea...
24/04/2024
Mundo Hispano Digital Launches MundoNow Connect
ATLANTA Mundo Hispano Digital has launched a new advertising product, MundoNow Connect, that is designed to help advertisers reach Hispanic audiences on connect...
24/04/2024
Epic Games Releases Unreal Engine 5.4
Epic Games has released a major new version of Unreal Engine, which has become a mainstay in virtual production, that includes new features and improvements to ...
24/04/2024
NAB Show Welcomes Creators to Las Vegas
The National Association of Broadcasters welcomed the industry to its annual extravaganza last month in Las Vegas. The sights and sounds were similar to previou...
24/04/2024
Chptr, Gray Television Launch on Video Obituary Platform
NEW YORK Chptr and Gray Television have announced that they are introducing a new video solution for funeral homes and communities that will allow funeral direc...
24/04/2024
Adobe Charts the Future of Creativity and AI at MAX London
Adobe Charts the Future of Creativity and AI at MAX London Brie Clayton April 24, 2024 0 Comments Adobe is taking MAX, the world's largest creativ...
24/04/2024
Curtis LeGeyt, NAB President and CEO, Extends Contract
National Association of Broadcasters president and CEO Curtis LeGeyt has agreed to a contract extension that keeps him at the trade association's helm throu...
24/04/2024
Jo Ann Ross Steps Down as Ad Sales Chairman at Paramount
Jo Ann Ross, the long-running queen of television advertising sales, is stepping down from her role as chairman of Paramount Advertising at the end of the month...
24/04/2024
Scripps Names James Galindo as Station Manager in Bakersfield
E.W. Scripps said it named James Galindo as station manager for KERO, the ABC affiliate in Bakersfield, California....
24/04/2024
Amazon Prime Video's Fallout' Tops TVision Power Score Rankings
Amazon Prime Video's Fallout topped TVision's Power Score rankings of shows on connected TV for the week of April 15....
24/04/2024
DoubleVerify Gets MRC Stamp for CTV Viewability Metrics
DoubleVerify said that it received accreditation from the Media Rating Council for its measurement of video viewable impressions and related metrics for connect...
24/04/2024
PlayBox Neo Highlights Latest Advances in Smart Media Pla...
PlayBox Neo reports a successful and well attended 2024 NAB Show, held in mid April at the Las Vegas Convention Center. Now in its 101st year, the event attract...
24/04/2024
MPEG-5 LCEVC Showcase at NAB 2024 demonstrates ecosystem...
MPEG-5 LCEVC ecosystem support continues to grow and includes TVs and set-top boxes, gearing up for the deployment of TV3.0 in Brazil New, never-before-seen ...
24/04/2024
Black Box and NOVO at Integrate Middle East 2024 Featurin...
At Integrate Middle East 2024 in Booth AR-F45, where the company is exhibiting along with its partner NOVO, Black Box will feature IP-based KVM and AV solution...
24/04/2024
NEP Belgium Taps manifold CLOUD in Virtual OB Setup for Live Sports
FRANKFURT, Germany Software solutions provider manifold technologies has announced that its manifold CLOUD was selected by NEP Belgium to provide a signal proce...
24/04/2024
Integral Ad Science Achieves MRC Accreditation
NEW YORK Integral Ad Science has announced that it has earned Media Rating Council (MRC) accreditation for its sophisticated invalid traffic (SIVT) filtration f...
24/04/2024
Plex Launches NFL Channel
LOS GATOS, Calif. Streaming media company Plex has announced a partnership with the National Football League that will add the NFL Channel, the NFLs 24/7 free l...
24/04/2024
NAB Extends Contract for President & CEO Curtis LeGeyt
WASHINGTON, D.C. NAB President and CEO Curtis LeGeyt has agreed to a contract extension that will keep him at the helm of NAB through 2029, according to NAB Joi...
24/04/2024
GlobalM, scoopa Form Strategic Partnership To Enable Speedy Content Distribution
GENEVA, Switzerland Software-defined video network (SDVN) platform specialist GlobalM and broadcast-quality content distribution expert scoopa have formed a str...
24/04/2024
Screen Australia celebrates Australian projects bound for Cannes Film Festival 2024
24 04 2024 - Media release Screen Australia celebrates Australian projects bound...
24/04/2024
Berklee Online to Hold 2024 Berklee Onsite Music Conference May 31-June 1
Berklee Online to Hold 2024 Berklee Onsite Music Conference May 31-June 1 The in-person conference is open to Berklee Online students and the music community ...
24/04/2024
Kargo Gives Buyers More Detail on CTV Campaigns
Kargo said it has launched a new product that gives advertisers more details about the connected TV campaigns they are buying....
24/04/2024
MundoNow Connect Launches To Help Brands Target Hispanics on CTV
Mundo Hispano Digital said it has launched MundoNow Connect, which is designed to use first-party audience data to help advertisers reach Latino connected-TV vi...
24/04/2024
Brittney Griner Sits With Robin Roberts for 20/20' Special
Brittney Griner, the WNBA star who spent 10 months in a Russian prison, sits with Robin Roberts for a primetime special on ABC Wednesday, May 1. The 20/20 speci...
24/04/2024
DirecTV Adds Content From Cineverse, Scripps
To give its subscribers more content to pick from, DirecTV Stream is making deals to carry streaming channels from Cineverse and additional digital multicast ch...
24/04/2024
Jenny Padura Named Anchor at Univision's WLTV Miami
Jenny Padura has been promoted to co-anchor on the 6 and 11 p.m. newscasts at WLTV Miami, known as Univision 23. She starts April 25 and will anchor with Ambros...
24/04/2024
Paris Schutz Joins WFLD Chicago as Political Reporter
Paris Schutz has joined WFLD Chicago, known as Fox 32, as a political reporter. He starts April 29 and will handle all political coverage for the station, repor...
24/04/2024
Plex Adds NFL Channel Ahead of Draft Coverage
Plex has made a deal with the National Football League that will let users watch the NFL Channel, the league's free ad-supported streaming television (FAST)...
24/04/2024
Schwarzenegger, Stallone Discuss Rivalry on TMZ Presents'
Arnold Schwarzenegger and Sylvester Stallone sit for a chat when TMZ Presents: Arnold & Sly: Rivals, Friends, Icons debuts on Fox Tuesday, April 23. The pair di...
24/04/2024
Lionsgate Signs Long-Term Deal With TV Production Head Gary Goodman
Lionsgate Television said it signed a new multiyear employment agreement with executive VP, worldwide production, Gary Goodman....
24/04/2024
Miguelangel Lopez Upped to Regional VP of News at Telemundo Florida Trio
Miguelangel Lopez, WTMO Orlando (Florida) VP of news, has been named regional VP of news and content for WTMO, WRMD Tampa and WWDT Fort Myers, effective immedia...
24/04/2024
VEON Announces 2024 AGM and Board Nominees
24 Apr 2024 VEON Announces 2024 AGM and Board Nominees Amsterdam, 24 April 2024 - VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam: VEON), a global digital operator...
24/04/2024
Howie Schwab - Beloved ESPN Researcher, Producer, and Trivia Star - Dies at 63
Howie Schwab - Beloved ESPN Researcher, Producer, and Trivia Star - Dies at 63 By SVG Staff Wednesday, April 24, 2024 - 6:46 am Print This Story | Subscri...
24/04/2024
Miss the SVG Venue Summit at Allegiant Stadium? All Panel Recordings Now Available on SVG PLAY
Miss the SVG Venue Summit at Allegiant Stadium? All Panel Recordings Now Availab...
24/04/2024
Rohde & Schwarz and IPG Automotive unveil a complete Hardware-in-the-Loop automotive radar test solution
Rohde & Schwarz and IPG Automotive unveil a complete Hardware-in-the-Loop automo...
24/04/2024
My Oni Girl' Trailer Unveils a World Where Suppressed Emotions Can Transform You
Back to All News My Oni Girl' Trailer Unveils a World Where Suppressed Emo...
24/04/2024
Nurturing a new look for Huntapac
Posted on 24 Apr 2024 Creating a contemporary brand update that reflects a company's strong heritage can often pose a challenge, yet its a task ICG embrace...
24/04/2024
2024-04-24
Beginning in May, a special Today at Apple series titled Made for Business will offer small business owners and entrepreneurs free opportunities to learn how ...