A Simple Guide to Formats and Codecs
09/04/2020
Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.
UNDERSTANDING THEM
Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.
Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.
The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.
LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.
Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.
In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.
WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.
Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.
Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.
The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: | https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs... |
See more stories from tvtechnology |
Most recent headlines
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
19/03/2024
Barco announces collaboration with NVIDIA and SoftAcuity to add AI and data analytics applications to the operating room
Mar 18, 2024 Barco announces collaboration with NVIDIA and SoftAcuity to a...
19/03/2024
Hear from New Bulls Manager Morgan Ensberg on latest The Durham Bulls Podcast
Meet the Bulls' new manager, hear from 2 former managers, a former player and a person with a very special connection to Wool E. Bull. Tune in to The Durham...
19/03/2024
What Is Dembow? Tracing the Roots of a Global Phenomenon
What Is Dembow? Tracing the Roots of a Global Phenomenon The story of the dembow beat, which can be found in reggaeton, hip-hop, pop, and far beyond, speaks t...
19/03/2024
Berklee's Roger H. Brown Jr. Building Honored by Boston Society for Architecture
Berklee's Roger H. Brown Jr. Building Honored by Boston Society for Architec...
19/03/2024
Applications Open for 2024 Berklee at Umbria Jazz Clinics
Applications Open for 2024 Berklee at Umbria Jazz Clinics The 39th edition of the program will be held from July 9-21. By Callista Chan March 21, 2024 Ima...
19/03/2024
Smoke and Mirrors: Monday's episode, 18 March 2024 [VIDEO]
Smoke and Mirrors: Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Afric...
19/03/2024
Umkhokha: The Curse - Monday's episode, 18 March 2024 [VIDEO]
Umkhokha: The Curse - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Af...
19/03/2024
Gqeberha: The Empire - Monday's episode, 18 March 2024 [VIDEO]
Gqeberha: The Empire - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South A...
19/03/2024
Muvhango: Monday's episode, 18 March 2024 [VIDEO]
Muvhango: Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African websit...
19/03/2024
Uzalo: Monday's episode, 18 March 2024 [video]
Uzalo: Monday's episode, 18 March 2024 [video]Stay up to date with the latest episodes of your favourite South African soapie on The South African website. ...
19/03/2024
Generations: The Legacy - Monday's episode, 18 March 2024 [VIDEO]
Generations: The Legacy - Monday's episode, 18 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The Sout...
19/03/2024
Skeem Saam: Monday's episode, 18 March 2024 [VIDEO]
Skeem Saam: Monday's episode, 18 March 2024 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
18/03/2024
USC Basketball Star Juju Watkins on Fashion, Film, Friendship Bracelets, and More
Listeners turn to Spotify to connect with their favorites-from artists and album...
18/03/2024
Young professionals successfully complete vocational training at SGL's Meitingen site
Seven young professionals completed their vocational training at SGL Carbon in M...
18/03/2024
Vintage Allure
Released this past January, the music video for Ariana Grande's yes, and? brings a modern approach to vintage allure. The video was directed by Christian ...
18/03/2024
ST Engineering iDirect Unveils Intuition at SATELLITE 2024 Conference and Exhibition
Global satellite communications leader gives market a first look at its next-gen...
18/03/2024
Box to Box Films shares with MediaSilo
Box to Box Films Shares with MediaSilo Amy and Drive to Survive producer updates collaborators simply and securely Boston, MA, March 18, 2024 - Box to Box Fi...
18/03/2024
Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 2024
Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 20...
18/03/2024
Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio
Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio Brie Clayton March 18, 2024 0 Comments Blackmagic Design today announced ...
18/03/2024
FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking Software at NAB 2024
FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking ...
18/03/2024
DirecTV to Allow Subscribers to Opt Out of Local Stations
DirecTV announced a new feature over the weekend that will allow its subscribers to opt out of their local stations in return for a discount. Customers who ch...
18/03/2024
Logging and reviewing: Moving towards a sustainable workflow
Jane Sung, COO at Cinedeck, explains how broadcasters and content production companies can achieve the goal of moving towards creating a more sustainable, effic...
18/03/2024
Altice Media sold to French shipping tycoon for 1.55 billion
The deal includes BFM TV, one of the country's largest 24-hour news channels, as well as documentary channel RMC D couverte, and RMC Story By Jenny Priestl...
18/03/2024
Meet the CEO and founder
By TVBEurope Staff Published: March 18, 2024 Nick Franco tells TVBEurope how he went from being a master plasterer and refurbishing the ornate plasterwork ...
18/03/2024
Master the Avatar State: Glowing Eyes in Adobe After Effects
Master the Avatar State: Glowing Eyes in Adobe After Effects Levi Borland March 18, 2024 0 Comments In this step-by-step tutorial, learn how to recrea...
18/03/2024
Next Season of Doctor Who' on Disney Plus May 10
The next season of Doctor Who, with Ncuti Gatwa as the 15th Doctor, premieres on Disney Plus and around the world May 10. It is the first season to launch on Di...
18/03/2024
Screen Australia and VicScreen launch new Screen Careers initiative
18 03 2024 - Media release Screen Australia and VicScreen launch new Screen Careers initiative LTR Denise Eriksen, Esther Coleman Hawkins, Caroline Pitcher, K...
18/03/2024
CBC/WRAL Night Helps Bring in Over $26k for PBS NC
Capitol Broadcasting and WRAL-TV continued a decades-long tradition of supporting PBS North Carolina, our state's public television station, to good result ...
18/03/2024
Tonight on My Brother's Keeper: Nomusa leaves Moketsi's house in a rush
Tonight on My Brother's Keeper: Nomusa leaves Moketsi's house in a rushDon't miss Monday, 18 March's riveting episode of South African soapie My...
18/03/2024
Tonight on House of Zwide: Zola discovers she's pregnant
Tonight on House of Zwide: Zola discovers she's pregnantDon't miss Monday, 18 March's riveting episode of South African soapie House of Zwide on e.t...
18/03/2024
Big Brother Mzansi 4: Papa Ghost secures back-to-back Head of House wins
Big Brother Mzansi 4: Papa Ghost secures back-to-back Head of House winsPapa Ghost has clinched consecutive victories as Head of the House in the latest edition...
18/03/2024
NVIDIA Edify Unlocks 3D Generative AI, New Image Controls for Visual Content Providers
NVIDIA Edify, a multimodal architecture for visual generative AI, is entering a ...
18/03/2024
From Atoms to Supercomputers: NVIDIA, Partners Scale Quantum Computing
The latest advances in quantum computing include investigating molecules, deploying giant supercomputers and building the quantum workforce with a new academic ...
18/03/2024
New NVIDIA Storage Partner Validation Program Streamlines Enterprise AI Deployments
A sharp increase in generative AI deployments is driving business innovation for...
18/03/2024
NVIDIA Unveils Digital Blueprint for Building Next-Gen Data Centers
Designing, simulating and bringing up modern data centers is incredibly complex, involving multiple considerations like performance, energy efficiency and scala...
18/03/2024
Generative AI Developers Harness NVIDIA Technologies to Transform In-Vehicle Experiences
Cars of the future will be more than just modes of transportation; they'll b...
18/03/2024
All Eyes on AI: Automotive Tech on Full Display at GTC 2024
All eyes across the auto industry are on GTC - the global AI conference running in San Jose, Calif., and online through Thursday, March 21 - as the world's ...
18/03/2024
All Aboard: NVIDIA Scores 23 World Records for Route Optimization
With nearly two dozen world records to its name, NVIDIA cuOpt now holds the top spot for 100% of the largest routing benchmarks in the last three years. And thi...
18/03/2024
We Created a Processor for the Generative AI Era,' NVIDIA CEO Says
Generative AI promises to revolutionize every industry it touches - all that's been needed is the technology to meet the challenge. NVIDIA founder and CEO ...
18/03/2024
Banglalink Gets Unified Licence to Deliver Superior Digital Services in Bangladesh
18 Mar 2024 Banglalink Gets Unified Licence to Deliver Superior Digital Service...
18/03/2024
Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its network
Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...
18/03/2024
Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its ne...
Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...
18/03/2024
Major League Soccer: IMG on Capturing Fan Rituals and Delivering Consistent Coverage
Major League Soccer: IMG on capturing fan rituals and delivering consistent cove...
18/03/2024
Smashing Padel: Inside Aurora's Innovative Production of the Inaugural Hexagon Cup
Smashing padel: Inside Aurora's innovative production of the inaugural Hexag...
18/03/2024
Airspeeder Teams Up With EMG for World's First Live Broadcast of Flying Car Series
Airspeeder teams up with EMG for world's first live broadcast of flying car ...
18/03/2024
Netflix Announces News About 26 Upcoming Nordic Titles - Including 12 Brand New Titles
Back to All News Netflix Announces News About 26 Upcoming Nordic Titles - Inclu...
18/03/2024
Final sprint in the AS4 market communication
Final Sprint in the AS4 Market Communication: All Arvato Systems Customers Are Ready to Go Customers for market communication AS4-ready Arvato Systems is now...
18/03/2024
Tonight on Uzalo: Nkunzi takes a drastic decision
Tonight on Uzalo: Nkunzi takes a drastic decisionDon't miss Monday, 18 March's riveting episode of South African soapie Uzalo on SABC 1 on DStv channel ...
18/03/2024
Thales to modernize Montreal Mtro blue Line,improving passengers' punctuality and train reliability
Facebook Twitter LinkedIn Following a call for tenders, the Soci t de tra...