Sony Pixel Power calrec Sony

A Simple Guide to Formats and Codecs

09/04/2020

ORLANDO, Fla.- All I need is a QuickTime file. How many times have you heard this from a client? Unfortunately, that's not enough information. Here are the reasons why.

Digital files consist of format wrappers, data, and metadata. A format wrapper defines the type of file it is, as identified by the file extension, like .mpeg, .mov, .mp4, .mxf, etc. Think of a wrapper like a videocassette tape. It earmarks which player application should be compatible with that file, just like a VHS cassette told you that a VHS player was required. The data is the audio/video content contained within that format wrapper. The metadata is information about that data, such as date/time stamps, color profiles, and more.

UNDERSTANDING THEM

Audio and video signals are encoded into digital files using codecs-shorthand for compression/decompression. Most video files use data compression, whereas the audio signal in professional formats is typically uncompressed. On the other hand, consumer audio formats such as .mp3 and .m4a use a highly compressed codec. While we tend to associate certain codecs together with specific formats, like ProRes and .mov, they are not synonymous. For example, files can be encoded with the ProRes codec and stored in .mxf wrappers.

Video compression is defined as either lossy or visually lossless. This is determined by the codec type, data rate used to encode the file, frame rate, and frame size. File sizes will be smaller when a lossy method is used. But, they will display compression artifacts visible to the eye, because so much signal information is thrown away. Streaming services like Netflix and YouTube use lossy methods to get the signal to your home over the internet. Visually lossless codecs, like high bit-rate versions of the Avid DNx or the Apple ProRes family of codecs, are used in camera acquisition and post production. These codecs employ a high data rate for compression and will have significantly larger file sizes. However, compression artifacts are generally indiscernible to the eye compared to uncompressed video.

The vast majority of codecs used in production and post today are the proprietary intellectual property of companies or associations. They are not open source or open standard, even though their use may be ubiquitous. The use of a codec, especially to encode data to that codec, requires a licensing agreement. Typically, this is transparent and appears to be free to the user, but rest assured that an arrangement between companies has been made. As with all intellectual property, this can result in a codec no longer being available within an application if such an arrangement has ended between companies.

LIBRARY COMPONENTS AND THE 64-BIT TRANSITIONWhen a video file is played by an application, its data is decoded on-the-fly and displayed as RGB pixels to your screen or a viewer within the interface. This requires a set of installed library components that the application draws upon in order to read, decode, and display the video data. These components may be part of the computer's operating system or they are custom-installed components that only function for that one application.

Over time, Apple and Microsoft have dropped or deprecated support for older codecs within their own operating systems. For example, Apple's Catalina is a 64-bit operating system, with no support for 32-bit applications and library components. This means that certain codecs - including many still in active use, like DNxHD/HR-can no longer be decoded (played) through any application that depends on the 32-bit QuickTime framework used in previous versions of macOS. This is not an issue of the codec itself, but rather the library components used.

In order for such files to work within Catalina, Apple or the application developer has to write new 64-bit library components to play such files going forward. In the case of DNx, Avid and Adobe can read and write these files in the .mxf format, but Apple's own applications, like Final Cut Pro X or QuickTime Player, are not able to do the same. Expect that to be updated later this year.

WHY CAN'T I WRITE CAMERA RAW FILES IN POST?Digital video cameras convert raw sensor data into RGB pixel information and record that to a digital file using a defined codec and format. Processing is done in the camera to bake in the conversion of the Bayer pattern sensor data to RGB, along with its native ISO and a color profile. These files are then easily played by most professional editing and player applications.

Ever since the launch of RED Digital Cinema's RED One camera, compressed raw codecs have grown in popularity. When you record a camera raw signal, the conversion/processing step to RGB is skipped, thus enabling access to more latitude for color correction in post. It also generates higher quality images for an equivalent data rate and file size. The trade-off is that camera raw files tax the hardware systems used in post. That's because the conversions that would have been done in the camera are now performed in real-time by the computer.

Raw codecs store information generated by a camera's sensor and are only intended for image acquisition. You cannot write or re-encode camera raw files in post, because there is no sensor data available. Camera raw codecs are also proprietary to individual companies, including RED, ARRI, Apple, Blackmagic Design, and others. For now, there is no video equivalent to CinemaDNG, a photographic raw format developed by Adobe and then offered up as an open standard to the community. Although it could be argued that GoPro's CineForm RAW codec is a comparable solution for video.

The video from non-raw codecs can be adjusted through color correction, but you aren't actually altering the underlying color processing of the file itself. You are skewing the RGB information that
LINK: https://www.tvtechnology.com/news/a-simple-guide-to-formats-and-codecs...
See more stories from tvtechnology

North America Stories

25/04/2024

Inside the Archives: Highlighting the Importance of Preservation for the Festival's 40th Edition

Sundance Institute Founder Robert Redford during a press conference at the 1996 ...

25/04/2024

SNS Dealer Of The Year Awards: See The Full List Of Winners

alt= class=wp-image-12361 data-lazy-src=/wp-content/uploads/2024/04/NAB-booth-2024-960x540-1.jpg/> Set against a vibrant backdrop of innovation and collaboratio...

25/04/2024

Trends And Takeaways From NAB Show 2024

alt= class=wp-image-12356 data-lazy-src=/wp-content/uploads/2024/04/NAB-mod-win-960x540-1.jpg/>NAB's Eric Trabb (right) awards SNS with two NAB Show Product...

25/04/2024

Peacock Subs Jump 55% YoY to 34M in Q1 2024

PHILADELPHIA Comcast beat earnings estimates in its Q1 2024 financial report, as streaming losses continued to decline and Peacock's paid subscribers spiked...

25/04/2024

Seattle Kraken Inks Deals with Tegna and Prime Video

SEATTLE The Seattle Kraken have inked new multi-year agreements with Tegna and Prime Video that will expand access to their games over broadcast stations and st...

25/04/2024

Cintel Scanner G3 HDR+ Restores Egypt's Cinema Treasures to Their Former Glory

Cintel Scanner G3 HDR Restores Egypt's Cinema Treasures to Their Former Glo...

25/04/2024

Sinclair Names Kevin Coskren Chief Meteorologist at KTUL Tulsa

Sinclair Broadcast Group said it named Kevin Coskren chief meteorologist at KTUL, its ABC affiliate in Tulsa, Oklahoma....

25/04/2024

Attend The Business of TV News Event in D.C. on May 2

The Business of TV News, a new one-day event featuring Martha Raddatz, Shannon Bream, Glenn Kirschner and other major figures in television news, happens at Hot...

25/04/2024

Problematic FCC Conditions On Station Sale Could Create Detroit Drama

Conditions put on the proposed sale of WADL Detroit, to Mission Broadcasting have created a potential drama in the Motor City....

25/04/2024

TelevisaUnivision 1Q Loss Widens But DTC Business Expected To Turn Profit in Second Half

TelevisaUnivision reported a $52 million loss in the first quarter, up from $3 m...

25/04/2024

Comcast Earnings Flat As Video, Broadband Sub Losses Continue

Comcast reported flat first-quarter earnings as it reduced the red ink at Peacock but continued to lose video and broadband customers....

25/04/2024

Vevo Brings Music Videos To Telly's Dual Screen TVs

Music-video network Vevo said it launched its app on Telly, the company offering consumers free dual-screen TVs in return for data about what they're watchi...

25/04/2024

Future Today Redesigns Streaming App Interfaces

Future Today said it has introduced a redesigned user interface for about half of its 300 streaming apps, including Fawesome, HappyKids and iFood.TV....

25/04/2024

Deutsche Telekom Powers New MagentaTV Service With Broadp...

Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...

25/04/2024

Lightware Enhances Microsoft Teams Rooms with Powerful BY...

Lightware Visual Engineering, a leading manufacturer of connectivity solutions for the professional integrated systems market and a pioneer in signal management...

25/04/2024

Net Insight secures collaboration with DMC Production to...

Net Insight has entered into a collaboration with DMC Production that positions Net Insight at the forefront of sports broadcasting in the Nordics. Net Insight ...

25/04/2024

GlobalM and scoopa announce strategic partnership to faci...

GlobalM has announced a strategic partnership with scoopa, the specialists in broadcast-quality content distribution, offering a complementary service for live ...

25/04/2024

DDish TV LLC Chooses PlayBox Neo Channel-in-a-Box for Bro...

PlayBox Neo announces the completion of a new multichannel playout system for the DDish direct-to-home satellite television network in Mongolia. Based in the na...

25/04/2024

Legendary Producer Garth Richardson Chooses PMC Monitors...

Canadian music producer and engineer Garth Richardson also known as Gggarth due to his stutter - has embraced immersive audio by installing a PMC monitoring s...

25/04/2024

Televisa transforms its broadcast ecosystem with proven t...

Leading video software provider Synamedia today announced that Televisa, the Mexican telecommunications and broadcasting company, has chosen Synamedia as its pa...

25/04/2024

OTTera partners with ThinkAnalytics to enhance personaliz...

OTTera, a leading provider of end-to-end OTT and FAST channel solutions, proudly announces its strategic partnership with ThinkAnalytics, a global leader in adv...

25/04/2024

Perfect Weather Forecast for American Tobacco Events Tonight and Saturday

The American Tobacco Campus will be hopping with activity tonight and this weekend with two fun events! Durham Night Market At last! The Durham Night Market i...

25/04/2024

Qurate Launches The Big Dish on The Roku Channel

WEST CHESTER, Pa. Video commerce provider Qurate Retail Group has launched The Big Dish, a new culinary-themed FAST channel on The Roku Channel....

25/04/2024

HPA Opens Submissions for 2024 HPA Engineering Excellence Awards

LOS ANGELES The Hollywood Professional Association has announced that submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This re...

25/04/2024

DV Earns MRC Accreditation for CTV Viewability

NEW YORK The digital media measurement and analytics firm DoubleVerify has announced that it has received Media Rating Council (MRC) accreditation for Video Vie...

25/04/2024

DAZN FAST Channels to Launch on Tubi

SAN FRANCISCO Fox Corp.'s ad-supported streaming service Tubi has announced a licensing agreement with the sports platform DAZN that will see DAZN Ringside ...

25/04/2024

IAB Makes Three Appointments to Its Leadership Team

NEW YORK In the runup to the 2024 IAB NewFronts, the IAB has announced three key appointments to its leadership team....

25/04/2024

Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam for Android, and more

Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...

25/04/2024

Content Creation, Production, Distribution Is In a State of Flux

Content Creation, Production, Distribution Is In a State of Flux Andy Marken April 24, 2024 0 Comments My empathy is creeping towards what I would de...

25/04/2024

Capitol Broadcasting Company to Air Carolina Panthers Games on Triangle's Strongest Broadcast Signal

The Carolina Panthers and Capitol Broadcasting Company (CBC) announced they have...

25/04/2024

Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist

Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist The accomplished saxophonist secured a spot among the elite winners of this year's ...

25/04/2024

Local News Close-Up: St. Louis Born and Bred

Stations everywhere take pride in having a main anchor who comes from the market they represent. That applies in St. Louis, too, but it also pertains to general...

25/04/2024

Edward Moody Joins WBTW Myrtle Beach Anchor Team

Edward Moody is joining the WBTW Myrtle Beach, South Carolina, anchor crew, and will anchor the 5, 6 and 11 p.m. newscasts alongside Trish Williford. He comes f...

25/04/2024

MTV Moving VMAs To New UBS Arena in New York

MTV said the 2024 Video Music Awards will return to New York and take place at the new UBS Arena....

25/04/2024

Offbeat Comedy The Outlaws' Returns to Prime Video Next Month

Season three of comedy The Outlaws premieres on Prime Video May 31. Stephen Merchant co-created the show, and stars. There are five episodes....

25/04/2024

Bidders Interested in Buying Bounce, Says Scripps CEO Adam Symson

The E.W. Scripps Co. is evaluating offers for Bounce, its multicast channel for African-American viewers, according to a report from CNBC....

25/04/2024

Paramount Plus Renews Dora'

Paramount Plus has ordered a second season for Dora, the animated preschool show based on Dora the Explorer. The show, featuring Dora on a rainforest adventure ...

25/04/2024

Tribeca Festival 2024 Announces Audio Storytelling and Games Lineup

April 25th, 2024 Press Materials Available Here TRIBECA FESTIVAL 2024 ANNOUNCES AUDIO STORYTELLING AND GAMES LINEUP Audio Storytelling Program Features 10th ...

25/04/2024

NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand

NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand Mobile cells will help accommodate first responders, social media, sports betti...

25/04/2024

NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Production of Post-First-Round Draft Show on NFL+

NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Pro...

25/04/2024

NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presentations

NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presenta...

25/04/2024

Let the Pleasure Begin: Doctor Climax' and Its Steamy Q&A Column Debut June 13

Back to All News Let the Pleasure Begin: Doctor Climax' and Its Steamy Q&A...

25/04/2024

Netflix Joins 'The Thursday Murder Club'

Back to All News Netflix Joins The Thursday Murder Club Entertainment 25 April 2024 Global Link copied to clipboard Writer, Director: Chris Columbus Prod...

25/04/2024

Into the Omniverse: Unlocking the Future of Manufacturing With OpenUSD on Siemens Teamcenter X

Editor's note: This post is part of Into the Omniverse, a series focused on ...

25/04/2024

Blast From the Past: Stream StarCraft' and Diablo' on GeForce NOW

Support for Battle.net on GeForce NOW expands this GFN Thursday, as titles from the iconic StarCraft and Diablo series come to the cloud. StarCraft Remastered,...

24/04/2024

Mundo Hispano Digital Launches MundoNow Connect

ATLANTA Mundo Hispano Digital has launched a new advertising product, MundoNow Connect, that is designed to help advertisers reach Hispanic audiences on connect...

24/04/2024

Epic Games Releases Unreal Engine 5.4

Epic Games has released a major new version of Unreal Engine, which has become a mainstay in virtual production, that includes new features and improvements to ...

24/04/2024

NAB Show Welcomes Creators to Las Vegas

The National Association of Broadcasters welcomed the industry to its annual extravaganza last month in Las Vegas. The sights and sounds were similar to previou...

24/04/2024

Chptr, Gray Television Launch on Video Obituary Platform

NEW YORK Chptr and Gray Television have announced that they are introducing a new video solution for funeral homes and communities that will allow funeral direc...