Sony Digital Rapids Pixel Power calrec Sony

Master the Modes: HERO7 Black Scene Analysis + Advanced Metadata

23/03/2019

tools of the trade

Mar 22, 2019

We're about to get super meta here. But not in the self-referential, that's so meta way that became nomenclature in the early 2010s, sometime after Inception hit theaters. We're talking meta specifically in regard to metadata-i.e. data about data.

In early 2017, GoPro introduced GoPro Metadata Format, which open-sourced GoPro video metadata-sharing telemetry, temperature, image exposure and shutter speed, to name a few, in a dedicated MP4 track (much like an audio or video track within that file). In late 2017, we launched GoPro's first-ever custom processing chip, GP1, and HERO6 Black began to tap further into metadata capabilities.

And in 2018, *drumroll, please* we continued the meta momentum with HERO7 Black-the first GoPro with scene recognition as well as improved facial and smile recognition. These upgrades help with not only auto white balance (AWB), color rendering and color grading but also improve the QuikStories auto-editing experience.

To help explain, we asked the GoPro experts to give from a relatable scenario in which this benefits user, and what better than when taking the waterproof HERO7 Black under water.

The following words are by firmware architect Anandhakumar Chinnaiyan, who works out of the GoPro headquarters in San Mateo, Calif., and algorithm engineer Adrien Cariou, who works out of the GoPro Paris office.

Under the Sea: Metadata + Auto White Balance

Underwater photos and videos have been part of the GoPro DNA since Day 1. And starting with HERO5, we've been working toward making underwater footage easier than ever to capture. That means eliminating the need for color-correcting dive filters-less gear needed, means less gear to forget.*

From an image engineer point of view, the water acts like a blue filter and blocks most of the red-light rays. This phenomenon intensifies with depth: The deeper you dive, the less red rays will hit your sensor. Dealing with this lack of red coloring is one of the most challenging scenarios for our AWB algorithm to correct.

Historically, AWB was applied after analyzing the color of the scene, but this approach can lead to tricky defect called metamerism. Metamerism is when a color is perceived in different ways depending on the light source. For example, a yellow color swatch in sunlight can appear to be the exact same color as a green color swatch under a warm artificial light source. This is simply due to the human brain and its interpretation, and we rarely (if not, never) consider how our brains interpret color differently depending on ambient light sources, both consciously and unconsciously.

When the human brain is removed from the equation, and a machine is asked to make these differentiations, it gets trickier. AWB can't recognize metamerism, which makes it particularly difficult to color-correct underwater scenes proactively with AWB and Auto Exposure.

Enter HERO7 Black armed with the GP1 chip and advanced metadata capabilities. Now, with this GoPro, as you reach lower depths and less light is available, image analysis and metadata influence AWB and Auto Exposure to deliver color-corrected content straight from the camera.

While this underwater scene analysis is a favorite example amongst GoPro, it's actually only one of six scenes that HERO7 Black metadata can differentiate. The others are indoor, urban, beach, snow and vegetation.

These scene classifications are baked in to the AWB algorithm, using metadata, and rely on analyzing global parameters, such as the exposure condition, to deliver more accurate, natural colors straight from the GoPro.

Check out HERO7 Black here, and read more about open-sourced metadata here.

*Pro Tip Deep Dive: For all you Scuba Steves and Scuba Sallys out there who are diving to depths deeper than 10 meters, there are many variables that we cannot always predict and correct for-water color, changing light conditions and transmission. In this case, using a dive filter may still be necessary.
LINK: https://gopro.com/news/master-the-modes-advanced-metedata-underwater...
See more stories from gopro

Most recent headlines

25/06/2019

Filipe Lands 3rd Oi Rio Pro Victory

Pros Jun 24, 2019 The fifth stop on the WSL CT proved to be a big one for GoPro Athlete Filipe Toledo. The Brazilian went into the Barrinha fired up and ca...

25/06/2019

Record-Breaking UTV Jumps with Tanner Godfrey

Pros Jun 24, 2019 Hucking a UTV across a 200+ foot gap is one thing. Hucking it while using a metal rod to control the gas pedal to counteract partial para...

25/06/2019

Screen Australia announces $5.7m+ in production funding

25 06 2019 - Media release Screen Australia announces $5.7m in production funding Josh Lawson, Evie Macdonald, Grace Feng Fang Juan Screen Australia has ann...

25/06/2019

Milan-Cortina awarded the Olympic Winter Games 2026

Milan-Cortina awarded the Olympic Winter Games 2026 posted: 24/06/2019 Milan-Cortina, Italy, will host the Olympic Winter Games 2026. The decision was tak...

25/06/2019

USA Adds Asner, Cumming to Cast of Briarpatch'

USA Network said that award-winning actors Ed Asner and Alan Cumming will have recurring roles in the upcoming drama Briarpatch. Ed Asner Briarpatch stars Ros...

25/06/2019

Season 14 of It's Always Sunny in Philadelphia' on FXX Sept. 25

From left: Charlie Day as Charlie, Danny DeVito as Frank, Kaitlin Olson as Dee, and Rob McElhenney as Mac in FXXs "Its Always Sunny in Philadelphia" Credit: Pa...

25/06/2019

Rocky Mount Mills and American Tobacco Team Up for Summer Beer Garden

Rocky Mount Mills and American Tobacco are coming together for a super summer project, the Rocky Mount Mills Beer Garden @ American Tobacco. The sister campus...

25/06/2019

Updated: SAILOR MOON Season 5 Set 1 Statement

Updated: SAILOR MOON Season 5 Set 1 Statement The team here at VIZ was very excited to take on the honor of localizing SAILOR MOON, especially acknowledging th...

25/06/2019

BBC One announces new Agatha Christie thriller The Pale Horse

BBC One announces new Agatha Christie thriller The Pale Horse Company News June 24, 2019 The BBC, Mammoth Screen and Agatha Christie Limited today announce t...

25/06/2019

Windows 7 End of Support Announcement

Have you heard the news? Microsoft will be officially ending support of Windows 7 on January 14, 2020....

25/06/2019

Guns N' Roses Bassist Duff McKagan Sings a Message of Hope

Guns N' Roses bassist Duff McKagan has spent three decades touring the globe, playing for tens of thousands of fans at a clip. But he's always set aside...

25/06/2019

Legend of French Singer-Songwriter Serge Gainsbourg Looms Large on Spotify

Name just about any modern French or international superstar-Phoenix, Sebastien Tellier, Benjamin Biolay, David Bowie, Beck, Arctic Monkeys, Damon Albarn, Jarvi...

25/06/2019

Military University of Technology Utilizes Phantom UltraHigh-Speed v1612

The Military University of Technology (WAT) (http://www.go-poland.pl/university/military-university-technology), located in Warsaw, Mazowieckie, Poland, has rec...

25/06/2019

Rice University Gains Phantom Machine Vision S210

Rice University's Department of Chemistry (https://chemistry.rice.edu/) encompasses scientists and engineers who investigate the composition, properties, st...

25/06/2019

Seven Members of House, Senate Join as Cosponsors of Local Radio Freedom Act

Seven Members of House, Senate Join as Cosponsors of Local Radio Freedom Act 181 House Members, 23 Senators now oppose performance royalty on radio broadcasters...

24/06/2019

ANN SARNOFF NAMED CHAIR AND CEO OF WARNER BROS.

Proven Media, Business and Studio Executive Brings a Wide Range of Experience to the Role June 24, 2019 New York - WarnerMedia CEO John Stankey today announc...

24/06/2019

Avid to Celebrate the Music Community and Introduce New Audio Products at Avid Connect Live from Music City USA

Join Avid in Nashville or tune in online for the live unveiling of new products ...

24/06/2019

HOOQ Streams Live and On-Demand Video Content on Brightcove Video Platform

Singapore - June 24, 2019 - Brightcove (NASDAQ: BCOV), the leading provider of cloud services for video, today announced that HOOQ, Asia's leading OTT servi...

24/06/2019

GEORGE CLOONEY TO DIRECT AND STAR IN UNTITLED MARK L. SMITH PROJECT FOR NETFLIX

Hollywood, Calif., -- June 24, 2019 -Netflix announced today that Academy Award Winner George Clooney is in pre-production on an untitled feature project for Ne...

24/06/2019

UKTV flexes commissioning muscles and orders Eddie Eats America with Strongman, Eddie HallUKT

24 June 2019 UKTV has joined forces with former Worlds Strongest Man in brand ne...

24/06/2019

ARTE Journal picks AFP for its TV production in Germany

From the end of July, Agence France-Presse, through its German subsidiaries, will host ARTE Journals editorial office in Berlin. AFP will provide the Franco-Ge...

24/06/2019

Ericsson to transform 4G user experiences for Robi, Bangladesh

Robi chose the solution to enhance its LTE (4G) services in Bangladesh. Ericsson's Automatic Shared Carrier solution smoothly expands LTE capacity in legacy...

24/06/2019

KDDI and Ericsson drive innovation with new 5G Core use cases

Ericsson and KDDI, a leading telecommunications in Japan, will showcase their joint efforts to innovate and define 5G core network use cases during Mobile World...

24/06/2019

Multi-Screen Eurosport Approach Delivers 31% Video Streaming Increase During Roland Garros

Multi-screen Eurosport approach delivers 31% video streaming increase during Rol...

24/06/2019

Wimbledon 2019: BBC Sport To Offer Centre Court in UHD on iPlayer, HD Coverage from All 18 Courts

Wimbledon 2019: BBC Sport to offer centre court in UHD on iPlayer and provide HD...

24/06/2019

How CBS Sports HQ Delivered the NBA Draft

How CBS Sports HQ Delivered the NBA Draft Experts live in multiple locations helped viewership more than double last year's By Troy Dreier, Contributor, St...

24/06/2019

400,000 cool characters and a camera

Bertie GregoryFollow Bertie : Facebook LinkedIn Twitter Instagram Bertie Gregory, Nat Geo Wildlife Cameraman, Demands the Most Reliable Gear When Shooting in R...

24/06/2019

ITV commissions two part drama, Honour, starring Keeley Hawes

Published: Mon 24 Jun 2019 ITV commissions two part drama, Honour, written by Gwyneth Hughes, starring Keeley Hawes, directed by Richard Laxton and produced by...

24/06/2019

A Sound Education

Across the globe, schools and colleges are looking to train the next generation of broadcast engineers, and are finding that it entails more than just concepts ...

24/06/2019

Outstanding television programming about the environment to be recognised at tve's sustainability film awards

PA, the UK's leading provider of multimedia content and services, will again...

24/06/2019

BIRTV 2019

BIRTV 2019Exhibiting with partner: ATD TECHNOLOGY LTD. August 20-24, 2019 The China International Exhibition Center (CIEC) Beijing, China More information at: h...

24/06/2019

InfoComm India 2019

InfoComm India 2019September 18-20, 2019 Bombay Exhibition Centre Mumbai India More information at: http://www.infocomm-india.com/ About ApantacApantac LLC is ...

24/06/2019

The IOC, The Coca-Cola Company and China Mengniu Dairy Company Ltd announce Joint Worldwide Olympic Partnership to 2032

The IOC, The Coca-Cola Company and China Mengniu Dairy Company Ltd announce Join...

24/06/2019

Crown Media Claims Upfront Price and Volume Increases

Crown Media Family Networks said it finished its upfront negotiations, registering an increase in dollar sales volume and a double digit increase in commercial ...

24/06/2019

Netflix's Sarandos insists no plans to introduce advertising, or sport

Both are not core to the proposition of the streamer Jenny Priestley 5 hours ago Both are not core to the proposition of the streamer target=_blank t...

24/06/2019

Barco launches smart solution for remote radiology reading

Barco launches smart solution for remote radiology reading Kortrijk, Belgium, 24 June 2019 - Barco's remote radiology reading solution ensures dependable im...

24/06/2019

3D characters walk out of...

University of Washington researchers have developed a method to make people and characters walk out of still photos or paintings. The computer scientists deve...

24/06/2019

Analog Way appoints Demetrio Faroldi as EMEA sales...

Analog Way has named Demetrio Faroldi as sales director for EMEA. In his new position Faroldi leads the EMEA sales team to steer the development of sales across...

24/06/2019

Samsung installs 1,000 sq m LED screen in Times...

Samsung Electronics completed a huge five-screen LED display installation at the One Times Square building in New York City. The displays from Samsung measure m...

24/06/2019

Christie signs global reseller agreement with Arts...

Dale Miller, executive vice president, Cinema, Christie Christie has officially announced a worldwide* reseller agreement with cinema software provider Arts A...

24/06/2019

Holoplot to outline groundbreaking immersive audio tech in...

Holoplot will stage a webinar exploring the creation of immersive sound experiences using room acoustics on July 3, 2019. Audio technology innovator Holoplot ...

24/06/2019

CBC'ers Make Indy Week Best of Triangle List for 2019

CBC entities made Indy Week's 2019 Best of the Triangle list, published in June. Independent Weekly recently release the list of 2019 Indy Week Best of the...

24/06/2019

The Empire Strips Back in America

The Empire Strips Back in America posted: 24/06/2019 Hugely successful Australian burlesque Star Wars parody The Empire Strips Back has just completed i...

24/06/2019

Foxtel and Screen Australia announce new series Money School

24 06 2019 - Media release Foxtel and Screen Australia announce new series Money School Scott Pape Foxtel and Screen Australia announced today a new four-par...

24/06/2019

The propaganda films of apartheid-era South Africa

24 June, 2019 - 06:06 In the 1970s and 80s, the apartheid government funded a little-known film scheme aimed at black South Africans. In 1973, a ground-brea...

23/06/2019

Olympic Golden Rings award winners unveiled in front of 1,000 guests in Lausanne

Olympic Golden Rings award winners unveiled in front of 1,000 guests in Lausanne posted: 23/06/2019 This evening, the International Olympic Committee (IOC) ...

22/06/2019

Michael Ledesma uses Elation for Santana House of Blues residency

Michael Ledesma uses Elation for Santana House of Blues residency posted: 22/06/2019 One of our industry's most renowned and longest serving lighting de...

22/06/2019

NEP completes construction of Netherlands data centre

NEP completes construction of Netherlands data centre posted: 22/06/2019 NEP has completed the construction of its new data centre at the Media Park in th...

22/06/2019

Passaic County Technical Institute Upgrades Studio with Three JVC CONNECTED CAM Cameras

-- JVC Professional Video, a division of JVCKENWOOD USA Corporation, today ann...