Sony Digital Rapids Pixel Power calrec Sony

Master the Modes: HERO7 Black Scene Analysis + Advanced Metadata

23/03/2019

tools of the trade

Mar 22, 2019

We're about to get super meta here. But not in the self-referential, that's so meta way that became nomenclature in the early 2010s, sometime after Inception hit theaters. We're talking meta specifically in regard to metadata-i.e. data about data.

In early 2017, GoPro introduced GoPro Metadata Format, which open-sourced GoPro video metadata-sharing telemetry, temperature, image exposure and shutter speed, to name a few, in a dedicated MP4 track (much like an audio or video track within that file). In late 2017, we launched GoPro's first-ever custom processing chip, GP1, and HERO6 Black began to tap further into metadata capabilities.

And in 2018, *drumroll, please* we continued the meta momentum with HERO7 Black-the first GoPro with scene recognition as well as improved facial and smile recognition. These upgrades help with not only auto white balance (AWB), color rendering and color grading but also improve the QuikStories auto-editing experience.

To help explain, we asked the GoPro experts to give from a relatable scenario in which this benefits user, and what better than when taking the waterproof HERO7 Black under water.

The following words are by firmware architect Anandhakumar Chinnaiyan, who works out of the GoPro headquarters in San Mateo, Calif., and algorithm engineer Adrien Cariou, who works out of the GoPro Paris office.

Under the Sea: Metadata + Auto White Balance

Underwater photos and videos have been part of the GoPro DNA since Day 1. And starting with HERO5, we've been working toward making underwater footage easier than ever to capture. That means eliminating the need for color-correcting dive filters-less gear needed, means less gear to forget.*

From an image engineer point of view, the water acts like a blue filter and blocks most of the red-light rays. This phenomenon intensifies with depth: The deeper you dive, the less red rays will hit your sensor. Dealing with this lack of red coloring is one of the most challenging scenarios for our AWB algorithm to correct.

Historically, AWB was applied after analyzing the color of the scene, but this approach can lead to tricky defect called metamerism. Metamerism is when a color is perceived in different ways depending on the light source. For example, a yellow color swatch in sunlight can appear to be the exact same color as a green color swatch under a warm artificial light source. This is simply due to the human brain and its interpretation, and we rarely (if not, never) consider how our brains interpret color differently depending on ambient light sources, both consciously and unconsciously.

When the human brain is removed from the equation, and a machine is asked to make these differentiations, it gets trickier. AWB can't recognize metamerism, which makes it particularly difficult to color-correct underwater scenes proactively with AWB and Auto Exposure.

Enter HERO7 Black armed with the GP1 chip and advanced metadata capabilities. Now, with this GoPro, as you reach lower depths and less light is available, image analysis and metadata influence AWB and Auto Exposure to deliver color-corrected content straight from the camera.

While this underwater scene analysis is a favorite example amongst GoPro, it's actually only one of six scenes that HERO7 Black metadata can differentiate. The others are indoor, urban, beach, snow and vegetation.

These scene classifications are baked in to the AWB algorithm, using metadata, and rely on analyzing global parameters, such as the exposure condition, to deliver more accurate, natural colors straight from the GoPro.

Check out HERO7 Black here, and read more about open-sourced metadata here.

*Pro Tip Deep Dive: For all you Scuba Steves and Scuba Sallys out there who are diving to depths deeper than 10 meters, there are many variables that we cannot always predict and correct for-water color, changing light conditions and transmission. In this case, using a dive filter may still be necessary.
LINK: https://gopro.com/news/master-the-modes-advanced-metedata-underwater...
See more stories from gopro

Most recent headlines

21/04/2019

Weed growing guide: Cannabis indoors vs outdoors

Knowing the difference between an indoor grow and an outdoor grow can allow you to make an informed decision on how you would like to cultivate cannabis. And,...

21/04/2019

Warren Gatland set for Lions helm ahead of SA tour

Wales head coach Warren Gatland will lead the British and Irish Lions for the third time when they travel to South Africa in 2021, The Sunday Telegraph reports....

21/04/2019

Black Box Earns Top 2019 NAB Show Honors for Its Emerald Unified KVM Platform

Black Box Earns Top 2019 NAB Show Honors for Its Emerald Unified KVM Platform posted: 20/04/2019 Equipped With Innovative Software-Based Remote App, KVM Pla...

21/04/2019

Media Can Recover from its Missteps

Media Can Recover from its Missteps posted: 20/04/2019 by Andy Marken Howw nice of you to join us tonight and add COLOR to these monochromatic proceedi...

21/04/2019

Lotto and Lotto Plus results for Saturday, 20 April 2019

Are you ready for the Lotto and Lotto Plus draw on Saturday, 20 April? It's yet another chance to find out whether or not you're South Africa's late...

21/04/2019

Nedbank Cup semifinal results: Chiefs win thriller to book a place in final

Kaizer Chiefs will meet first-division outfit TS Galaxy in the Nedbank Cup final after beating Chippa United in a six-goal thriller at Port Elizabeth on Saturda...

20/04/2019

Stream the Songs That Motivate TIME's Most Influential People of 2019

Released today, the 2019 TIME 100-the magazine's list of the world's most influential people-features plenty of names you'll recognize instantly. An...

20/04/2019

PreSonus Weekend Rundown

It's been a busy week. Let's rehash the important stuff you may have missed. This is a fun one going on with our friends at Splice. Mix Nobody's ...

20/04/2019

Netflix: Animated kids movies available in South Africa [April 2019]

While Netflix doesn't officially report on how many subscribers it has in South Africa, estimates range from around 150 000 to over 300 000. Because one acc...

20/04/2019

Sundowns edge out 10-man Baroka to heat up title race

Mamelodi Sundowns remain in the hunt for the league title after beating Baroka 2-1 in the weekend's only PSL fixture, which took place at the Old Peter Moka...

20/04/2019

Trippin' With Skhumba: In conversation with Celeste Ntuli

Throughout the season, Skhumba and his friends travelled all over the country, visiting famous comedians' hometowns so we can learn more about our favourite...

20/04/2019

Canal Walk detail Ratanga Family Entertainment Centre

Fans of Cape Town's now defunct theme park Ratanga Junction have received some good news in the form of an announcement by Canal Walk Shopping centre. The ...

20/04/2019

Orlando Pirates should win the league even if Sundowns aren't docked points

Mamelodi Sundowns manager Pitso Mosimane appears to have conceded the title race to Orlando Pirates whom he feels are favourites to claim the title now. Pirate...

20/04/2019

ClayPaky Launches The First Beam Moving Light With A Laser Source At Prolight+Sound2019, Along With Several Other New Products

ClayPaky Launches The First Beam Moving Light With A Laser Source At Prolight So...

20/04/2019

Caves du Manoir upgrades with DiGiCo SD12

Caves du Manoir upgrades with DiGiCo SD12 posted: 19/04/2019 For 40 years, the Caves du Manoir in Martigny, Valais (Switzerland) have been used for cultural...

20/04/2019

Primetime Ratings: Big Bang' Paces CBS to Win

CBS got the top spot in Thursday ratings, with The Big Bang Theory leading to a 1.1 in viewers 18-49, per the Nielsen overnights, and a 5 share. In second was A...

20/04/2019

Natalie Morales Exiting Access

Just weeks after long-time Access executive producer Rob Silverstein was transitioned off of the entertainment magazine, co-host Natalie Morales also is departi...

20/04/2019

Weigel's WCIU Takes Over Chicago CW Affiliation in September

WCIU Chicago will become the CW affiliate in DMA No. 3 starting September 1. The station is owned by Weigel Broadcasting. The current CW affiliate in Chicago i...

20/04/2019

Powerball and Powerball Plus results Friday, 19 April 2019

It's Friday night and that can only mean one thing; cash dollar bills (not really) are ready to be won in the Powerball draw. Powerball and Powerball Plus ...

20/04/2019

Two Oceans Marathon: Live stream, start time results, route and more

The 2019 Two Oceans Marathon has had quite a few disruptions before the gun has even gone off. The route of the ultra event had to be changed due to the threat ...

20/04/2019

Weather forecast, alerts and UVB index for all South African provinces, 20 April 2019

Weather data provided by the South African Weather Service. For a detailed forec...

20/04/2019

3D Storm receives NAB2019 Top EMEA Distributor Award from NewTek

3D Storm receives NAB2019 Top EMEA Distributor Award from NewTek posted: 19/04/2019 At NAB 2019 show 3D Storm received an award as Top EMEA Distributor for ...

20/04/2019

Content We Loved This Week: April 19

in the wild Apr 19, 2019 All around the world, content creators are inspiring us. You know how much we love it! View this post on Instagram A post shared...

19/04/2019

7 Artists and Creators to Stream During Arab Heritage Month-and Year Round

April marks Arab Heritage Month in the U.S. To celebrate, we're featuring Arab American artists, comedians, and actors in our key Yalla Araby playlist. We k...

19/04/2019

2019 NAB Awards Roundup: Grass Valley, Panasonic, Ross Video, Quantum, and More Take Home Show Honors

2019 NAB Awards Roundup: Grass Valley, Panasonic, Ross Video, Quantum, and More ...

19/04/2019

Behind the Mic: ABC, ESPN Deploy Full Armada of On-Site Talent for Next Week's 2019 NFL Draft in Nashville

Behind the Mic: ABC, ESPN Deploy Full Armada of On-Site Talent for Next Week'...

19/04/2019

NAB 2019 Reflections: SportZcast's Mike Connell Envisions Vast Expansion Into New Sports Ventures

NAB 2019 Reflections: SportZcast's Mike Connell Envisions Vast Expansion Int...

19/04/2019

NAB 2019 Reflections: EVS's Sebastien Verlaine, Nicolas Bourdon Lay Out IP, Virtualized Future

NAB 2019 Reflections: EVS's Sebastien Verlaine, Nicolas Bourdon Lay Out IP, ...

19/04/2019

NAB Reflections: Panasonic's Mike Bergeron on 8K ROI and the Smart Studio

NAB Reflections: Panasonic's Mike Bergeron on 8K ROI and the Smart Studio Automated production and AR technology are also part of the studio design By Ken ...

19/04/2019

Sportradar, SportsGrid To Launch Free, 24-Hour Sports-Betting Network

Sportradar, SportsGrid To Launch Free, 24-Hour Sports-Betting Network By Jason Dachman, Chief Editor Friday, April 19, 2019 - 10:10 am Print This Story St...

19/04/2019

NAB 2019 Reflections: ChyronHego CEO Marco Lopez on the Importance of Sports-Venue, Esports Business

NAB 2019 Reflections: ChyronHego CEO Marco Lopez on the Importance of Sports-Ven...

19/04/2019

NAB 2019 Reflections: Object Matrix's Jonathan Morgan on the Power of Object-Based Storage for M&E

NAB 2019 Reflections: Object Matrix's Jonathan Morgan on the Power of Object...

19/04/2019

NAB 2019 in Review: The Major Trends and Surprises From the Big Broadcast Show in the Desert

NAB 2019 in Review: The Major Trends and Surprises From the Big Broadcast Show i...

19/04/2019

ZAYAN BAYAR BIL KEPERLUAN PEMINAT

ZAYAN BAYAR BIL KEPERLUAN PEMINAT Date Released:19 Apr 2019 Share Tweet Masalah pembayaran bil memberi tekanan dan membebankan anda? Sertai ZAYAN BAYAR u...

19/04/2019

IP-BASED SWITCHING SYSTEM OFFERS SUPERIOR OPPORTUNITIES - CHRISTIAN GOBBEL

Even though Internet Protocol (IP)-based systems are still in a phase where standards need to evolve and necessary features need to be consolidated, the opportu...

19/04/2019

Interra Systems Expands Dolby Partnership, Adding Support for Dolby Vision to BATON QC Platform

BCA Events 2012. Events 2013. BCA Events 2013 Interra Systems Expands D...

19/04/2019

Friday Tips: The Center Stage Reverb

If you've ever played a large venue like a sports arena, you know that reverb is a completely different animal than what the audience hears. You hear your i...

19/04/2019

NFVF Cycle 1 Funding Applications is Open

19 April, 2019 - 08:03 The National Film and Video Foundation, an agency of the Department of Arts and Culture is pleased to announce that the call for Cycl...

19/04/2019

Hellocomputer signs as Agency on Record' for A+E Networks Africa

19 April, 2019 - 08:03 Hellocomputer Johannesburg has successfully pitched for and signed as the agency on record for A E Networks Africa, the global media ...

19/04/2019

Adlib adds sonic magic to O2 Academy Glasgow with Academy Music Group

Adlib adds sonic magic to O2 Academy Glasgow with Academy Music Group posted: 19/04/2019 Adlib's installation team has delivered another excellent tou...

19/04/2019

4Wall Invests in Kinesys

4Wall Invests in Kinesys posted: 19/04/2019 Leading North American Lighting and Video rental specialist 4Wall Entertainment has invested in new Kinesys au...

19/04/2019

Complete workflow solutions from Datavideo at NAB 2019

Complete workflow solutions from Datavideo at NAB 2019 posted: 19/04/2019 The HS-3200: This feature rich machine has 12 inputs who are all accepting a mix...

19/04/2019

Super Rugby highlights: Sunwolves 23-29 Hurricanes

NOTE: Additional reporting by AFP, Super Rugby Highlights appear courtesy of SANZAAR. New Zealand's Hurricanes recovered their puff after a shaky start Fri...

19/04/2019

Philippines Easter: Devotees nailed to crosses, submit to flogging [pictures]

Please note that this article contains graphic images which might upset sensitive viewers. Eight men and a woman were nailed to crosses while hundreds of baref...

19/04/2019

Fox Orders Another Season of Last Man Standing'

Photo courtesy of ABC Fox has renewed the comedy Last Man Standing for 2019-2020. Tim Allen stars in the show. Next season will be Last Man's second on Fox...

19/04/2019

Fox Cancels Comedy Rel,' Drama The Gifted'

Fox has canceled the first-year comedy Rel and the sophomore drama The Gifted. Rel debuted Sept. 30, a multi-camera comedy from 20th Century Fox Television. It ...

19/04/2019

Season Two of Strange Angel' on CBS All Access June 13

Drama Strange Angel debuts season two on CBS All Access June 13. The period drama centers on Jack Parsons, who straddled the worlds of science and the occult, p...

19/04/2019

Premier League: Results, fixtures and EPL latest log 20 April 2019

EPL Fixtures on 20 April *All times SAST Manchester City vs Tottenham 13:30 Manchester City and Tottenham contest a repeat of their midweek Champions League...