Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Most recent headlines

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

28/03/2024

No votes for all

Out of an estimated 20,000 journalists in Pakistan, less than one thousand are women according to a recent Gender Disparity Report published by the Internationa...

28/03/2024

Give Me the Backstory: Get to Know 8 Women Filmmakers With Shorts at the 2024 Sundance Film Festival

A still from Jasmin Baumgartner's Bye Bye, Bowser, which screened as part ...

28/03/2024

The Best Shared Storage For Video Production

alt= class=wp-image-12214 data-lazy-src=/wp-content/uploads/2024/03/Best-Shared-Storage-EVO-logo-960x540-1.jpg/> Embarking on a cinematic journey or crafting a ...

28/03/2024

Future-Proofing the B-52

L3Harris is upgrading critical electronic warfare systems to ensure the iconic aircrafts spectrum superiority for decades to come....

28/03/2024

Supporting the RCAF for more than 25 Years with L3Harris' WESCAM MX-Series

L3Harris' WESCAM MX-Series EO/IR systems have supported the RCAF for more than 25 years....

28/03/2024

ENCO to Add AI News Anchor to Qimera Virtual Production Set

NOVI, Mich. During the 2024 NAB Show, ENCO will be showcasing an AI-driven virtual anchor delivering live news from a realistic 3D virtual news set....

28/03/2024

Johan de Nysschen Named President and CEO of ARRI Americas

MUNICH ARRI has announced that Johan de Nysschen has been put in charge of the ARRI Americas team as president and CEO ARRI Americas Inc....

28/03/2024

Fubo Inks Carriage Deal with YES Network

NEW YORK The YES Network and FuboTV have reached a multi-year carriage agreement that will allow Fubo to launch YES in its Pro base channel plan in time for YES...

28/03/2024

Dalet to Demo AI-Enabled Production, Automation and Monetization at NAB 2024

PARIS Dalet has announced that during its 2024 NAB showcase (booth #W1713), attendees can experience firsthand Dalet's collaborative, AI-enabled workflows t...

28/03/2024

Blackmagic Design Used on 2024 Oscar Nominated Films

Blackmagic Design Used on 2024 Oscar Nominated Films Brie Clayton March 28, 2024 0 Comments Blackmagic Design congratulates the many film professional...

28/03/2024

Arkona to Introduce BLADE//master Control and Orchestration Service at NAB 2024

Arkona to Introduce BLADE//master Control and Orchestration Service at NAB 2024 Brie Clayton March 28, 2024 0 Comments New option for BLADE//runner ke...

28/03/2024

Join Maxon for NAB 2024

Join Maxon for NAB 2024 Brie Clayton March 28, 2024 0 Comments Maxon returns to NAB with presentations by artists from around the world and demos of t...

28/03/2024

Boston Conservatory to Present Center Stage Production of A Midsummer Night's Dream at The Huntington

Boston Conservatory to Present Center Stage Production of A Midsummer Night'...

28/03/2024

The 4K cameras giving audiences an astronaut's view of Earth

TVBEurope meets Charles Black, founder and CEO of Sen, which has sent a payload of 4K cameras to the ISS to livestream images of Earth to audiences around the w...

28/03/2024

2024 Big Night In Raises $145k to Support Triangle Arts Councils

Capitol Broadcasting and WRAL-TV once again proudly supported our local arts community with the broadcast of Big Night in for the Arts Thursday, March 7, 2024. ...

28/03/2024

JIC, MRC Announce Accord On Roles In Judging Measurement Companies

With more companies offering different approaches to measuring television viewing and campaign effectiveness, two of the groups that evaluate potential media bu...

28/03/2024

Hulu Added to Disney Plus App for Bundle Subscribers

The Walt Disney Co. said that it launched Hulu on Disney Plus, which makes Hulu programming available via the Disney Plus app....

28/03/2024

GroupM To Double Ad Spending On Women's Sports Programming

Giant media buyer GroupM said it plans to double its media spending on women's sports....

28/03/2024

Scripps Renews State Farm As Sponsor of Friday Night WNBA on Ion

Scripps Sports said that State Farm has signed a new multi-year agreement to continue as the title sponsor of Ion's Friday night WNBA telecasts....

28/03/2024

Elisabeth Moss, Kerry Washington Sign On for Imperfect Women' on Apple TV Plus

Elisabeth Moss and Kerry Washington will star in, and executive produce, Imperfe...

28/03/2024

Telemundo Station Group Addresses Climate Change With Month-Long Initiative

Telemundo Station Group launches the month-long climate change initiative Our Planet Thursday, March 28. The multiplatform campaign ends on Earth Day, April 22,...

28/03/2024

Circle City Broadcasting Renews Nielsen Ratings Deal

Nielsen said that Circle City Broadcasting, owner of WISH-TV in Indianapolis, has renewed its local TV measurement deal....

28/03/2024

Lionsgate Extends Deal With Seth Rogen's Point Grey Pictures

Lionsgate Television said it extended its deal with Point Grey Pictures, the production company led by Seth Rogen, Evan Goldberg and James Weaver....

28/03/2024

Ariana DeBose Back as Tonys Host

Ariana DeBose returns as host of the Tony Awards Sunday, June 16, on CBS and Paramount Plus. It is her third consecutive time hosting, and it will be the 77th T...

28/03/2024

The Steve Wilkos Show' Renewed for Season 18

The Steve Wilkos Show has been renewed for its 18th season in national syndication, Tracie Wilson, executive VP, NBCUniversal Syndication Studios & E! News, sai...

28/03/2024

Sinclair Selects Embrace as Its Media Orchestration Engine

PARIS Embrace, a developer of advanced automation and orchestration software solutions, has announced that Sinclair Broadcast Group has selected Embrace's P...

28/03/2024

Nielsen and Circle City Broadcasting Renew Local TV Measurement Deal

NEW YORK Nielsen has a multi-year renewal with Circle City Broadcasting, Indianas only locally owned and operated broadcast and digital news media network, for ...

28/03/2024

JVC to Demo Its First Ever 40x Zoom PTZ Camera Series at 2024 NAB Show

LAS VEGAS JVC Professional Video has announced that it will debut its new KY-PZ540 Series PTZ Cameras with 40x zoom at 2024 NAB Show (Booth C4720)....

28/03/2024

Brightcove Launches Cloud Playout 2.0

BOSTON Brightcove has announced the launch of Cloud Playout 2.0, a platform that the company said will offer customers new ways to create linear channels, monet...

28/03/2024

NBC Sports Chicago to Air First-Ever Animated Real-Time Local Sports Telecast

The Chicago Blackhawks and NBC Sports Chicago have announced a collaboration with the NHL to bring fans the first-ever local animated real-time sports telecast....

28/03/2024

The Best News Coverage is Real, Live, Balanced, Professional

The Best News Coverage is Real, Live, Balanced, Professional Andy Marken March 28, 2024 0 Comments Hero image source News of the World, Perfect Wo...

28/03/2024

VEON Pays Back Outstanding Balance and Cancels its Revolving Credit Facility

28 Mar 2024 VEON Pays Back Outstanding Balance and Cancels its Revolving Credit Facility Amsterdam, 28 March 2024, 09.30 CET - VEON Ltd. (Nasdaq: VEON, Euronex...

28/03/2024

TNT Sports Gets Its College Game On for March Madness Audio

TNT Sports Gets Its College Game On for March Madness Audio Marching bands, crowds make up for lack of court FX and wired players By Dan Daley, Audio Editor ...

28/03/2024

Cosm/ESPN Deal Will Bring NBA, NHL, Tennis, College Football, and More to Shared Reality' Venues

Cosm/ESPN Deal Will Bring NBA, NHL, Tennis, College Football, and More to Share...

28/03/2024

MLB 2024: The Famous Group, Miami Marlins Team Up for AI-Powered Intro for All 2024 Home Games

MLB 2024: The Famous Group, Miami Marlins Team Up for AI-Powered Intro for All 2...

28/03/2024

MLB 2024: MLB Network Showcase Opts for Secaucus-Based Remote Production

MLB 2024: MLB Network Showcase Opts for Secaucus-Based Remote Production The league's production arm marks 15th-anniversary season with packed schedule By ...

28/03/2024

MLB Opening Day: ESPN Brings Sunday Night Baseball Into Analytic Age With Volumetric Replays, Win Probability' in Scorebug

MLB Opening Day: ESPN Brings Sunday Night Baseball Into Analytic Age With Volume...

28/03/2024

MLB 2024: FOX Sports Steps Up to the Plate With Big Audio Plans

MLB 2024: FOX Sports Steps Up to the Plate With Big Audio Plans More player and field sound will be on tap By Dan Daley, Audio Editor Thursday, March 28, 202...

28/03/2024

Rohde & Schwarz first to show measurements on novel Bluetooth Channel Sounding signals for positioning accuracy

Rohde & Schwarz first to show measurements on novel Bluetooth Channel Sounding ...

28/03/2024

Julia Rodgers Joins Riedel Communications as Southeast Regional Sales Manager, Bringing Decades of Industry Expertise

Wuppertal March 28, 2024 Julia Rodgers Joins Riedel Communications as Southeas...

28/03/2024

Netflix Announces Agatha Christie Series 'The Seven Dials Mystery' by 'Broadchurch' Writer Chris Chibnall

Back to All News Netflix Announces Agatha Christie Series The Seven Dials Myste...

28/03/2024

Haivision Showcases World-Leading Live Video Contribution Ecosystem at the 2024 NAB Show

Makito X4 video encoders, Haivision Pro mobile transmitters, StreamHub receiver,...

28/03/2024

FOR-A shows production flexibility for entertainment and sports at CABSAT

Compressed and uncompressed IP solutions alongside SDI...

28/03/2024

Tonight on House of Zwide: Zanele informs Zola of her pregnancy

Tonight on House of Zwide: Zanele informs Zola of her pregnancyDon't miss Thursday, 28 March's riveting episode of South African soapie House of Zwide o...

28/03/2024

Tonight on Umkhokha: MaMzobe outsmarts Gabisile but Difa's suspicion rises

Tonight on Umkhokha: MaMzobe outsmarts Gabisile but Difa's suspicion risesDon't miss Thursday, 28 March's riveting episode of South African soapie U...

28/03/2024

Tonight on Uzalo: Mbatha wins Linda Sibiya over

Tonight on Uzalo: Mbatha wins Linda Sibiya overDon't miss Wednesday, 27 March's riveting episode of South African soapie Uzalo on SABC 1 on DStv channel...

28/03/2024

Greater Scope: Doctors Get Inside Look at Gut Health With AI-Powered Endoscopy

From humble beginnings as a university spinoff to an acquisition by the leading global medtech company in its field, Odin Vision has been on an accelerated jour...

28/03/2024

Generations: The Legacy - Wednesday's episode, 27 March 2024 [VIDEO]

Generations: The Legacy - Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The S...