Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

18/11/2026

William Kamau: Young Journalist of the Year finalist 2026

William Kamau is an investigative journalist from Kenya. He says witnessing the pain, displacement and killings' that followed the country's 2007 elect...

18/11/2026

Humberto Basilio: Young Journalist of the Year finalist 2026

Humberto Basilio is a freelance science, health and environmental journalist from Mexico. He says that working in one of the most dangerous countries in the wo...

18/11/2026

Aaron Atsahyel: Young Journalist of the Year finalist 2026

Aaron Atsahyel is a multimedia investigative journalist from Nigeria who draws on his own experiences as someone displaced by the Boko Haram insurgency to tell...

18/11/2026

Eventide launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

18/11/2026

IK Multimedia announce Tonex Parametric

Parametric Tone Models emulate control responses & interactions IK Multimedia have just announced the launch of Parametric Tone Models, a new technology tha...

18/11/2026

Shure launch the MV360 Spatial Audio Microphone

Captures immersive audio on phone, tablet or computer via USB-C Shure have just announced the launch of the MV360 Spatial Audio Microphone, a compact USB-C ...

18/11/2026

Live from London, its Saturday night! Saturday Night Live UK returns 16 January on Sky and NOW

Wednesday 18 November 2026 Live from London, it's Saturday night! Saturday ...

18/11/2026

Sky Kids Investigates: Being a Boy

BAFTA award-winning series sees 16-year-old reporter explore topics including toxic digital influencers and disrespectful attitudes to girls in a groundbreaking...

18/11/2026

Choosing a display for TMxCore

TMxCore has no built-in display. If you use TMxCore with a network display, you may not need a dedicated display at all. If you prefer a directly connected scre...

18/11/2026

TeleData Accelerates XGS-PON Service Rollout in Germany and Unifies its Network with Harmonic's cOS Broadband Platform

Key Takeaways TeleData is building a unified DOCSIS and fiber network with Ha...

18/11/2026

Successfully achieved BSI C5 attestation

Arvato Systems Expands BSI-C5 Testing Greater Confidence in Cloud Security and Regulatory Resilience Successful BSI-C5 Retest Certification in accordance wi...

18/11/2026

RT to premiere new three-part documentary series Able

Brendan O'Connor joins six disabled job seekers as they navigate the barriers of finding work and challenge perceptions of disability in the workplace Begi...

18/11/2026

When writing becomes a weapon : New true-crime podcast series to reveal the impact of anonymous poison-pen letter case

Poison Ink begins Friday 20 November 2026 on RT Listen and RT Radio 1 Listen ...

18/11/2026

RT Choice Music Prize 2027 Key Dates Announcement

RT Choice Music Prize In association with IMRO and IRMA 2027 KEY DATES Irish Album of the Year 2026 Shortlist 18th January Irish Artist of the Year 2026 ...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

16/11/2026

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with highperformance oscilloscope

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with high p...

16/11/2026

CNAO and Hitachi launch advanced rotating proton therapy system in Italy

November 16, 2026 Hitachi system enables proton beams to be delivered from 360 degrees around the patient, expanding treatment capacity and supporting more pre...

16/11/2026

SES and ITU Expand Partner2Connect Digital-learning Initiative to 30 African Schools

Initiative in Malawi, Burundi, Zambia and Zimbabwe will leverage SES satellite s...

16/11/2026

U sees new original drama Fleet Street from the creators of Miss Scarlet

Images available HERE UKTV has announced Fleet Street (6x60'), a new period crime drama from Miss Scarlet creators Rachael New and Ben Edwards, coming to f...

16/11/2026

Sky and NOW bring some of the UKs biggest video podcasts to the big screen at no extra cost with Platform Media as first partner

From Graham Norton to Olivia Attwood and Joe Marler, a new collection of hit vid...

16/11/2026

Can Digital Product Passports help meet climate goals?

As countries gather to discuss climate targets at COP 31 this week, one question that is at the heart of debates is how to measure the environmental impact of t...

15/11/2026

Yamaha launch MGX, URX & CC1 updates

Mixers, interfaces & DAW controller receive new firmware Yamaha have just launched a trio of firmware updates that bring some powerful new functionality to ...

14/11/2026

Rotary Exciter & Resonator Clamps from ADDAC System

Modular innovators introduce two guitar-based products ADDAC System's recently introduced Four String Series makes it possible to integrate physical str...

13/11/2026

HLabs reveal the CL089

Studer-inspired 500-series PWM compressor unveiled The HLabs range already includes a couple of Studer-inspired offerings in the form of the PRE169 and EQ16...

13/11/2026

Freedom of Choice White Paper

Download Now! To view the white paper, please enter the following details: -- First Name* First Name Company* Country* Please select your countryA...

13/11/2026

Apple HomeView available today - UPDATE - Posted on 13 November 2026

Beginning today, November 13, Apple HomeView is available for purchase at Apple Store locations, on the Apple Store online, and in the Apple Store app in select...

12/11/2026

UVI release Twin 88 Keys

Blend between concert grand & vintage electric pianos UVI's latest release combines a concert grand with a vintage electric piano in a single instrument...

12/11/2026

Universal Audio reintroduce UAD Cooper Time Cube Delay

Native version of popular effects plug-in arrives Many of the plug-ins that used to require Universal Audios Apollo interfaces or DSP accelerators have made...

12/11/2026

Audient launch the iD Mk3 line-up

Four next-generation interfaces announced Following on from the release of their new flagship Thunderbolt interfaces, Audient have refreshed the design of t...

12/11/2026

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite payloads and radar at Space Tech Expo

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite ...

12/11/2026

Red Seat Ventures Announces Exclusive Partnership with Bryce Crawford and The Bryce Crawford Podcast

Red Seat Ventures Announces Exclusive Partnership with Bryce Crawford and The Br...

12/11/2026

More Pets, More Laughs, and More Chaos: The Big Pet Project is back

Airing Sunday 15 November on RT One and RT Player at 5.10pm A new series of The Big Pet Project kicks off this Sunday, brightening our winter evenings with a...

12/11/2026

U unveils first look teaser for brand-new drama, The Cadburys

Image available HERE Teaser available HERE A teaser for The Cadburys (6x60') has been released, introducing audiences to the core family of George (Harry ...

12/11/2026

Jeremiah Slovarp on building Jereco from the ground up in rural Montana

An island in rural MontanaJeremiah Slovarp owns Jereco in Bozeman, Montana, and teaches music technology and recording arts at Montana State University. He star...

12/11/2026

Introducing Ask the AI GP'

Who am I and whats an AI GP? Im Kathryn Hodgkinson, and Ive recently qualified as an Artificial Intelligence Governance Professional (AIGP), a certification awa...

12/11/2026

RT Coverage of European Political Community Summit in Dublin

RT will provide extensive coverage of the European Political Community Summit in Dublin across television, radio and online on Thursday, 12 November 2026. As p...

11/11/2026

Spitfire Audio & Eric Whitacre launch Eternity

Third collaboration with Grammy-winning composer & conductor Spitfire Audio have announced the release of Eternity, the third sample library to be created a...