How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
03/06/2026
RT has today announced Heineken 0.0 as the broadcast sponsor of their FIFA World Cup 2026 coverage.
The sponsorship, brokered by Dentsu, will see Heineken 0....
02/06/2026
Musically intelligent soft synth gets upgraded
Scaler Music will be probably be best known to many for their music theory tools, but their product range al...
02/06/2026
Powerful new vocal-production tool announced
Described as a vocal performance station , Klevgrand's latest plug-in combines pitch-correction with harmo...
02/06/2026
Launched alongside Go Green sale extension
McDSP have just released the latest addition to their APB line-up, DC-2 Dual Compressor, and have also announced ...
02/06/2026
Create custom tools for Ableton Live 12 Suite
Ableton have just introduced a new open JavaScript toolkit that allows anyone to create their own custom tools...
02/06/2026
Now features full H90 algorithm library
Eventide have announced the upcoming launch of the H9 Harmonizer Gen 2, a new and improved version of their hugely p...
02/06/2026
Plus UAD Half Yearly Sale now live
The latest arrival to the Universal Audio range delivers a new native pitch-correction plug-in that's capable of deli...
02/06/2026
Rohde & Schwarz to present comprehensive performance, conformance and spectrum-m...
02/06/2026
BTL Laboratory becomes Taiwan's first test house with a CTIA Certification c...
02/06/2026
If you've kept up with this article series, you know by now where to start w...
02/06/2026
With new DSP configurations and flexible licensing options, Calrec is removing the barriers to virtualised audio, giving broadcasters the freedom to scale produ...
02/06/2026
02 Jun 2026
VEON Closes USD 1.4 Billion Bond Offering, Refinancing 2027 Notes A...
02/06/2026
Praise for series three:
The Times - sun-dappled pleasure
The Daily Mail - The Homes Counties' Charlie's Angels
The Sun - 4* this [is an] enjoya...
02/06/2026
Wuppertal June 2, 2026
Gudrun Scharler Appointed CEO of Riedel Networks The Riedel Group today announced the appointment of Gudrun Scharler as CEO of Riedel N...
02/06/2026
Trust has become a commercial issue With global advertising spend forecast to exceed US$1 trillion this year*, the commercial consequences of weak governance co...
02/06/2026
June sees Ireland's cultural calendar in full bloom, as RT Supporting the Arts showcases a vibrant and wide-ranging programme spanning music, theatre, visu...
02/06/2026
After The Traitors Ireland launched in 2025, Irish audiences proved to have a taste for the global hit reality show. This Bank Holiday Monday fans can indulge e...
01/06/2026
Category line-up & sponsors announced
Photo: Paul Clarke
The Production Music Awards (PMA) have announced that submissions are now officially open ahead of...
01/06/2026
New hybrid sample/synthesis instrument revealed
Excite Audio have just released the latest instalment in their Evolve series, which has been developed in co...
01/06/2026
Latest TONEX expansion captures three rare vintage amps
The newest addition to IK Multimedia's ever-growing TONEX line-up introduces a set of three incr...
01/06/2026
Musically intelligent soft synth gets upgraded
Scaler Music will be probably be best known to many for their music theory tools, but their product range al...
01/06/2026
Rohde & Schwarz Satellite Industry Days 2026 guided by the motto From Earth to ...
01/06/2026
Luxembourg, June 1, 2026 - SES, a leading space solutions company, and Viva, Mexico's ultra low-cost airline, launched fast and reliable multi-orbit satelli...
01/06/2026
Mardi 2 juin 14h00
FilmLight (ARRI), 10 rue Ren Boulanger, 75010 Paris
Rejoignez-nous pour d couvrir comment FLAPI (l'API FilmLight) peut transformer e...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
29/05/2026
The days are getting longer, the temperatures are rising, and playlists are filling up for the season. With summer around the corner, Spotify's global edito...
29/05/2026
New retro-inspired MPC announced
There are few devices that have gained the status held by Akai Pro's MPC range, and in recent years, the company have s...
29/05/2026
Save up to 30 on acclaimed titles
Following a successful launch at Superbooth 2026, Bjooks have revealed that they will be continuing the Kickstarter campa...
29/05/2026
Binaural monitoring application improved
Genelec have just released an update that brings some powerful new features to their HRTF-based binaural headphone ...
29/05/2026
6 June 2026 at SAE Institute, London, UK
IMSTA FESTA 2026 is almost upon us, with some of the biggest names in pro-audio set to descend upon SAE Institute i...
29/05/2026
cetecom advanced certifies Rohde & Schwarz test solution for hybrid and Next Gen...
29/05/2026
May 29 2026, 09:00 (PDT) Dolby and rednote Bring More Immersive Storytelling to...
29/05/2026
Youtube exclusive special drops today
Watch now
UKTV today announces another e...
29/05/2026
Genelec announces V2.1 for Aural ID binaural headphone monitoring application posted: 29/05/2026
Aural ID 2.1 enhances binaural monitoring for stereo and ...
29/05/2026
At just 20 years old, Sean Melia from Summerhill Co. Meath has been revealed as the winner of Super Garden 2026. Sean is the youngest ever contestant and winner...
28/05/2026
Thomsons Climate Crisis Toolkit is already being put to work, helping journalist...
28/05/2026
A little refresh can go a long way. We've been making behind-the-scenes upda...
28/05/2026
Since early last year, our quarterly Creator Milestone Awards have celebrated podcasts from around the world that hit major streaming milestones on Spotify. Tod...
28/05/2026
New software-based MIDI multi-clock announced
Rapid Flow have just announced the launch of a new MIDI utility plug-in that aims to solve one of the most per...
28/05/2026
Company introduce most affordable interface yet
SSL's range of audio interfaces has just gained its latest, and smallest member, the SSL 1. Designed to ...
28/05/2026
New compact drum machine & sampler announced
The latest instrument from Sonicware sees the company kick off an all-new Deconstruct series with a compact dru...
28/05/2026
Hellenic Civil Aviation Authority modernizes nationwide ATC voice communications...
28/05/2026
Comscore Announces Appointment of Matt McLaughlin as Chief Executive OfficerJon Carpenter to remain as Senior Advisor to the Board and CEO
Global business lead...
28/05/2026
Wuppertal May 28, 2026
Berliner Ensemble Upgrades Backstage Infrastructure With Riedel Stage SystemsRiedel Communications today announced that Berliner Ensemb...
28/05/2026
Harmonic's Software-Based XOS Advanced Media Processor Powers Cost-Efficient 24/7 Channel Origination and Direct-to-Consumer Delivery
SAN JOSE, Calif. - M...
28/05/2026
RT presents Wild Conamara, a two-part natural history documentary that brings a...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
