How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
10/01/2026
This year, podcasts are making their Golden Globes debut with a new category honoring the medium's leading shows and creators. To mark the occasion, Spotify...
09/01/2026
RT Player has 157 million streams, up 10% year-on-year
An increase on 2024, RT...
09/01/2026
RT 2FM has today announced the highly anticipated list of 2FM Rising Artists for 2026, kicking off 2FM Rising week for the eighth year on The Tracy Clifford Sh...
09/01/2026
RT to Host the 2026 RTS Ireland Awards
Thursday, 16 April 2026 | Dublin Royal Convention Centre
The RTS Ireland Television Awards 2026 | Gradaim RTS 2026 | R...
08/01/2026
An evidence-based analysis on disinformation and information manipulation in Sudan's ongoing conflict is published today. (January 8th 2026).
Thomson Found...
08/01/2026
In 2025 we launched the Spotify Partner Program to give creators more ways to tu...
08/01/2026
On Wednesday in Los Angeles, Spotify welcomed creators and press to a brunch cel...
08/01/2026
TSA awards Rohde & Schwarz contract for advanced airport screening ahead of Socc...
08/01/2026
The review looks back at DPA's miniature microphone development over the years. It compares the evolving technologies from the original mics through CORE an...
08/01/2026
Comscore Launches Audio Targeting and Measurement Capabilities with The Trade De...
08/01/2026
Tonight, on RT Prime Time at 9:35pm on RT One and RT Player
Tonight, Prime T...
08/01/2026
The Late Late Show celebrates the very best of traditional Irish music with its first-ever full special dedicated entirely to the tradition
Lisa Canny | Kevin...
08/01/2026
It will be murder on the dancefloor when Dancing with the Stars returns this S...
07/01/2026
Spotify is launching a week-long celebration spotlighting creators at the center...
07/01/2026
We know people use Spotify not just to listen, but to share the songs, podcasts, and audiobooks they love with their friends and family. When we launched Messag...
07/01/2026
This week, all eyes are on the podcast industry as the Golden Globes recognizes ...
07/01/2026
Podcasts are stepping onto a new stage this week as the Golden Globes recognize the medium for the first time. To mark this milestone moment, we're hosting ...
06/01/2026
Spotify is launching a week-long celebration spotlighting creators at the center...
06/01/2026
Lorde. A$AP Rocky. JENNIE. Baby Keem. KATSEYE. That's just a taste of who...
06/01/2026
Channel 4 and UKTV are giving viewers even more reasons to stream, with UKTV's U service set to feature thousands of hours of free, unmissable and bingeable...
06/01/2026
Tuesday 6 January 2026
An update on our Sky Mobile prices
Devesh Raj, Chief Operating Officer, Sky
Today, we've announced some changes to the prices of ...
06/01/2026
Comscore Launches Daily Program-Level Reporting with Deduplicated Insights on Sh...
06/01/2026
Comscore Completes Recapitalization Transaction with Preferred Stockholders Foll...
05/01/2026
Bad Bunny's DeB TiRAR M S FOToS defined the sound of 2025 for listeners eve...
05/01/2026
As the clock struck midnight and 2026 was born, so was an exciting range of new ...
05/01/2026
These Sacred Vows starring Tom Vaughan-Lawlor, Justine Mitchell and Jason O'...
05/01/2026
DANDANCING WITH THE STARS RETURNS TO SHAKE UP SUNDAY NIGHTS
Reigning Rose of Tr...
02/01/2026
Any Given Day: Cork University Hospital premieres Wednesday 7 January on RT One and RT Player at 9:35pm
RT will debut a powerful new six-part documentary se...
02/01/2026
Friday 2 January 2026
All episodes of Heated Rivalry will be landing on Sky and...
02/01/2026
Sequins, chat shows, live sporting action, ground-breaking docuseries and brand-new Irish drama to kick off 2026
New Year, New Content Coming Soon across RT
...
01/01/2026
The Quantum 852 is situated in the 6,500-seat Seoul-based place of worship, a church which is home to a 1,000-person choir and a 50-piece orchestra. There are f...
01/01/2026
Formed in 2002, OneRepublic have enjoyed huge international success, with over 18 billion streams on Spotify alone. Their current tour, Escape to Europe, contin...
01/01/2026
We had been using the club's previous console for the last ten years, so we researched manufacturer information very carefully, says venue audio manager Mr...
30/12/2025
Your live countdown to 2026 with Inhaler, David Gray, Lyra, Garron Noone, Sharon...
29/12/2025
From crisper Lossless audio and immersive music videos in beta to new Audiobooks+ plans, custom transitions between tracks, and in-app Messages, we keep levelin...
24/12/2025
RT has unveiled an exclusive first look at the new Dancing with the Stars promo...
23/12/2025
The year is winding down, the weather outside is frightful, and it's the perfect time to escape into a story that warms the heart. For listeners looking for...
23/12/2025
23 Dec 2025
VEON's Beeline Kazakhstan and Rakuten Symphony Collaborate to A...
22/12/2025
For a decade, popular German podcast Fest & Flauschig has hosted an annual Chris...
22/12/2025
Monday 22 December 2025
Sky extends PGA TOUR partnership until 2029, as Sky Spo...
22/12/2025
Siobh n McSweeney, Rory McIlroy, Elon Musk, Catherine Connolly, Jim Gavin, Ivan Yates and Traitor Paudie Moloney lead new characters for Callan Kicks the Year 2...
22/12/2025
Winner announced in the picturesque surroundings of Wicklow's Avondale Tower and Treetop Walk
Andrew Trimble wins the show in his first series as coach
Th...
22/12/2025
The 2025 winners have been announced today, Sunday 21 December, for Ireland's largest choral competition Choirs for Christmas hosted by RT lyric fm.
Ove...
21/12/2025
John Shortt named Young Sportsperson of the Year Kerry are the Team of the Year
...
19/12/2025
With Playout Release 2025.4, ToolsOnAir continues to push professional playout w...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
