How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
19/03/2026
Berklee Popular Music Institute's 24th Showcase Channels '80s Prom Nosta...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
19/03/2026
How Chris Bolte Builds the Sound of PlayStation Games Chris Bolte '16 is a technical sound designer at Sucker Punch Productions, where he helps create the...
19/03/2026
Other Voices presents a legendary night of music as Foo Fighters bring their stadium anthems to St James' Church, An Daingean. The surprise performance teas...
19/03/2026
***Issued by RT on behalf of RTS Ireland Awards / Gradaim RTS 2026...
19/03/2026
It's a double feature on GFN Thursday. This week, GeForce NOW offers smoother sights in virtual reality (VR) and a sprawling new land to conquer.
Streaming...
18/03/2026
Newly named chief product officer (CPO), Larissa G rner Meeus will return to Net Insight on May 4.
Larissa G rner Meeus will become CPO of Net Insight on May 4...
18/03/2026
SVG Europe's The Football Summit 2026 explored how the sports broadcasting i...
18/03/2026
The 2026 NAB Show kicks off one month from today and SVG is once again set to cover the show from every angle. SVG's SportsTech@NAB Show Blog is now live - ...
18/03/2026
(L-R) The cast and crew of Dead Lover at The Ray Theater for its premiere at the 2025 Sundance Film Festival. (Photo by Robin Marshall/Shutterstock for Sundan...
18/03/2026
Yamaha C7 captured in Nashville
Wiltone Productions have announced the release of Music Row Piano, a deeply sampled Yamaha C7 piano library that's been ...
18/03/2026
Bass-enhancement plug-in upgraded
Along with a steady stream of new releases, Techivation have recently been revisiting some of the older plug-ins in their ...
18/03/2026
Mix-reference plug-in overhauled
iZotope's powerful mix-referencing plug-in has just reached its third major version, and now boasts a new capture proce...
18/03/2026
Latest EZKeys 2 expansion arrives
Toontrack's staggering collection of EZKeys 2 expansions has grown once again, and the latest instalment delivers a on...
18/03/2026
Jess Ho explores the politics of food in new SBS Audio podcast For The Culture
18 March, 2026
Media releases
New SBS Audio podcast For The Culture, hosted ...
18/03/2026
Future-ready broadcasts with ATSC 3.0 and enhanced services from Rohde & Schwarz...
18/03/2026
London Calling - When The Industry Convened to Help Streaming Find its MoJo In this blog, Laura Rognoni reflects on key discussions from the Connected TV World...
18/03/2026
SMPTE Unveils 2026 NAB Show Educational Presentations
Brie Clayton March 18, 2026
0 Comments
SMPTE , the home of media professionals, technologists, a...
18/03/2026
Auditel Ad Campaign Shot on Blackmagic PYXIS 12K
Brie Clayton March 18, 2026
0 Comments
LED wall virtual production blends 12K open gate acquisition w...
18/03/2026
Brainstorm transforms productivity and sustainability with Suite 7 at NAB Show 2...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/03/2026
SMPTE , the home of media professionals, technologists, and engineers, today unveiled its educational presentations for the 2026 NAB Show. This year SMPTE will ...
18/03/2026
Maxon, maker of powerful, approachable software solutions for creators working in 2D and 3D design, motion graphics, visual effects, gaming, and more, today ann...
18/03/2026
Digital Alert Systems
Preview
2026 NAB Show
April 19 - 22
Booth C3452
At the 2026 NAB Show, Digital Alert Systems will showcase Version 6.0 of its DASDEC ...
18/03/2026
Setplex today announced that it will showcase its complete, fully integrated Zapflex platform for the first time at the 2026 NAB Show, introducing powerful new ...
18/03/2026
THIS ANNOUNCEMENT RELATES TO THE DISCLOSURE OF INFORMATION THAT QUALIFIED OR MAY HAVE QUALIFIED AS INSIDE INFORMATION WITHIN THE MEANING OF ARTICLE 7(1) OF THE ...
18/03/2026
COW Jobs: Seeking DP for Low Budget Dramedy - Chicago
Brie Clayton March 17, 2026
0 Comments
Seeking Director of Photography for Low Budget Dramedy Fe...
18/03/2026
COW Jobs: Seeking Gaffer for Low Budget Dramedy - Chicago
Brie Clayton March 17, 2026
0 Comments
Seeking Gaffer for Low Budget Dramedy Feature Film- I...
18/03/2026
COW Jobs: Seeking Location, Sound for Low Budget Dramedy - Chicago
Brie Clayton March 17, 2026
0 Comments
Seeking Location/Sound for Low Budget Dramed...
18/03/2026
COW Jobs: Seeking Child Wrangler for Low Budget Film - Chicago
Brie Clayton March 17, 2026
0 Comments
Seeking Child Wrangler for Low Budget Dramedy Fe...
18/03/2026
Calrec Redefines Broadcast Workflows at NAB 2026 with its Most Powerful Hardware...
18/03/2026
Oscar Nominated Two People Exchanging Saliva Posted with DaVinci Resolve Studio
Brie Clayton March 17, 2026
0 Comments
DaVinci Resolve Studio handle...
18/03/2026
Boston Conservatory Presents Celebrated Musical Satire Urinetown Performances for this Center Stage production will take place at Boston Conservatory Theater ...
18/03/2026
Charlie Puth Joins Switched on Pop at Berklee NYC The Berklee alum spoke with host and Berklee NYC professor Charlie Harding for a live taping, answering audi...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
