
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
20/11/2026
Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...
20/11/2026
Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30
Pierre Jasmin November 19, 2026
0 Comments
Long time friends of the COW are up with a big sale!
Us...
20/11/2026
Avid is offering up to 33% off annual subscriptions!
Brie Clayton November 19, 2026
0 Comments
Hero image courtesy Deposit Photos
Pro Tools
Pro To...
19/11/2026
With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...
19/11/2026
The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone
The future of live sports produ...
19/11/2026
RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...
19/11/2026
SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...
19/11/2026
CTech and Skyline Communications have announced a partnership to deliver integra...
19/11/2026
Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...
19/11/2026
The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...
19/11/2026
All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...
19/11/2026
Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...
19/11/2026
The Audio Engineering Society (AES) Technical Committee on Broadcast and Online ...
19/11/2026
NDI has released NDI 6.4, which adds Recording and Playback APIs, support for HEVC 4:4:4 and a configurable receiver buffer for Wi-Fi. The update also includes ...
19/11/2026
Lemonlight, the video production company behind more than 50,000 brand videos, has announced Hero, an AI production operating system, along with a new AI agent ...
19/11/2026
In a first-of-its-kind deployment at XFINITY Center, the digital signage/display...
19/11/2026
For the first time on a US streaming service, real-time player identification, contextual stats, and visual insights appear right in the live stream, available ...
19/11/2026
His career runs from the 2-in. videotape era to Canada's first HD and UHD live-production facilities...
19/11/2026
The popular sports-graphics event features a new Chairperson and new venue...
19/11/2026
Beth de Ara jo, Gemma Chan, Channing Tatum and Mason Reeves attend the premiere of Josephine at Eccles Theatre on January 23, 2026, in Park City, UT. (Photo b...
19/11/2026
New performance-focused brass library announced
Expressive E's latest release brings together four meticulously sampled brass instruments: sousaphone, b...
19/11/2026
Acoustic synthesizer gains free web editor
The phase8 acoustic synthesizer has been an ongoing project for Korg Berlin. It was unveiled as an early prototyp...
19/11/2026
MIDI controller keyboards upgraded
Designed for users who want a full-size keyboard and hands-on DAW control but in a relatively compact footprint, Nektar...
19/11/2026
Hugely popular compact monitor overhauled
IK Multimedia's ultra-compact monitors have proven to be incredibly popular, and the company say that they'...
19/11/2026
Rohde & Schwarz brings company-wide technology and service expertise to critical...
19/11/2026
On October 8, 2026, Nielsen employees came together around the world to celebrate our fourteenth company-wide day of service, Nielsen Global Impact Day (NGID). ...
19/11/2026
Integrating Gracenote's content intelligence with Nexxen's unique CTV supply allows advertisers to more closely align campaigns with audience viewing ha...
19/11/2026
Enhancement Mirrors Local TV's Recent Move to 1-Minute Qualifier (1MQ)
Upda...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
19/11/2026
As Founder and Creative Director of Future Phonic Studios, the Netherlands' first Dolby Atmos music studio, Richard Burki has spent more than a decade pushi...
19/11/2026
Boris FX Black Friday Sale - 25% Off Everything
Brie Clayton November 19, 2026
0 Comments
Check out the Boris FX Black Friday sale on Monday, November...
19/11/2026
Virtual Production Finds Its Middle Ground with Blackmagic Design
Brie Clayton November 19, 2026
0 Comments
How Neon Vision is using PYXIS 12K and Ult...
19/11/2026
FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Line...
19/11/2026
TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio
Brie Clayton November 19, 2026
0 Comments
TBS ACT streamlines post production for broad...
19/11/2026
Beeble launches SwitchX 3.0 with dynamic environments and greater creative contr...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...
19/11/2026
Five-year deployment has automated APL's media supply chain from fixture to archive, managing over 200,000 assets
Blue Lucy, the workflow orchestration and...
19/11/2026
Riding the Australian wave through co-pros 11 November 2026
L-R: The Surfer, We Bury the Dead
Australian stories are captivating global audiences and attracti...
19/11/2026
Screen Australia and Australian Film Television and Radio School announce the Fi...
19/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...