How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/07/2026
New AI Assistant, Multi-channel Audio, ARA2 improvements & more
Tracktion's DAW software has just received its latest major update, gaining a selection ...
01/07/2026
Stammering, stuttering, strangulated tones
The Crow Hill Company's latest creation promises to be the most original sound set they've produced to d...
01/07/2026
Exclusive run of limited-edition modelling pedals
Sweetwater and Andertons M...
01/07/2026
UKTV has today announced the appointment of Matt Berry to the newly created role of General Manager - Marketing, effective 1 July.
Matt will take on this senio...
01/07/2026
Sky Zero Footprint Fund-backed TV campaign featuring Deborah Meaden challenges consumers to rethink everyday bathroom wasteWednesday 1 July 2026
Fussy asks Bri...
01/07/2026
Constituency-level analysis reveals where girls miss out most on sport - and where targeted action could unlock more than £640 million in economic and health be...
01/07/2026
Wuppertal July 1, 2026
Riedel and SKAARHOJ Expand Collaboration With SimplyLive IntegrationRiedel Communications today announced an expanded collaboration wit...
01/07/2026
Apple today introduced power-packed updates to Apple Creator Studio, a groundbre...
01/07/2026
Nectar360, the Retail Media, Loyalty and Insights business of the Sainsburys Gro...
01/07/2026
9.2 million streams on RT Player between 11 and 28 June
Reach of 2.9 million viewers during Group stages of FIFA World Cup on RT 2
23 million video views acr...
30/06/2026
Could your journalism reach an international stage?
Entries are now open for the Thomson Foundation's Young Journalist Award 2026, one of the most prestigi...
30/06/2026
Brings together saturation & lo-fi effects
Following on from the release of their Voxcraft vocal-processing plug-in, UJAM have announced the launch of Retro...
30/06/2026
New IR reverb engine, Juno-inspired chorus & more
The latest version of Rapid Flow's hardware-emulation synth plug-in expands on its predecessor with a ...
30/06/2026
Excels at heavy-handed VCA compression
For their latest release, Shy Audio have recreated the crunchy' sound of a rackmount compressor that found its w...
30/06/2026
Component scarcity drives cost increases
Shortly after Apple's CEO Tim Cook acknowledged that cost increases would soon be inevitable , the company hav...
30/06/2026
Hitachi and Bank Pekao S.A. have completed the installation of the first Hitachi...
30/06/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/06/2026
Four-layer instrument aimed at dark electronic music
Excite Audio's latest software instrument has been designed with dark drum and bass, atmospheric te...
29/06/2026
New AI Assistant, Multi-channel Audio, ARA2 improvements & more
Tracktion's DAW software has just received its latest major update, gaining a selection ...
29/06/2026
Details environmental policies & results
The Focusrite Group have just announced that following a long audit process, they have published their 2026 sustain...
29/06/2026
Arvato Systems Achieves AWS Cloud Operations Competency
The team behind the AWS Cloud Operations Competency (from left to right: Philipp Hellmich, Johanna Bod...
29/06/2026
RT today announced that Ger Gilroy will join the RT Podcasts team to present a daily sports podcast. Launching later this year, the new show will set the spor...
29/06/2026
RT Commercial announced OUTsurance as sponsor of the Oliver Callan show on RT Radio 1 from Wednesday 1 July.
Oliver Callan doubles the fun, delivering two ...
28/06/2026
Half-size model joins Console 1 line-up
Shortly after the release of their new Flow Studio controller, Softube have announced the launch of another new surf...
28/06/2026
New EXO Series DSP control software announced
EVE Audio's EXO Series monitor range has just gained a new software element that provides remote access to...
27/06/2026
Brings together saturation & lo-fi effects
Following on from the release of their Voxcraft vocal-processing plug-in, UJAM have announced the launch of Retro...
26/06/2026
Virtual session musician plug-in gains new percussion options
Celemony's latest update for their virtual session musician platform complements the exist...
26/06/2026
Half-size model joins Console 1 line-up
Shortly after the release of their new Flow Studio controller, Softube have announced the launch of another new surf...
26/06/2026
ELT Group and Rohde & Schwarz sign a cooperation agreement to explore commercial...
26/06/2026
Flicker Productions to produce five-part docu-reality series following women who have fallen for men in prison and have become TikTok sensations, with brands an...
26/06/2026
Catch up on the latest developments across Baselight and Daylight v7, Nara and F...
26/06/2026
26. June 2026 News
DFT is pleased to announce that a second Polar HQ film s...
26/06/2026
A fresh look at how the Irish helped shape the foundations of the United States
...
25/06/2026
Six free workshops across two days
Global music education platform Music Production for Women (MPW), have just announced a brand new and highly anticipated ...
25/06/2026
Popular pedalboard PSU gets an upgrade
The DC7 v2 is a new and improved version of the renowned effects pedal PSU from CIOKS, and is said to be the thinnest...
25/06/2026
Optimised for lush, enveloping sounds
Described as an instantly rewarding reverb , the latest addition to Arturia's range of creative effects plug-ins ...
25/06/2026
27 June 2026, Westminster University Harrow Campus
GearExpo UK is now upon us, with just two days to go until 150 of the worlds top pro-audio brands and ind...
25/06/2026
alt= data-nectar-img-srcset=https://www.antonbauer.com/wp-content/uploads/2026/0...
25/06/2026
Thursday 25 June 2026
Read all about it! The Paper will return for a second sea...
25/06/2026
Thursday 25 June 2026
How to watch the 2026/27 EFL season on Sky Sports
Which EFL matches are Sky Sports showing on the 2026/27 opening weekend?
Sky Sports w...
25/06/2026
Launching today (Thursday 25 June), new RT podcast Ramble with Joe McGucken is a series of curiosity-driven conversations where actor, writer and comedian Joe ...
24/06/2026
Plus: VoiceAssist Basic now available to UA LUNA users
NoiseWorks Audio have just released an update that adds a new Mouth De-Click module to the Advanced t...
24/06/2026
New heavy-duty mic stand joins range
The latest arrival to Gator's Frameworks family introduces a new heavy-duty boom stand that's been designed for...
24/06/2026
Latest major plug-in update goes live
Waves have just announced that the latest major update for their hugely popular plug-in range is now officially availa...
24/06/2026
When assessing cellular coverage, many people look at the signal bars displayed on a smartphone, router or modem. More bars are often assumed to mean better per...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
