How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Europe Stories
09/11/2025
Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
17/09/2025
Transatlantic collaboration combines experience and agility to drive innovation in network design and delivery
Luxembourg, September 16, 2025 - SES, a leading ...
17/09/2025
For the Moon Safari anniversary tour, AIR opened the doors to their backstage. Just a few hours before the Paris concert, DPA met with two key figures of the te...
17/09/2025
Auditions will be held in Dublin, Cork and Galway
The County Parade returns f...
16/09/2025
Hace una d cada, la m sica latina representaba apenas el 8% de las reproducciones globales en Spotify. Hoy, constituye m s de una cuarta parte (27%) de toda la ...
16/09/2025
A decade ago, Latin music made up just 8% of global Spotify streams. Today, it a...
16/09/2025
Spotify is expanding our video lineup with a new partnership with Zoo 55, part of ITV Studios. For the first time, acclaimed content from ITV Studios is landing...
16/09/2025
Calrec has strengthened its collaboration with audio metering expert RTW by integrating RTW's new TMxCore metering platform across its full range of Argo IP...
16/09/2025
Leading space solutions company will use optical ground stations to deliver faster, more secure data from space
Luxembourg, September 15, 2025 - SES, a leading...
16/09/2025
Comscore Unveils The Scoreboard: An Interactive Destination Surfacing Consumer B...
15/09/2025
Global K-Pop sensation aespa is redefining what it means to be rich with the r...
15/09/2025
Every day, millions of people around the world turn to Spotify to enjoy the audi...
15/09/2025
After months of intensive planning and implementation, Brembo SGL Carbon Ceramic...
15/09/2025
Unique sports content orchestration platform builds momentum among SES's cus...
15/09/2025
-- Opens door to growth in renewable energy New Delhi, India - 15th September -- Global business and industry leaders from around the world are joining technol...
13/09/2025
Harmonic's Software-Based XOS Advanced Media Processor Provides Unparalleled Efficiency and Unlocks New Business Models SAN JOSE, Calif. - Sept. 13, 2025 -...
12/09/2025
For fans, we know how important it is to stay plugged into music culture and dis...
12/09/2025
Link ping, Sweden and Shipley, United Kingdom, September 12, 2025 - Agama, the expert in video observability and analytics for service quality and customer expe...
12/09/2025
Feature-length retrospective from Studio Crook to air in 2026
Sir David Jason returns to the nation's favourite comedy channel, U&GOLD, for Open All Hours:...
12/09/2025
Friday 12 September 2025
The Boomtown Rats, Nyah Grace, Soweto Kinch, Royal Ballet and Madness also announced to perform at the ceremony on Tuesday
Sky today ...
12/09/2025
Wuppertal September 12, 2025
Riedel Unveils Ultra-Light Bolero Mini Wireless Intercom BeltpackAt IBC2025 in Amsterdam, Riedel Communications unveiled Bolero M...
12/09/2025
Wuppertal September 12, 2025
Riedel Communications Acquires hi human interfaceRiedel Communications today announced the acquisition of hi human interface fro...
12/09/2025
CORE+ virtually removes distortion, setting a new standard for church sound and giving worship teams the clarity and confidence they need.
Read the full artic...
12/09/2025
The Late Late Show is back with a bang after the summer break, and Patrick Kielt...
12/09/2025
The World Athletics Championships, Ireland v France in the Women's Rugby World Cup quarter-final, the Irish Champions Festival, and two Sports Direct Men...
12/09/2025
The Records Show starts Sunday at 6.30pm on RT One and RT Player.
Katie Hanno...
11/09/2025
RADAR, Spotify's program for emerging talent, recently hit a major milestone...
11/09/2025
Link ping, Sweden, September 11, 2025 - Agama, the expert in video observability & analytics for service quality and customer experience, announced today the la...
11/09/2025
Under the USD 89.6 Million award, SES Space & Defense will provide global commer...
11/09/2025
Leading Balkan DTH provider adds capacity to consolidate its m:Sat TV platform at 23.5 degrees East and serve more customers across the region
Luxembourg, 11 S...
11/09/2025
UKTV's free streaming service U launches on Sky Q
Free streaming service U has launched on Sky Q in the UK, UKTV and Sky confirm today, expanding the footp...
11/09/2025
From the discreet 2061 lavaliers to 4099 and 4011 mics, the setup delivered clean, natural sound in one of the most challenging broadcast environments.
Read th...
11/09/2025
From rugged build quality to natural, detailed sound, the verdict is clear: big performance can come in a very small package.
Read the full review here!...
11/09/2025
Tonight on Prime Time
RT One and RT Player at 9:35pm
Tonight RT Prime Time...
11/09/2025
RT Statement: 2026 Eurovision Song Contest
At the General Assembly of the European Broadcasting Union (EBU) in July, a number of EBU members raised concerns ...
10/09/2025
Lossless on Spotify Premium is here.
Lossless audio has been one of the most a...
10/09/2025
The Television Will Be Revolutionised Sep 10, 2025
Written by Sunit Kotecha, Director of Delivery and Operations, YouView
2025 marks a century since the f...
10/09/2025
First of Spains F110 frigates get future-ready with Rohde & Schwarz communicatio...
10/09/2025
Harmonic's cOS Platform Supports DOCSIS and Fiber, Enabling Midco to Deliver Reliable Multi-Gigabit Connectivity to Subscribers SAN JOSE, Calif. - Sept. 10,...
10/09/2025
RT brings three days of live radio, live entertainment, live news, live weather, personal appearances, and more
Join RT Radio 1: Morning Ireland, The Oliver ...
09/09/2025
Since 2020, Spotify's RADAR program has been a launchpad for emerging talent...
09/09/2025
In 2020, Spotify launched RADAR with a clear mission: to identify, nurture, and ...
09/09/2025
If you're on BookTok, you know the drill. You scroll, you tap, and suddenly your To Be Read list is overflowing with trending must-reads. Not unlike Spoti...
09/09/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
09/09/2025
Harmonic's VOS360 Ad SaaS Enables Personalized Ad Delivery and Seamless Integration with the Ad Tech Ecosystem SAN JOSE, Calif. - Sept. 9, 2025 - Harmonic ...
09/09/2025
St. Luke's Episcopal Church in New Jersey needed audio that truly connects and they found the answer.
Read the full case study here!...
09/09/2025
From AI-driven sound design to adaptable systems and uncompromising audio quality, the discussion highlights how innovation is shaping the future of performance...
09/09/2025
The conversation covers DPA's natural, uncolored sound, how to choose the right mic for any application and the company's latest innovations including C...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
