How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
By Philip Stevens
Published: October 22, 2020
How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch
https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>
One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.
So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.
Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.
Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.
We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.
Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.
Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.
We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.
As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.
So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.
To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.
In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.
Creating the data The technology also generates data about the actions so t
Europe Stories
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
19/08/2026
Studio owners invited to have their say on rates cuts
The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...
19/08/2026
Vintage-inspired desktop interface revealed
Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...
19/08/2026
Granular effect remains locked to scale and tempo
Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...
19/08/2026
First polyphonic SWAM instrument incoming
Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...
19/08/2026
There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...
19/08/2026
Wednesday 19 August 2026
Sky gives sports fans the chance to watch multiple liv...
19/08/2026
On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...
18/08/2026
Company launch with stereo-imaging tool
Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...
18/08/2026
Control software now available for older interfaces
Focusrite have just announced the launch of an update that extends Control 2 software support their Scar...
18/08/2026
Tuesday 18 August 2026
Sky Sports and The Fast and the Curious announce new partnership
Sky Sports and The Fast and the Curious have announced a new long-term...
18/08/2026
Wuppertal August 18, 2026
Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...
18/08/2026
Apple today announced changes to its business terms for apps in the European Uni...
18/08/2026
THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM
A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...
18/08/2026
Stunning Irish performances at European Athletics and Swimming Championships rea...
18/08/2026
The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player
...
17/08/2026
New MIDI processor & macro controller revealed
SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...
17/08/2026
Cover extended on innovative motorised pot system
Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...
17/08/2026
Latest firmware version now available
1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...
17/08/2026
Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...
17/08/2026
Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...
17/08/2026
Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...
17/08/2026
Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification.
...
16/08/2026
Virtual drummer joins line-up
The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...
15/08/2026
In-ear monitoring line-up gains new universal models
In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...
14/08/2026
Latest instalment delivers disco-inspired grooves
The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...
14/08/2026
Elite range gains giant 24-inch powered sub
The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...
14/08/2026
Friday 14 August 2026
Breaking news! Sky releases trailer for The Paper, return...
14/08/2026
It's been one year since our client, Cotswolds Designer Outlet, opened its doors and we've loved seeing the scheme come to life. Together, we've hel...
13/08/2026
Company preview bio-interactive' synthesizer
VAEMI have announced the upcoming launch of a new standalone bio-interactive' generative synthesizer....
13/08/2026
Plug-in host gains new Slot Scenes feature
Ravine DSP have recently updated their innovative plug-in host, kitting it out with a new feature that brings yet...
13/08/2026
New U and U&W Documentary Features Kathleen Richards, One of the Last Surviving Witnesses to Fred and Rose West
Kathleen is Reunited with Childhood Friend and ...
13/08/2026
Thursday 13 August 2026
Official trailer released for the return of Tea with Ju...
13/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
13/08/2026
Wenvoe serves over 1 million people across South Wales
13 August 2026, Winchester, UK - Vale of Glamorgan MP, Kanishka Narayan, has praised the engineering exp...
13/08/2026
RT 's Miriam O'Callaghan welcomed a range of specially invited guests to the National Concert Hall last week for a unique event to mark a new season wit...
13/08/2026
August 13 2026, 06:00 (PDT) Seattle Seahawks Become First Team to Bring Dolby O...
12/08/2026
Enhanced DAW & plug-in control for the UC1, UF8 and UF1
The software that powers SSL's range of control surfaces has just received a major update that d...
12/08/2026
In-line preamp features one-knob EQ
In addition to their range of in-line preamps, Triton Audio recently managed to squeeze a compressor into an enclosure t...
12/08/2026
Captures system audio with or without a DAW
Depending on your setup, capturing system audio in a DAW can be a tedious process, so much so that Arvital Audio...
12/08/2026
Comscore Reports Second Quarter 2026 ResultsRESTON, Va., August 12, 2026 Comscore, Inc. (Nasdaq: SCOR), a trusted partner for planning, transacting and evalu...
12/08/2026
NEW BOOKSHOP OPENING IN LONDON THAT OFFERS NEW IDENTITIES, NOT BOOKS, WITH FREE ...
12/08/2026
Brand-new trailer unveiled as Sky announces SNL UK ticket ballot will open on 14...
12/08/2026
Wednesday 12 August 2026
Sky Sports agrees deal to show Laver Cup from London's O2
Sky Sports has agreed a deal with Trident8 to show all three days of th...
12/08/2026
Wednesday 12 August 2026
Pre-order the new Google Pixel 11 range from today and...
11/08/2026
Free library captures pro classical string section
There's no shortage of freebies in The Crow Hill Company's line-up, with their Vaults series offe...
11/08/2026
Percussion instrument introduces all-new engine
Emergence Audio have just introduced an instrument that brings together a vast collection of percussive anal...
How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch
