Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Europe Stories

03/12/2025

ToolsOnAir Composition Builder 2025 Boilerplate

ToolsOnAir Composition Builder 2025 Boilerplate More Details: The Composition Builder 2025 application for macOS enables TV stations and Live Event broadcast...

03/12/2025

ToolsOnAr just:live pro 2025 Boilerplate

ToolsOnAr just:live pro 2025 Boilerplate More Details: just:live pro 2025 is a Single Channel Live Production Playout solution for video and static or real-t...

03/12/2025

ToolsOnAr just:play pro 2025 Boilerplate

ToolsOnAr just:play pro 2025 Boilerplate More Details: just:play pro 2025 is a Single Channel automated 24/7 Master Control playout solution with SD, HD and ...

03/12/2025

ToolsOnAr live:cut 2025 Boilerplate

ToolsOnAr live:cut 2025 Boilerplate More Details: live:cut is an option to just:in mac pro 2025 and enables multicamera production workflows for up to 16 cam...

03/12/2025

ToolsOnAir Just In Mac Lite NDI 2025 Boilerplate

ToolsOnAir Just In Mac Lite NDI 2025 Boilerplate More Details: The Just In Mac Lite NDI application is a streamlined media capture solution designed specific...

03/12/2025

ToolsOnAir Just In Mac Lite 2025 Boilerplate

ToolsOnAir Just In Mac Lite 2025 Boilerplate More Details: The Just In Mac Lite application is a streamlined media capture solution designed specifically for...

03/12/2025

ToolsOnAir just:in mac pro 2025 Boilerplate

ToolsOnAir just:in mac pro 2025 Boilerplate More Details: just:in mac pro is a macOS-based client-server multichannel capture solution to record SDI, HDMI, N...

03/12/2025

Opportunity awaits Young Journalist of the Year winner

Tracy Bonareri Onchoke, Thomson's Young Journalist of the year 2025 is hoping the accolade will be a springboard to more cross-border collaboration between ...

03/12/2025

Listeners Worldwide Crown Bad Bunny Global Top Artist for the Fourth Time and His Latest Release Takes Global Top Album

For the fourth time, Bad Bunny is the most-streamed Wrapped artist on Spotify gl...

03/12/2025

2025 Wrapped Is Here With More Layers, Stories, and Connection Than Ever Before

The wait is over. It's time to look back at the audio that defined your year with 2025 Spotify Wrapped, our annual celebration for fans, artists, creators, ...

03/12/2025

Los oyentes del mundo coronan a Bad Bunny como el Top Artista Global por cuarta vez y su ltimo lanzamiento se lleva el Top lbum Global

Por cuarta vez, Bad Bunny es el Top Artista Global de Wrapped en Spotify, con 19...

03/12/2025

These Music Trends Took 2025 in Surprising New Directions

Spotify Wrapped is back, and as always, it's powered by the billions of streams that fans around the world delivered throughout the year. From the artists w...

03/12/2025

The 2025 Wrapped Guide for Artists, Songwriters, Creators, Authors, and Advertisers

Spotify Wrapped is the moment when hundreds of millions of fans around the world...

03/12/2025

The Top Artists, Songs, Albums, Podcasts, and Audiobooks of 2025

With more than 700 million listeners around the world turning to Spotify to soundtrack their lives, it's time to look back at the audio that defined the yea...

03/12/2025

Los top artistas, canciones, lbumes, pdcasts y audiolibros de 2025

Con m s de 700 millones de oyentes en todo el mundo usando Spotify para acompa ar su d a a d a, es momento de mirar hacia atr s y ver el audio que marc el a o....

03/12/2025

Inside the 2025 Audiobook Trends on Spotify: Romantasy, Modern Classics, and What's Next

From page-turning thrillers to inspiring memoirs, audiobooks are becoming a core...

03/12/2025

Os Top Artistas, Msicas, lbuns, Podcasts e Audiolivros de 2025

Com mais de 700 milh es de ouvintes em todo o mundo recorrendo ao Spotify para embalar seu dia a dia, chega o momento de revisitar o udio que marcou o ano. Nos...

03/12/2025

How Our 2025 Wrapped Campaign Turns Your Year in Listening Into a Global Celebration

Spotify Wrapped celebrates the audio that defined our year, and the annual globa...

03/12/2025

Riedel and Haivision Join Forces to Advance Wireless Video Transmission

Wuppertal December 3, 2025 Riedel and Haivision Join Forces to Advance Wireless Video TransmissionRiedel Communications today announced a new partnership with...

03/12/2025

Take Five with Emily

Tell us a little bit about your job I am a Digital Marketing Executive working on Paid Social, PPC, and Organic Social. I joined the team in May 2025 and am enj...

03/12/2025

Harmonic and Normann Engineering Achieve Major Milestone with 20 Broadband Deployments Across Europe

SAN JOSE, Calif. and VIENNA - Dec. 3, 2025 - Harmonic (NASDAQ: HLIT) and Normann...

03/12/2025

Tidings of sport across RT this Christmas

S an Nollaig Celebrate 2025's top Irish sporting stars with RT Sport Awards live from RT Studios on RT One and RT Player RT pays tribute to Ror...

02/12/2025

Clear-Com's Gen-IC Virtual Intercom Delivers Fast, Flexible Communications for...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

02/12/2025

International organizations align at International AI Standards Summit

-- The International Electrotechnical Commission (IEC), the International Organization for Standardization (ISO), and the International Telecommunication Unio...

02/12/2025

Harmonic Powers Telia's Next-Generation Broadband Upgrade in Norway

Harmonic's cOS Platform Will Redefine Subscribers' Quality of Experience, Lowering Churn SAN JOSE, Calif. - Dec. 2, 2025 - Harmonic (NASDAQ: HLIT) today...

02/12/2025

All I want for Christmas is movies: RT unwraps hours of Festive films

S an Nollaig Hollywood blockbusters The Banshees of Inisherin, Barbie and Oppenheimer make their Irish TV debut Tune into the classics such as Love Actual...

02/12/2025

RT and Fs ireann/Screen Ireland unveil four new Storyland dramas for 2025

Showcasing fresh Irish storytelling and emerging talent Storyland 2025 signals a fantastic time for Irish drama RT and F s ireann/Screen Ireland are proud to...

01/12/2025

Oasis Live '25 Tour Brings The Biggest Band of the

MANCHESTER, UK - November 2025 - Announced two days before the 30th anniversary of Oasis' debut album, Definitely Maybe, the Oasis Live '25 tour marks t...

01/12/2025

Kyivstar and Ukrainian Ministry of Digital Transformation Select Google Gemma as the Foundation for Ukraine's National LLM

01 Dec 2025 Kyivstar and Ukrainian Ministry of Digital Transformation Select Go...

01/12/2025

Sky unveils official trailer for highly anticipated prequel Gomorrah The Origins coming to Sky and NOW early 2026

The prequel to the global hit Sky Original mob crime saga, Gomorrah' is a s...

01/12/2025

Step inside Nick Caves Veiled World a one-off special featuring Florence Welch, Flea and more, premiering 6 December on Sky and NOW

Featuring Florence Welch, Red Hot Chilli Peppers' Flea, designer Bella Freud...

01/12/2025

Fox Corporation Chief Financial Officer Steve Tomsic to Participate in Upcoming UBS Global Media and Communications Conference 2025

Fox Corporation Chief Financial Officer Steve Tomsic to Participate in Upcoming ...

01/12/2025

Arvato Systems' Virtual Private Cloud (VPC) Receives BSI C5 Certification (Type 2) Following Audit by HLB Stckmann

Arvato Systems' Virtual Private Cloud (VPC) Receives BSI C5 Certification (T...

01/12/2025

Consumer Magazines Returns System - 2025 Update

Summary This short video gives you an summary of the changes in under two minutes. --...

01/12/2025

From Ballet to Books: RT is Supporting 12 Arts and Cultural Events all over Ireland this December

As the festive season approaches, RT Supporting the Arts is proud to showcase a...

01/12/2025

Lights, Camera, Christmas: RT rings in the Season S an Nollaig

Festive specials of Christmas in Kilmainham presented by Marty Whelan, High Road Low Road, Callan Kicks the Year and Keys to My Life Ring in the New Year with ...

01/12/2025

Architect and presenter Hugh Wallace dies aged 68

Architect and television presenter Hugh Wallace, best known to RT audiences as a long-serving judge on Home of the Year, has died at the age of 68. In a state...

28/11/2025

4 Reasons Why Keeping Your Spotify App Updated Matters and What You Might Be Missing

It's easy to ignore those little red update available badges. But when it ...

28/11/2025

Sky Sports x Slawn drop limited-edition football jersey that unlocks a month of free content from the home of sport

Friday 28 November 2025 Sky Sports x Slawn drop limited-edition football jersey...

28/11/2025

Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds three billion euros for the first time

Rohde & Schwarz shows resilience in a challenging environment, revenue exceeds t...

28/11/2025

Changing children's lives for good: Donations for the RT Toy Show Appeal 2025 open tonight

Unwrapped: The Toy Show Appeal - airing this Sunday on RT One and RT Player- s...

27/11/2025

Sky unveils first look image from high-stakes action thriller Prisoner, coming 2026

Tahar Rahim and Izuka Hoyle star in the gripping six-part Sky Original from Acad...

27/11/2025

Sky Arts Reveals the Nations Greatest Basslines and Queen Reign Supreme

Thursday 27 November 2025 Sky Arts Reveals the Nation's Greatest Basslines - and Queen Reign Supreme The UK's most iconic basslines have been revealed...

27/11/2025

Arqiva Achieves Five-Star GRESB Rating

Rating reflects rating progress across areas including policies, diversity & inclusion, health & safety and Net Zero leadership Winchester, UK, 27 November 202...

27/11/2025

Retail Media Audits Explained: What Networks Need to Know

What are the industry standards for Retail Media? Kathryn explains that certification is based on the IAB Europe Retail Media Measurement Standards and the IAB ...

27/11/2025

Katie Taylor, Rachael Blackmore and Arthur Gourounlian among the guests on this week's Late Late Show

World champion boxer and Irish sporting icon Katie Taylor will be in studio this...

27/11/2025

Tonight on RT Prime Time, serious child protection concerns emerge over online gaming platform, Roblox

Roblox, one of the world's most popular online gaming platforms for primary ...