Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

22/07/2026

ERA II Vocal Codex from Eduardo Tarilonte

Library now available in Engine Player Another of Eduardo Tarilonte's popular sample libraries has just been moved over to Engine Audio's Engine Pla...

22/07/2026

Cloudvocals improved FlashTrack FT-15 DSP Microphone

All-in-one mic & DSP interface overhauled Cloudvocal have just refreshed the design of their all-in-one mic, audio interface and DSP processor, introducing ...

22/07/2026

Electro-Harmonix launch the Deluxe Big Muff Pi 2

The final boss of the lost dual-op-amp circuit Electro-Harmonix have just introduced the Deluxe Big Muff Pi 2, which they say offers their latest take on t...

22/07/2026

Clear-Com Delivers Integrated Communications for Fryderyk Awards Gala in Krakw

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

22/07/2026

Sky Documentaries announces The Salisbury Poisonings: A Spy Next Door

A poisoned spy, a secret war, and a small English city contaminated by a deadly chemical weapon. Available on Sky Documentaries from 4 AugustWednesday 22 July 2...

22/07/2026

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement with Spotify, SiriusXM, Triton Digital, Acast, and Libysn

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement wi...

22/07/2026

Arvato Systems and Lobster Enter into a Partnership

Arvato Systems and Lobster Enter into a Partnership and Combine the Integration Platform and Managed Services Flexible integration solutions for cloud, hybrid...

22/07/2026

RT PUBLISHES 2025 ANNUAL REPORT

RT REPORTS NET SURPLUS OF 22.5 MILLION IN 2025...

22/07/2026

Documentary on film censorship in Ireland coming to RT

In the Opinion of the Censor airs Monday 27 July at 9.35pm on RT One and RT Player In the Opinion of the Censor looks at how films for theatrical release wer...

21/07/2026

High Interest, limited resources: AI in Mongolia's newsrooms

New research involving a cross-section of Mongolias independent media landscape finds enthusiasm for AI as a tool to improve efficiency, sustainability and resi...

21/07/2026

elysia Channex Studio now available

High-end analogue channel strip boasts plug-in recall Originally revealed as a prototype back at NAMM 2024, the Channex Studio channel strip represented a b...

21/07/2026

Musik Hack announce HyFi mastering platform

Relies on same DSP as plug-in range Musik Hack's line-up has been influenced heavily by founder Stan Greene's work as a mixing engineer, and their M...

21/07/2026

Dirty Boy Jr. Series from Warm Audio

Official collaboration with boutique builder Dirty Boy Pedals Warm Audio have just announced the launch of a new guitar pedal range created in collaboration...

21/07/2026

Rohde & Schwarz showcases broad range of EMC test solutions at EMC+SIPI 2026 in Dallas, Texas

Rohde & Schwarz showcases broad range of EMC test solutions at EMC SIPI 2026 in ...

21/07/2026

X-Rite Pantone and NIFT Partner to Build Color Management Skills for India's Fashion and Textile Workforce

X-Rite Pantone and NIFT Partner to Build Color Management Skills for India's...

21/07/2026

Bluepeak Taps Harmonic to Speed Up Fiber Rollout and Expand into MDUs

Harmonics cOS Virtualized Broadband Platform and Pearl Remote OLTs Enable Flexible PON Migration, While SeaStar Optical Node Powers Cost-Effective Multi-Gigabit...

21/07/2026

RT announces biggest ever year for new drama

160 hours of Irish storytelling for 2026 KIN and The Walsh Sisters return RT has today unveiled its most ambitious drama slate ever, with a record-breakin...

20/07/2026

Graph Tech Guitar Labs open UK Online Store

Product range now readily available in the UK Graph Tech Guitar Labs have just announced the launch of a new UK Online Store that makes it quicker and easie...

20/07/2026

Audeze launch the Maxwell 2 ANC

Popular headset gains active noise cancellation The Maxwell headet was Audeze's first foray into the gaming world, and thanks to its Dolby Atmos compati...

20/07/2026

Sky brings free global roaming to millions of loyal customers when they choose Sky Mobile

Monday 20 July 2026 Sky brings free global roaming to millions of loyal custome...

20/07/2026

Red Seat Ventures Announces Introduction of Premium Creator and Podcast Communities to Amazon DSP

Red Seat Ventures Announces Introduction of Premium Creator and Podcast Communit...

20/07/2026

RT secures exclusive free-to-air Irish rights to the 2030 FIFA World Cup

FIFA World Cup Final sets new RT Player record as the most-streamed single event in the platform's history Over 1 million viewers watched live on RT 2 as ...

19/07/2026

Acustica reveal Mystic 2

Channel strip plug-in gets upgraded Acustica Audio's vintage-inspired channel strip plug-in has just been treated to an update that expands its tonal ra...

18/07/2026

IK Multimedia add Brown Panel Signature Collection to TONEX

Captures nine sought-after Fender amps IK Multimedia's latest TONEX expansion captures a selection of nine rare Brown Panel' Fender amps that were ...

18/07/2026

Frap Tools update the Magnolia

Latest batch ships alongside firmware update Since being unveiled at Superbooth 2025, Frap Tools' debut polysynth has been met with widespread praise, a...

17/07/2026

Sonuscore introduce Elysion Elements

Full engine access with reduced soundset Sonuscore have steadily been introducing a selection of reduced-cost and free versions of their flagship products r...

17/07/2026

Arturia AstroLab Silver & KeyLab Mk3 Ultra

Two new special-edition models revealed Over the past week, Arturia have launched special-edition versions of both their premium MIDI controller and stage p...

17/07/2026

Dirk Ulrich reacquires Plugin Alliance & Brainworx

Original founder now back at the helm In a message posted on his personal social media accounts, Dirk Ulrich has announced that both Plugin Alliance and Bra...

17/07/2026

Few mics are trusted on an antique Stradivarius copy 4099 is

From intimate acoustic settings to large-scale festival stages, her focus has remained constant: preserving the true natural voice of the violin in every perfor...

17/07/2026

RT Radio 1 continues its summer of stories, music, sport and conversation

New and returning series, live festival broadcasts, powerful documentaries and major sporting moments headline RT Radio 1's summer schedule RT Radio 1 is...

17/07/2026

Dith, Jacqui and Louise bring hurling fans together ahead of the All-Ireland Finals

Up For The Match - Live From Croke Park this Saturday at 8pm on RT One and RT ...

17/07/2026

DiscoverIreland.ie announced as official show sponsor of The Traitors Ireland series 2

RT Commercial has today announced DiscoverIreland.ie, as sponsor of The Traitor...

16/07/2026

Business Innovation Synergizer: Grants of up to 30,000 for media organisations

Media organisations with tested plans for new products, services or revenue models can now apply for grants of up to 30,000 through the Business Innovation Syn...

16/07/2026

Baby Audio release SubCulture

A new benchmark in bass enhancement Described as a new benchmark in bass enhancement , Baby Audio's latest release has been designed to augment the lo...

16/07/2026

Other Worlds Evolved from Zero G

Popular library rebuilt in new Orbita Engine Other Worlds Evolved is the latest of Zero G's sample libraries to be treated to a ground-up rebuild using ...

16/07/2026

Native Instruments announce Super*Saw

Created in collaboration with A. G. Cook The newest addition to Native Instruments' software collection introduces a new synth created by A. G. Cook, a ...

16/07/2026

Rohde & Schwarz supplies conformance test systems to Marquistech for India's first GCF RTO and PTCRB ATL lab

Rohde & Schwarz supplies conformance test systems to Marquistech for India's...

16/07/2026

RTW Network Display: Meters Anywhere

Modern broadcast facilities are no longer confined to a single control room. Production teams are spread across multiple workstations, machine rooms, studios, c...

16/07/2026

RTW Network Display: Compact Line vs TMxCore

Whether you're operating a single control room or managing metering across an entire broadcast facility, having the right information in the right place is ...

16/07/2026

Harmonic Commits $25,000 to Venezuela Earthquake Relief Efforts in Partnership with Global Empowerment Mission

San Jose, CA - July 16, 2026 - Harmonic (NASDAQ: HLIT) today announced a $25,000...

16/07/2026

RTW Network Display

Modern broadcast facilities are no longer confined to a single control room. Production teams are spread across multiple workstations, machine rooms, studios, c...

16/07/2026

Fox Corporation Executives to Discuss Fourth Quarter and Full Fiscal Year 2026 Financial Results Via Webcast

Fox Corporation Executives to Discuss Fourth Quarter and Full Fiscal Year 2026 F...

16/07/2026

More interfaces now compatible with Focusrite Control 2

More interfaces now compatible with Focusrite Control 2 Your Focusrite interface might now be compatible with a public beta support of Focusrite Control 2. If...

16/07/2026

FIFA World Cup semi-finals deliver whopper audiences as RT Player surpasses 21 million streams across the tournament to date

Together the semi-finals had a combined reach of 1.98 million unique individuals...

15/07/2026

Freqport unveil the Dual FreqInOut FO1-2RK

Launched alongside new FreqSoft installer Designed to bridge the gap between hardware and software, Freqport's FreqInOut FO1 unit provides a simple way ...