Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

05/02/2026

Tech Focus: Wireless Audio, Part 2 - RF Mics Have a Key Role in Sports Broadcasting

Three examples of how wireless microphones are deployed to bring fans in deep an...

05/02/2026

Samsung's Galaxy S25 Ultra Camera To Capture the Opening Ceremony

Broadcast coverage will include 25 cameras distributed around the venues, including to some athletes; Galaxy AI Interpreter will also be deployed The Opening C...

05/02/2026

Kiswe to Power Mountain West Conference's New Direct-to-Consumer Streaming Platform

Kiswe has partnered with the Mountain West Conference to power the next iteratio...

05/02/2026

NBCUniversal, Roku Launch the NBC Winter Olympics Experience

NBCUniversal and Roku announce the launch of the 2026 NBC Winter Olympics Experience, a destination delivering NBCUniversal's comprehensive CTV coverage of ...

05/02/2026

Vizrt Transforms Corporate Communications with AI-Powered Augmented Reality in Zoom

Vizrt, which specializes in live production technology as well as transforming v...

05/02/2026

Canon Intros RF7-14mm Fisheye Zoom, RF14mm Prime Lens

Canon USA has launched the RF7-14mm F2.8-3.5 L fisheye STM zoom lens and the RF14mm F1.4 L VCM prime lens. Building on Canon's legacy of innovative optics, ...

05/02/2026

UMass Lowell's Tsongas Center Upgrades with Ikegami UHK-X600 Cameras

The Paul E. Tsongas Center at UMass Lowell in Massachusetts has chosen Ikegami cameras for incorporation into its broadcast-quality television production facili...

05/02/2026

Exchange, NBCUniversal to Provide Service Members with Free Streaming of Winter Olympics

Once again, service members and Veterans worldwide will enjoy free access to NBC...

05/02/2026

Advanced Systems Group Appoints Industry Veteran Derek Pezzotti to Lead Sports and Venue Market Growth

Advanced Systems Group, LLC (ASG), a technology and services provider for media ...

05/02/2026

Broadcast Management Group Expands Management Team to Support Managed Services and Live Production Growth

Broadcast Management Group (BMG) is strengthening its leadership team to support...

05/02/2026

NBC Sports Selects Comcast Technology Solutions for Production of Winter Olympics

NBC Sports selects Comcast Technology Solutions (CTS) to provide multiscreen vid...

05/02/2026

AIM Sports Group Enhances AIM Sportsplex With Spiideo's Advanced Automated Video Technology

AIM Sports Group, a sports enterprise dedicated to elevating youth athletics thr...

05/02/2026

Inside the 2026 Milano Cortina IBC: How Tech Makes a Difference for Rightsholders, Fans, the Environment

Designed for efficient use of shared services and resources, the home of OBS pro...

05/02/2026

SVG Students To Watch: Brandon Malin, University of Michigan

The Yankees fan from Connecticut is executive producer of BTN StudentU for the Wolverines In the live-sports-video industry, the future is bright. Our series S...

05/02/2026

OBS Is Ready To Deliver for Milano Cortina Opening Ceremony

In an Olympic first, the ceremony will be held in four locations simultaneously...

05/02/2026

Remembering Charlie Jablonski, an Olympic Broadcasting Legend

Members of the broadcast and tech communities share four decades of memories of the technology leader The 2026 Milano Cortina Olympics are upon us, and every O...

05/02/2026

NBC Sports Has an Army of Technology Providers Supporting Winter Olympics Production

Key vendors include Appear, Audio-Technica, Canon, Chyron, Cisco, Comcast Techno...

05/02/2026

Spotify Partners With Bookshop.org and Debuts Page Match Feature to Bridge Physical, E-book, and Audio Formats

Since bringing audiobooks to Spotify in 2022, we've helped listeners discove...

05/02/2026

How to Use Page Match to Seamlessly Switch Between a Book and Its Audiobook on Spotify

Today, Spotify announced two new updates to give book lovers a more personalized...

05/02/2026

HC-130J Aircraft Enhances Coast Guard Readiness

A U.S. Coast Guard HC-130J aircraft during a test flight at L3Harris' facility in Waco, Texas....

05/02/2026

Al Seer Marine and L3Harris Deepen Strategic Agreement to Advance Maritime Unmanned Systems in the Middle East

Al Seer Marine and L3Harris have announced a strategic partnership combining UAE...

05/02/2026

Well-Thought-Out UX: The Quiet Power Behind Our Latest Improvements

AI should balance automation (replacing tasks) and augmentation (empowering humans). Automate the mundane and augment the creative by applying the right AI type...

05/02/2026

Football And Younger Viewers Drive Ad Supported TV Viewing To 2025 High, Nielsen's Q4 2025 Ad Supported Gauge Finds

During this period, streaming comprised the majority of ad supported TV (45.6%),...

05/02/2026

New Orlando TV Station Focuses On Puerto Rican Viewers

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

Teads, Google TV Partner To Grow CTV HomeScreen Ad Availability

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

Advanced Systems Group Appoints Industry Veteran Derek Pe...

Advanced Systems Group, LLC (ASG), a technology and services provider for media creatives and content owners, announced the appointment of Derek Pezzotti as Sen...

05/02/2026

Taurus Technologies Elevates Podcast Production with Brig...

Taurus Technologies, a Dallas-area professional AV systems integrator, has upgraded its in-house podcast studio with Brightline Lighting's AV/720 low-voltag...

05/02/2026

NBC Sports Selects Production Infrastructure and Signal P...

NBC Universal to Present XXV Olympic Winter Games Feb. 6-22 and Milan Cortina Paralympics March 6-15 NBC Sports to Utilize Grass Valley's Frame Rate Conver...

05/02/2026

Atomos Unveils All New Shogun AV-19

Atomos today announced Shogun AV-19, a rack-mountable, 19-inch 4K HDR monitor-recorder-switcher designed for professional live production, broadcast, and video ...

05/02/2026

Vizrt revolutionizes corporate communications with AI-pow...

Vizrt, the leader in live production technology, revolutionizing viewer experience and engagement, today introduces two brand new solutions in partnership with ...

05/02/2026

Appear Appoints Simon Frost as Chief Marketing Officer to...

Appear, a global leader in live production technology, today announced the appointment of Simon Frost in a newly created role as Chief Marketing Officer (CMO). ...

05/02/2026

Noah Chamis ICLS Illuminates Only Murders in the Building...

New York gaffer Noah Chamis, ICLS ( You Deserve Each Other , The Half of It , Project Runway ) practices a mix of technical precision and creative play in his...

05/02/2026

NBC Sports Deploys Audio-Technica Microphones for Winter Olympics

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

Hemisphere Media Group, Entravision Launch WAPA Orlando

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

SMT Providing Timing And Production Data Services for Winter Olympics

Share Copy link Facebook X Linkedin Bluesky Email...

05/02/2026

BBC Studios and UKTV appoint Karin Marelle as Global Head of Acquisitions

BBC Studios and UKTV have appointed Karin Marelle to lead their Global Acquisitions team, overseeing the sourcing of content across BBC Studios' global chan...

05/02/2026

The Miniature Wife, A Sky Exclusive comedy drama starring Elizabeth Banks and Matthew Macfadyen, to land on 9 April

Thursday 5 February 2026 The Miniature Wife, A Sky Exclusive comedy drama starr...

05/02/2026

Trailer Revealed for Sky Original Film FUZE starring Aaron Taylor-Johnson, Theo James, Gugu Mbatha-Raw and Sam Worthington

Thursday 5 February 2026 Trailer Revealed for Sky Original Film FUZE starring A...

05/02/2026

Rohde & Schwarz at MWC Barcelona 2026: Enabling connections, empowering innovations

Rohde & Schwarz at MWC Barcelona 2026: Enabling connections, empowering innovati...

05/02/2026

The Final Season of 'Turn of the Tide' Premieres on April 10

Back to All News The Final Season of Turn of the Tide Premieres on April 10 Entertainment 05 February 2026 GlobalSpainPortugal Link copied to clipboard Do...

05/02/2026

Nicolette van Dam and Bas Smit Present the Dutch Version of 'Love Is Blind'

Back to All News Nicolette van Dam and Bas Smit Present the Dutch Version of Lo...

05/02/2026

GeForce NOW Celebrates Six Years of Streaming With 24 Games in February

Break out the cake and green sprinkles - GeForce NOW is turning six. Since launch, members have streamed over 1 billion hours, and the party's just getting...

04/02/2026

Save the Date: SVG Regional Sports Production Summit Heads to Denver June 29-30

The 11th-annual Summit will not only the unprecedented headwinds facing the business, but also the groundbreaking opportunities for the future....

04/02/2026

2026 Grammy Awards Audio Team Collaborates for Live Broadcast

Just moments before the 2026 Grammy Awards kicked off, members of the event's audio team assembled for a group photo at the base of the stage inside Los Ang...

04/02/2026

Riedel Connects Live Surgery and Medical Professionals at VISAR 2025

At the Vienna Interdisciplinary Symposium on Aortic Repair (VISAR), Riedel Communications' Managed Technology Division delivered a turnkey technical infrast...