Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Most recent headlines

27/07/2021

TV Tech's Special Guide to PTZ Systems Ebook Is Now Available

The ability to control cameras remotely has become increasingly important as enterprises seek to lower costs and manpower and increase the range and flexibility...

27/07/2021

First Mile Technologies Introduces Camera-to-Cloud Connectivity

TORONTO-First Mile Technologies, a developer of creative connectivity solutions for media and entertainment production, has launched a new service to allow prod...

27/07/2021

CP Communications Coordinates RF For MLB All-Star Game

DENVER-CP Communications provided RF coordination and an extensive lineup of equipment to ESPN, Fox and MLB earlier this month for coverage of the 2021 All-Star...

27/07/2021

Fox 5 DC Debuts New Headquarters in Bethesda Maryland

WASHINGTON-FOX 5 DC has moved into a new 58,000 square foot IP-based facility in Bethesda Maryland that features a number of new technologies that will help WTT...

27/07/2021

Olympics: Streaming Is Up 279% Over 2018

TOKYO-While the traditional TV viewership in the U.S. for the Opening Ceremony of the Olympics was the lowest in decades, new data from Conviva suggests that gl...

27/07/2021

Samsung, 'Parasite Producer CJ ENM Partner on New Virtual Production Studio

LONDON-Samsung Electronics Co. has announced a partnership with CJ ENM, the entertainment and media group behind the Oscar-winning film Parasite film, to buil...

27/07/2021

Nexstar Hires Lee Ann Gliha as EVP and CFO

IRVING, Texas-Nexstar has announced that Lee Ann Gliha has been hired as the companys executive vice president and chief financial officer....

27/07/2021

grandMA3 onPC rack-unit: The all-round lighting control solution for installations

grandMA3 onPC rack-unit: The all-round lighting control solution for installatio...

27/07/2021

ITV Drama vs Reality Anna Friel, Olivia Attwood and Bradley Dack

ITV Drama vs Reality Anna Friel, Olivia Attwood and Bradley Dack ITV's Drama vs Reality latest film with Emmy-winning actor Anna Friel & reality star coupl...

27/07/2021

Grand Finale on a Year of High School Sports: HSOT Honors Presents Awards Virtually

Nick Stevens hosts the 2021 HighSchoolOT Honors which took place virtually on Th...

27/07/2021

US Women Vs. New Zealand in Olympic Soccer July 24

The U.S. women's soccer team plays New Zealand in the Olympics July 24. The match kicks off at 7:30 a.m. ET and airs on NBCSN and Telemundo. USA Network air...

27/07/2021

Bill Simmons' Woodstock 99' Documentary on HBO July 23

The Bill Simmons documentary Woodstock 99: Peace, Love, and Rage premieres on HBO July 23. Directed by Garret Price, Woodstock 99 is the first film in Simmons&#...

27/07/2021

Former ESPN Host Maria Taylor Moves to NBC Sports

Maria Taylor, who spent close to a decade on the air at ABC/ESPN, has joined NBC Sports. She starts on the Olympics in Tokyo, joining Mike Tirico as host for Pr...

27/07/2021

Streaming Jumps During Olympics Opening Ceremony: Convivia

Streaming has made big strides since the last Olympic games, according to a new report from Conviva....

27/07/2021

U.S. TV Ad Spending to Drop 4% in 2021 as Digital Video Booms

Media agency Zenith is forecasting a decline in U.S. TV ad spending in 2021 as audiences shrink and marketers pour their advertising dollars into digital video....

27/07/2021

Verizon Media Pushes Shark Week With Augmented Reality Campaign

Discovery and Verizon Media are bringing sharks closer to viewers with an augmented reality Shark Week campaign aimed at driving viewers to Discovery Plus....

27/07/2021

Nexstar Brings in New Blood, Naming Lee Ann Gliha CFO

Nexstar Media Group said it named Lee Ann Gliha as executive VP and CFO, effective Aug. 9....

27/07/2021

DMR Launching Social Video Division To Boost OTT Channels

Digital Media Rights (DMR) said it has formed a new social media division that will curate content for social platforms in order to push distribution and create...

27/07/2021

Chip n' Dale: Park Life' Starts on Disney Plus July 28

Chip n' Dale: Park Life, an animated series about a pair of pesky chipmunks, premieres on Disney Plus July 28. Each episode features three seven-minute sto...

27/07/2021

Fixer to Fabulous' Gets Third Season on HGTV

HGTV has picked up 16 episodes of Fixer to Fabulous, which has Dave and Jenny Marrs overhauling historic homes in Arkansas, for a third season. The new season i...

27/07/2021

X-Rite Names Dustin Bowersox Textile & Apparel Business Development Manager

X-Rite Names Dustin Bowersox Textile & Apparel Business Development Manager Contact: Corporate: Alicia Libucha X-Rite +1 857-205-0919 alicialibu...

26/07/2021

Save the Date: SVG's TranSPORT Event Addresses the State of Sports Transmission Tech on Sept. 23

Save the Date: SVG's TranSPORT Event Addresses the State of Sports Transmiss...

26/07/2021

In YES Network App, New YES Edge Feature Adds Dynamic Graphic Overlays to Live Game Streams

In YES Network App, New YES Edge Feature Adds Dynamic Graphic Overlays to Live G...

26/07/2021

Minnesota Lynx Production Team Relies on NBA Crew, Lessons From Timberwolves Season at Target Center

Minnesota Lynx Production Team Relies on NBA Crew, Lessons From Timberwolves Sea...

26/07/2021

Hazelden Betty Ford, Sports Video Group Help Olympic Production Staff

Hazelden Betty Ford, Sports Video Group Help Olympic Production Staff By SVG Staff Monday, July 26, 2021 - 4:07 pm Print This Story Working on video produ...

26/07/2021

Lido Pimienta lleva sus races afrocolombianas al pop electrnico como artista EQUAL del mes

Quiz ubiques a Lido Pimienta por nuestra playlist Spotify Singles: Pride que la...

26/07/2021

Spotify's What's New Feed Means You'll Never Miss the Latest Releases From the Shows and Artists You Follow

On Spotify, every day brings the chance to discover something new-whether that&#...

26/07/2021

Popular Chilean Sci-Fi Podcast Gets Adapted for Brazilian Listeners in Paciente 63'

Since its premiere last fall, the popular Chilean Spotify Original podcast Caso ...

26/07/2021

Sky Mobile reveals summer dating trend as new break-up banger, Time to 65075' is released with Lady Leshurr

I've Got a Text!: New research from Sky Mobile reveals that 1 in 4 couples a...

26/07/2021

Net Insight Wins Key Aperi Order

Net Insight Interim Report January - June 2021 Strategic initiatives ensure continued growth After a cautious start to the year, sales and operating earnings ...

26/07/2021

Nokia and EDC partner to advance Canada's 5G contributions

Nokia and EDC partner to advance Canada's 5G contributions Export Development Canada (EDC) will provide financing and insurance solutions to Nokia's...

26/07/2021

Netflix Drops Trailer for New Norwegian Vampire Comedy Post Mortem: No One Dies in Skarnes

Back to All News Netflix Drops Trailer for New Norwegian Vampire Comedy Post Mo...

26/07/2021

7 Prisoners, new Netflix film, makes its World Premiere at the 78th Venice Film Festival

Back to All News 7 Prisoners, new Netflix film, makes its World Premiere at the...

26/07/2021

Banijay Benelux Expands Portfolio

Banijay Benelux today announces its acquisition of a majority stake in leading Dutch sports producer, Southfields. Retaining its name, the label will combine wi...

26/07/2021

RADIO GEGAR ANJUR IBADAH KORBAN UNTUK KAMPUNG DI KELANTAN

RADIO GEGAR ANJUR IBADAH KORBAN UNTUK KAMPUNG DI KELANTAN Date Released:21 Jul 2021 Share Tweet Kapsyen gambar: Geng GEGAR Fan Club di Korban Raya GEGAR ...

26/07/2021

Live sports broadcasting in 2021- is it time to be experimental?

With the uncertainty surrounding live events in 2021, Arqiva's Chris Alner looks at the broadcast challenges of a congested and fluid sporting calendar and ...

26/07/2021

Water Saving Week: The solutions making a splash

We need to be more water aware and we need to use water wisely, or we risk placing parts of this country under severe water stress. Last March, the Environment...

26/07/2021

Preparing for a broadcast-driven summer of sport

Arqiva will be at the heart of many broadcasters' plans for this summer's major sports events. TVB Europes Jenny Priestley met the company's commerc...

26/07/2021

FCC Grants C-band Spectrum Licenses

WASHINGTON-The Federal Communications Commission has taken another step forward in making additional mid-band spectrum available for flexible use, particularly ...

26/07/2021

Keep your fans engaged!

How event-based TV content such as cliffhanger dramas and Reality TV can be used to personalise the viewer experience and maximise monetisation opportunities S...

26/07/2021

Malaysia's Visual Three Powers Live Production With AJA FS-HDR

Malaysia's Visual Three Powers Live Production With AJA FS-HDR posted: 26/07/2021 The broadcast technology experts at Visual Three in Malaysia have pr...

26/07/2021

ITV backs three Studio 55 Ventures

ITV backs three Studio 55 Ventures Businesses with appeal amongst 16-34 year olds ITV can today announce the three successful media and entertainment busines...

26/07/2021

WRAL and FOX 50 return to DISH lineup

UPDATE: July 23, 2021 Exciting news to share with WRAL and FOX 50 viewers impacted by the DISH outage: We are happy to report that both WRAL (NBC) and FOX 50 (...

26/07/2021

Samsung partners with Parasite producer on virtual production studio

The modular screens include precise colour expression, HDR10 and cinema LED picture quality technology, as well as optimised frame rates for production houses ...

26/07/2021

Andrea Duilio appointed Sky Italia CEO

Will take up his new position in early September By Jenny Priestley Published: July 26, 2021 Will take up his new position in early September target=_blan...

26/07/2021

V-Nova raises 33 million in latest funding round

Investor Neva SGR tips V-Nova to become a billion euro company in the next few years By Jenny Priestley Published: July 26, 2021 Investor Neva SGR tips V-No...

26/07/2021

Amrica Televisin Eyes Improved Production Values with Ross

Ottawa, Canada, July 23rd 2021 Am rica Televisi n is a Peruvian television network, founded in 1958 and based in the country's capital Lima. It was the se...

26/07/2021

Apantac Joins SDVoE Alliance

Apantac Joins SDVoE Alliance posted: 26/07/2021 Leading developer of image & signal processing equipment adds SDVoE solutions to their product roadmap The ...

26/07/2021

Screen Australia announces development funding for 28 drama projects

26 07 2021 - Media release Screen Australia announces development funding for 28 drama projects Comedy duo Hot Department are developing online series HOME S...

26/07/2021

Crepes, coffee and cocktail bar opening at American Tobacco Campus

Press, a coffeehouse, creperie and cocktail bar from Graham, will open its second location at the American Tobacco Campus later this month. Press, a coffeehous...