Sony Pixel Power calrec Sony

Bird watching without binoculars

22/10/2020

How the BBCs R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBCs Autumnwatch

By Philip Stevens

Published: October 22, 2020

How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

target=_blank title=Share on LinkedIn class=share-linkedin> How the BBC's R&D team developed open source machine-learning framework network YOLO (You Only Look Once) for the BBC's Autumnwatch

https://www.tvbeurope.com/production-post/bird-watching-without-binoculars title=Share via Email class=share-email>

One of the major problems with making natural history programmes is the fact that the stars' will not take direction from the production team. Try getting a badger to appear on cue, or a bird to feed its young when the programme goes live, and you will appreciate the difficulty. And yet it is these principal characters that the audience wants to see. And the viewers are interested - programmes such as the BBC's Springwatch and Autumnwatch prove the point.

So-called camera traps have, of course, been around for some time. Basically, these are fitted with motion sensors that enable the camera to start shooting when action is detected. However, that action might be a tree moving in the background - and that could mean a memory card filled with brilliant shots of branches moving to and fro - but little sign of wildlife.

Beyond that, many hours are needed for checking through the footage from upwards of 30 Springwatch cameras to determine what could and could not be used.

Using technology To make the work of natural history production teams a little easier, the BBC's Research and Development team has been working on a solution. And it involves Artificial Intelligence (AI) and Machine Learning (ML). Trials took place during the 2019 Springwatch and Autumnwatch productions, with the technology being used more fully for this year's programming.

We became involved in this project when a natural history producer approached us some time ago, explains Robert Dawes, senior research engineer, BBC R&D. He asked us to look into AI technology to see how we could improve the performance of those sensors and use these resources more effectively.

Dawes continues, We did some initial Artificial Intelligence work using computer vision processing techniques. This involved building a rig that had a camera attached to a small Raspberry Pi computer. This computer monitored continuously the camera's output and enabled us to determine when birds or animals appeared in shot. By using the computer vision techniques, we were able to filter out unwanted triggers such as moving trees. But because ML was not involved, it still did not tell us what kind of animal or bird was there.

Obviously, more was needed and when the R&D team became involved with the Springwatch operation it provided the opportunity they had been looking for. By cabling the local remote wildlife cameras to the OB unit, power was immediately available. This opened up possibilities for using higher-powered computer technology to help with the monitoring purposes.

We wanted to create a system of tools that will keep an eye on the multiple cameras at the same time. This needed to be quite sophisticated and required a method to trigger recordings. This was not only helpful for the live programme production teams, but also for the digital output that allows viewers at home to watch cameras 24 hours a day.

As it turned out, the solution that Dawes and his team devised not only worked for the BBC cameras, but for those operated by third party wildlife teams - such as the RSBP (Royal Society for the Protection of Birds) across the United Kingdom - to which the broadcaster has access. Our answer removes the need for someone to be monitoring all these cameras on a continual basis.

So, how does it work? Dawes explains that an open source machine-learning framework network called YOLO (You Only Look Once) was employed. This technology enables the system to recognise objects. For example, if it is used in an office, it can be taught to identify a chair, a monitor, a fridge or a person. In the natural history application, we can teach it to recognise different types of creatures and then put a box around that object. Once that box is in place, it is possible to track where that animal, bird or whatever wanders around the screen.

To enable the system to learn' about the animals, multiple stills of the creatures in question are fed into the computer. These still can run into many thousands as it is important for the system to recognise the subject from many different angles. The computer uses the images to train a system known as a neural network , loosely modelled on the structure of the brain, to recognise what those kind of objects look like. This is a good example of Machine Learning. When the system sees' an object that it recognises as being an animal, it tracks that creature in real time on live video. The set-up means that it will be a creature that is being tracked rather than something else that is moving within the camera's view. In other words, producers can advance from knowing something has happened in the scene' to a creature has moved in the scene'.

In each case, it takes up to three days to import all this basic data to train the neural network. One benefit is that all this can be carried out on a powerful domestic PC - it doesn't require a million-dollar system, emphasises Dawes. It also means it is easy to change the images the system needs to recognise as and when the circumstances change. Clearly, if that process took six months, the system would not be viable.

Creating the data The technology also generates data about the actions so t
LINK: https://www.tvbeurope.com/production-post/bird-watching-without-binocu...
See more stories from tvb

Europe Stories

14/06/2021

NBC Olympics Selects Its Augmented Reality Graphics Provider for Its Production of Olympic Games in Tokyo

NBC Olympics Selects Its Augmented Reality Graphics Provider for Its Production ...

13/06/2021

RT Statement: GunPlot

In today's Sunday Independent (13/06/'21), former government minister, Des O'Malley, claims that the producers of the RT GunPlot' series never...

12/06/2021

Amazon wins rights to Ligue 1, sparks Canal Plus protest

Canal Plus has refused to broadcast the two matches a week it has been awarded, stating the deal is detrimental to the leagues historic partners By Jenny Pries...

11/06/2021

Spotify Invites Fans to the K-pop Playground With a New Enhanced Album From TWICE

It's no secret that K-pop is taking the world by storm, and when it comes to...

11/06/2021

Sky Sports to deliver more boxing than ever before as part of a new chapter for the sport

Two new partnerships will see Top Rank and BOXXER fights on Sky Sports until 202...

11/06/2021

ESSENTIAL MAINTENANCE OF RT LONGWAVE TRANSMITTER

KEEP LISTENING TO RT | WWW.RTE.IE/KEEPLISTENING RT will carry out essential maintenance of the Long Wave (LW) transmitter in Clarkstown, Co. Meath from 15th...

11/06/2021

Nokia modernizes Subisu's optical network for high-speed broadband across Nepal

Nokia modernizes Subisu's optical network for high-speed broadband across Ne...

11/06/2021

Channel Partner Spotlight: Rerate Limited

Rerate Limited is a USA-based supplier of equipment, systems and services for various communications markets. Major markets served include Broadcast, Fixed and ...

11/06/2021

Press release: US can address pressing broadband needs with proposed infrastructure funds, report shows

Press release: US can address pressing broadband needs with proposed infrastruct...

11/06/2021

A guide to using IP monitoring as a business strategy

A new white paper from TAG Video Systems looks at how broadcaster can ensure agile, real-time monitoring of their streams and signals in an IP environment Spon...

11/06/2021

Belgium's BX1 adopts Dalet's media production platform

Belgian broadcaster is using the platform to underpin its production and distribution infrastructure across news and sports production across its radio and TV s...

11/06/2021

Discovery nets French Open for another five years

In 2021, Eurosport has reported significant year-on-year growth in its audience watching via digital platforms during the first eight days of the Grand Slam eve...

11/06/2021

GB News plans radio station launch

New DAB national station could launch as early as next month By Jenny Priestley Published: June 11, 2021 New DAB national station could launch as early as n...

11/06/2021

Isotropic Systems and SES GS Complete Milestone Trials to Unlock Next-Gen Connectivity for U.S. Military

Successful multi-beam, over-the-air tests in the UK and US advance multi-beam an...

11/06/2021

GBH Powers Media Workflows With EditShare Cloud Solutions

GBH Powers Media Workflows With EditShare Cloud Solutions posted: 11/06/2021 EFSv streamlines production with remote workflow flexibility EditShare , a t...

10/06/2021

VEON Shareholders Elect New Members to its Board of Directors

Amsterdam, 10 June 2021 - VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam: VEON), a leading global provider of connectivity and internet services, announces the res...

10/06/2021

What Type of Fan Are You? Celebrate the Arrival of Spotify's Football Now Playlist in the U.K. and Germany

League preferences and team allegiances may differ, but one thing remains consis...

10/06/2021

Sky Mobile reveals the lengths fans go to never miss a sporting moment

Viewing confessions: New research from Sky Mobile reveals 37% of Brits will use their smartphones to watch their favourite sports at work, with 27% sneakily vie...

10/06/2021

The one where Friends: The Reunion becomes Sky One's most watched show ever

Friends fans across the UK have broken viewing records for Sky One with 5.3m watching the long-awaited return of Friends: The Reunion. The must-watch one-off sp...

10/06/2021

RT announces details of UEFA EURO 2020 coverage - live and exclusive

All 51 games live and free-to-air with 45 games live on RT 2 plus 6 final group games on RT Player & RT News channel RT Sport team includes Damien Duff, Ste...

10/06/2021

Nokia and AT&T accelerate U.S C-Band rollout with first commercial equipment call

Nokia and AT&T accelerate U.S C-Band rollout with first commercial equipment cal...

10/06/2021

Sorry, I Didnt Know to return, with opportunities for new writers

Sorry, I Didnt Know to return, with opportunities for new writers ITV and TriForce Productions Launch Competition to Find Writers for Comedy Panel Show ITV ha...

10/06/2021

Hitachi and Arrival to deliver electric buses and infrastructure

London, June 10, 2021 - Hitachi Europe, a wholly owned subsidiary of Hitachi, Ltd. (TSE: 6501, Hitachi), and Arrival (NASDAQ: ARVL), the global company creating...

10/06/2021

4YFN Moves to the Heart of MWC Putting Startups in the Centre of the Mobile Ecosystem

Sir Ronald Cohen, the father of British venture capital among inspiring list of ...

10/06/2021

FilmLight releases Baselight 5.3 Editions for Avid and NUKE

Baselight 5.3 enhancements boost colour correction within your editing or VFX workflow FilmLight today announced the release of Baselight 5.3 Editions for Avid...

10/06/2021

Dalet Helps BX1 Transform into One of Brussel's Leading Multimedia Channels

Dalet, a leading technology and service provider for media-rich organizations, today announced that Brussels-based BX1, has expanded its multimedia channel and ...

10/06/2021

Megacable Improves TV QoE With Broadpeak's CDN and Multicast ABR Solutions

Megacable Improves TV QoE With Broadpeak's CDN and Multicast ABR Solutions June 10, 2021 Broadpeak's Suite of Technologies Reduces Delivery Costs While ...

10/06/2021

Megacable mejora la calidad de experiencia de TV con las soluciones de CDN y Multicast ABR de Broadpeak

Megacable mejora la calidad de experiencia de TV con las soluciones de CDN y Mul...

10/06/2021

Big Brother Canada to Return for Milestone 10th Season

Banijay Rights today announces a landmark tenth season of Big Brother Canada for Corus Entertainment's Global Channel in Canada. The greenlight for a new l...

10/06/2021

Arvato Systems and NIMMSTA push forward "freehand" operations in logistics processes

Arvato Systems and NIMMSTA Push Forward "Freehand" Operations in Logistics Proce...

10/06/2021

Britain's broadcasters launch CFlight - a new ABC-audited tool for measuring ad campaign coverage across linear TV & BVOD

10/06/2021 We're excited to be working with CFlight - the recently launched...

10/06/2021

Euro 2020: The man making sure fans don't miss a single kick

Sunset Vine's leading staff match director Jamie Oakford talks to TVBEurope about his role at this summers Euro 2020 tournament By Jenny Priestley Publish...

10/06/2021

How can broadcasters secure themselves against possible cyber attacks?

Following the recent ransomware attack on one US media group, Quantums Eric Bassier explains why broadcasters are being targeted, and how they can safeguard the...

10/06/2021

EBS rebrands as PA TV Metadata, wins GB News contract

Pawa - the cloud-based metadata platform developed by EBS - will continue to underpin the companys offering By Jenny Priestley Published: June 10, 2021 Pawa...

10/06/2021

DAZN rejects Sky Italia content deal bid'

According to reports, DAZN has rejected Skys bid to keep its app on its set-top-box and satellite service By Jenny Priestley Published: June 10, 2021 Accord...

10/06/2021

Beam me up! Thales & Goonhilly Earth Station collaborate on research into laser beams as data pipes

Facebook Twitter LinkedIn Thales Australia has signed a major research ext...

10/06/2021

Thales revolutionises IoT "out-of-the-box" connectivity to any cellular network worldwide.

Facebook Twitter LinkedIn Breakthrough connectivity solution greatly simpl...

10/06/2021

SBAS for Africa & Indian Ocean helicopter demonstration proves Safety of Life (SoL) services

Facebook Twitter LinkedIn The Agency for Air Navigation Safety in Africa a...

10/06/2021

French space agency president Philippe Baptiste visits Thales Alenia Space's Cannes plant

Facebook Twitter LinkedIn Innovation to drive competitiveness and digital ...

10/06/2021

Canapii takes virtual event engagement to the next level with help from AWS

Canapii takes virtual event engagement to the next level with help from AWS posted: 10/06/2021 For virtual and hybrid event technology developer Canapii, ...

10/06/2021

Vox Media relies on Dante audio network for flexible connectivity, remote operations, and studio growth

Vox Media relies on Dante audio network for flexible connectivity, remote operat...

10/06/2021

VSNCrea and the rule of three

Three industries, three geographies, three happy customers: in this month's blog we explore the benefits that VSNCrea can bring. Who can benefit from VSNC...

09/06/2021

Myleene Klass opens up on her baby loss journey for new W documentary

9 June 2021 UKTVs premium channel W has commissioned a powerful documentary with broadcaster and musician Myleene Klass. The compelling one-off documentary Myle...

09/06/2021

Spotify Presenta Coming Out: Emociones Compartidas', un Podcast Original con Inspiradoras Historias de Creadores LGBTQIA+

Para Spotify, Pride se trata de crear un espacio permanente para las personas LG...

09/06/2021

Love Factually: Watching documentaries is booming, inspiring a nation of aspiring armchair experts

FROM REEL TO REAL - Brits have watched more documentaries this past year than ev...

09/06/2021

Sky Documentaries announces a slate of new original titles to mark channel's first anniversary

Sky today announced five new Sky Original documentaries that reinforce its commi...

09/06/2021

Sky reveals trailer and premiere date for highly anticipated documentary Murder at the Cottage: The Search for Justice for Sophie

Sky has today revealed the official trailer for highly anticipated Sky Original ...

09/06/2021

BLOOMSDAY ON RT

DRAMA Killian Scott stars in world premiere of US vs Ulysses AUDIO RT Radio 1 Extra to air epic 29 hour, 45 minute RT production of Ulysses this Bloomsday ...

09/06/2021

Nokia and Orange Jordan launch mesh Wi-Fi for superior broadband performance

Nokia and Orange Jordan launch mesh Wi-Fi for superior broadband performance Press Release Nokia and Orange Jordan launch mesh Wi-Fi for superior broadband ...

09/06/2021

ARRI X CT OPEN MIXED REALITY STUDIO IN THE UK

ARRI X CT OPEN MIXED REALITY STUDIO IN THE UKLondon | June 9, 2021...