Sony Pixel Power calrec Sony

December 09, 2024

10/12/2024

Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.

December 09, 2024

LA JOLLA, CA Imagine an artificial intelligence (AI) model that can watch and understand moving images with the subtlety of a human brain. Now, scientists at Scripps Research have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.

This brain-inspired AI model, detailed in a study published in the Proceedings of the National Academy of Sciences on November 19, 2024, can perceive moving scenes by simulating how neurons or brain cells make real-time sense of the world. Conventional AI excels at recognizing still images, but MovieNet introduces a method for machine-learning models to recognize complex, changing scenes a breakthrough that could transform fields from medical diagnostics to autonomous driving, where discerning subtle changes over time is crucial. MovieNet is also more accurate and environmentally sustainable than conventional AI.

The brain doesn't just see still frames; it creates an ongoing visual narrative, says senior author Hollis Cline, PhD, the director of the Dorris Neuroscience Center and the Hahn Professor of Neuroscience at Scripps Research. Static image recognition has come a long way, but the brain's capacity to process flowing scenes like watching a movie requires a much more sophisticated form of pattern recognition. By studying how neurons capture these sequences, we've been able to apply similar principles to AI.

To create MovieNet, Cline and first author Masaki Hiramoto, PhD, a staff scientist at Scripps Research, examined how the brain processes real-world scenes as short sequences, similar to movie clips. Specifically, the researchers studied how tadpole neurons responded to visual stimuli.

Tadpoles have a very good visual system, plus we know that they can detect and respond to moving stimuli efficiently, explains Hiramoto.

Left to right: Hollis Cline, PhD, and Masaki Hiramoto, PhD. Credit: Scripps Research.
LINK: https://www.scripps.edu/news-and-events/press-room/2024/20241209-cline...
See more stories from scripps

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

15/07/2026

S&P Analysis: Three Quarters of Americans Watch Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

15/07/2026

Scripps Sports, Ion Score Women's Volleyball Rights

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Bowling Green State Upgrades Doyt Perry Stadium With New Daktronics LED Display

South end zone videoboard, cloud-based control system will be ready for 2026 football season...

14/07/2026

Mizzou Athletics Launches Connected Digital Platform

Redesigned website, enhanced mobile app unify content, ticketing, and personalized fan engagement...

14/07/2026

DePaul Athletics, Playfly Sports Agree to Multimedia Rights Partnership

Agreement spans sponsorship sales, digital monetization, radio production, and new practice facility naming rights...

14/07/2026

American Association Expands Broadcast Reach Through FanDuel Sports Network Partnership

Independent league adds 14 regional sports network affiliates, growing distribut...

14/07/2026

Euroleague Basketball Introduces Euroleague Basketball+ Digital Ecosystem Initiative

New strategy aims to unify competitions, content, fan engagement, and commercial...

14/07/2026

Professional Fighters League, ESPN Reach Multi-Year Media Rights Deal for Brazil

ESPN and Disney+ become exclusive home of PFL events in key international MMA market...

14/07/2026

TEGNA Names Scott Gill VP of Technology and Operations

Gill will oversee engineering, technology, and sports operations across the company's 64 local television stations...

14/07/2026

Guest Post: Dynamic Media Facilities Could Reshape the Future of Broadcast Workflows

Submitted by North American Broadcasters Association (NABA) As broadcasters con...

14/07/2026

Bayerischer Rundfunk Debuts Fully Software-Defined SMPTE ST 2110 Radio OB Van Built Around Lawo Technology

Modernized mobile unit combines HOME Apps, mc 56 console, and IP infrastructure ...

14/07/2026

Scripps Sports, ION Secure U.S. Rights to 2027 FIVB Womens Volleyball World Cup

Every match of the 32-team tournament will air across ION and Scripps Sports platforms in English and Spanish...

14/07/2026

FloSports Lands Exclusive U.S. Rights to IIHF Mens World Championship Beginning in 2027

FloHockey to stream every game of the annual international tournament under four...

14/07/2026

Minnesota Lynx Add Three Games to KARE 11s Over-the-Air Schedule

Victory+ telecasts to be simulcast on TEGNA-owned station, expanding free local distribution...

14/07/2026

Avalanche Tones debut with Chainsaw Suite

Plug-ins for heavy music Avalanche Tones is the brainchild of Ava Toton, a 17-year-old musician and developer who says her goal is to make the lives of gui...

14/07/2026

IK Multimedia introduce ReSing Voices Brazilian Pack

Launched alongside new Singer Showcase purchase model IK Multimedia's innovative vocal-synthesis software has just gained its latest voice add-on, the R...

14/07/2026

MIDI Innovations Awards 2026

Registration open until 1 September 2026 The MIDI Association have revealed that the registration deadline for this year's MIDI Innovation Awards has no...

14/07/2026

Launchkey MK4 88 joins Novation line-up

88-note model completes MK4 range Novation have just introduced the final model in their flagship MIDI controller keyboard range, the Launchkey MK4 88. Roun...

14/07/2026

CBS Atlanta Adds a Noon Newscast

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Tegna Names Scott Gill VP, Technology and Operations

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Colorado Wildfires Bring Close Call for Broadcasters

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

IBC2026 sets conference agenda

IBC2026 has unveiled a powerful Conference programme bringing together global media leaders, technology innovators, creators, sports organisations, broadcasters...

14/07/2026

Nominations for Best of Show Awards at IBC2026 Now Open

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Broadcast Solutions delivers industry-first software-defi...

Broadcast Solutions, a leading systems integrator and provider of innovative solutions for the broadcast media industry, has delivered two highly capable outsid...

14/07/2026

UPDATED: Scripps, DirecTV End Blackout, Ink New Retrans Deal

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

12 States Sue to Block $110 Billion Warner Bros./Paramount Merger

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Heidi Raphael to Head N.Y. State Broadcasters Association

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

CBS Atlanta Expands Live Local News Programming

Share Copy link Facebook X Linkedin Bluesky Email...

14/07/2026

Nemotron Labs: How Open Models Give Enterprises and Nations AI They Can Trust, Control and Customize

Editor's note: This post is part of the Nemotron Labs blog series, which exp...

14/07/2026

Techtel Successfully Relocates AICD Broadcast Studio to New Sydney Headquarters

Techtel Successfully Relocates AICD Broadcast Studio to New Sydney Headquarters BroadcastBroadcast EquipmentLive StreamingBroadcast Studio2026 14 July Writ...

14/07/2026

First look revealed for Friday the 13th prequel, Crystal Lake, from A24 coming to Sky and NOW in the UK and Ireland this October

Tuesday 14 July 2026 First look revealed for Friday the 13th prequel, Crystal ...

14/07/2026

Surround Is Still the Standard

When immersive audio dominates industry headlines, it's easy to assume that every broadcaster is preparing for an Atmos future. The reality is quite differ...

14/07/2026

Fresh Thinking from MAD//Fest London 2026

Emma and Sophie from ICG's marketing team joined thousands of fellow marketers, brands and agencies at MAD//Fest London 2026, one of the UK's biggest ma...

14/07/2026

Seven paradoxes shaping the next era of media production - Episode 3

Why Trusted and Secure Media Operations Matter In this series, we explore the technologies, architectures and operational realities shaping modern media operati...

14/07/2026

How Merchants Can Prepare for the Next Evolution in Digital Commerce

Pilot Project Shows How Retailers Are Prepared for the Next Step in the Evolution of Digital Commerce Arvato Systems Drives Agentic Commerce Forward G terslo...

14/07/2026

Building a more sustainable future - Our commitment to climate action

As part of this commitment, weve joined the SME Climate Hub, publicly pledging to: measure our greenhouse gas emissions reduce them in line with a net zero p...

14/07/2026

Why Performance per Watt Is the Ultimate Metric for AI Infrastructure Efficiency

Power is AI infrastructure's inescapable constraint. How many tokens an AI factory can generate within a fixed power budget determines its revenue and profi...

13/07/2026

BravesVision GM Jeff Cravens on Launching MLB's Newest Team-Owned Network in 35 Days

The Braves opted to keep production in-house rather than hand it off to MLB...

13/07/2026

Behind The Mic: Adam Schefter Signs Multi-Year Extension with ESPN

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

13/07/2026

Eurovision Sport and European Athletics Bring Live Athletics to More Fans with Multilingual AI Commentary Initiative

Eurovision Sport is making live athletics more accessible to fans than ever befo...

13/07/2026

Milwaukee Bucks Return to Full-Season Over-the-Air Television for First Time in 31 Years

The Milwaukee Bucks will return to full-season over-the-air television for the 2...

13/07/2026

SMPTE Expands Education Offerings with Connected Learning Path for IP Media Workflows

SMPTE has announced an expanded education pathway for media technology professio...

13/07/2026

Vizrt Graphics Power Netflix MVP MMA Event at Intuit Dome

Vizrt has announced that its graphics technology was used by broadcast design agency Girraphic for Netflix's debut MVP MMA event, broadcast live from the In...

13/07/2026

ARRI To Sell Global Rental Business to H2 Equity Partners in Management Buyout

ARRI has announced an agreement to sell its global rental activities in Europe, the United Kingdom, and North America to H2 Equity Partners through a management...

13/07/2026

DAZN and Premier Boxing Champions Announce Global Broadcasting Partnership

DAZN has announced a partnership with Premier Boxing Champions (PBC) to bring PBC fight nights to DAZN subscribers globally. The partnership begins Saturday, Ju...

13/07/2026

TikTok and WSC Sports Partner To Connect Sports Rightsholders With Content Creators

TikTok and WSC Sports have announced a strategic partnership that gives sports r...