Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
December 09, 2024
LA JOLLA, CA Imagine an artificial intelligence (AI) model that can watch and understand moving images with the subtlety of a human brain. Now, scientists at Scripps Research have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.
This brain-inspired AI model, detailed in a study published in the Proceedings of the National Academy of Sciences on November 19, 2024, can perceive moving scenes by simulating how neurons or brain cells make real-time sense of the world. Conventional AI excels at recognizing still images, but MovieNet introduces a method for machine-learning models to recognize complex, changing scenes a breakthrough that could transform fields from medical diagnostics to autonomous driving, where discerning subtle changes over time is crucial. MovieNet is also more accurate and environmentally sustainable than conventional AI.
The brain doesn't just see still frames; it creates an ongoing visual narrative, says senior author Hollis Cline, PhD, the director of the Dorris Neuroscience Center and the Hahn Professor of Neuroscience at Scripps Research. Static image recognition has come a long way, but the brain's capacity to process flowing scenes like watching a movie requires a much more sophisticated form of pattern recognition. By studying how neurons capture these sequences, we've been able to apply similar principles to AI.
To create MovieNet, Cline and first author Masaki Hiramoto, PhD, a staff scientist at Scripps Research, examined how the brain processes real-world scenes as short sequences, similar to movie clips. Specifically, the researchers studied how tadpole neurons responded to visual stimuli.
Tadpoles have a very good visual system, plus we know that they can detect and respond to moving stimuli efficiently, explains Hiramoto.
Left to right: Hollis Cline, PhD, and Masaki Hiramoto, PhD. Credit: Scripps Research.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
09/06/2026
Kiswe announces an expanded long-term partnership with ONE Championship (ONE), t...
09/06/2026
SiriusXM will broadcast FOX Sports' English-language commentary for all 104 FIFA World Cup 2026 matches from June 11 through July 19, available to subscribe...
09/06/2026
EVS has announced it is changing its corporate name from EVS Broadcast Equipment to EVS, reflecting the company's expanded portfolio beyond broadcast equipm...
09/06/2026
Fox Corporation and the NFL have announced a multi-year agreement to bring NFL c...
09/06/2026
FOX Sports and ReachTV, an airport media network, have announced an agreement to...
09/06/2026
Cosm Atlanta, a 70,000-square-foot, three-level immersive entertainment venue located within Centennial Yards adjacent to State Farm Arena and Mercedes-Benz Sta...
09/06/2026
NESN captured five awards at the 2026 Boston/New England Emmy Awards, including four program honors and one individual award.
These awards reflect the passion...
09/06/2026
Ateme has announced that its support for Apple Immersive Video workflows was referenced by Apple during its 2026 Worldwide Developers Conference (WWDC26).
Atem...
09/06/2026
Bitmovin has announced that Axel Springer SE has deployed Player Web X, Bitmovin's web video player, to power audio readouts of news articles and an audio-o...
09/06/2026
Grass Valley and Lawo have announced a technology collaboration to validate orch...
09/06/2026
LiveU has announced a deployment with the Oceania Football Confederation (OFC) t...
09/06/2026
Globecast has announced the launch of its Content Exchange platform, powered by ...
09/06/2026
NBC Sports will present live coverage of Overtime's OT7 football league Championship Weekend from Sullivan Field at Loyola Marymount University in Los Angel...
09/06/2026
We're in three different locations, three different production teams. Coveri...
09/06/2026
The intro video for Men's Basketball won Outstanding In-Venue Video in the C...
09/06/2026
Today is match day minus two for FIFA and HBS. On Thursday, there will be two ma...
09/06/2026
Since their debut, the clock-and-score graphic has drawn the affinity and ire of...
09/06/2026
Last month, Spotify hosted PURE FLOWERS LIVE, a special event celebrating the re...
09/06/2026
Last month, RADAR U.K. artist Skye Newman took the stage in East London for a sp...
09/06/2026
Company to cease operating on 30 June 2026
Australian loudspeaker and amplifier manufacturer Wayne Jones Audio have announced that after much consideration,...
09/06/2026
Increases low-end weight and character
The latest plug-in release from Sheffield-based fedDSP aims to offer an all-in-one solution for users in search of mo...
09/06/2026
Introduces AI Studio Assistant, Moises Studio integration & more
Fender Studio have just announced the launch a significant update that brings an array of n...
09/06/2026
The National Film and Video Foundation (NFVF) is a statutory body mandated to spearhead the equitable growth and development of the South African film and video...
09/06/2026
The BBC has found its Hercule Poirot.
After Deadline revealed last month that t...
09/06/2026
Media buyers and sellers can now compare YouTube reach from computer, mobile, an...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
A project aimed at modernizing scheduling operations across Mediaset's channel portfolio
Mediagenix, a global leader in smart content solutions to profitab...
09/06/2026
tvONE, an ACT Entertainment brand, debuts its most powerful video processor ever built: the 4RU CALICO PRO (C7-PRO-4200), at InfoComm 2026 (Booth N6813). Engine...
09/06/2026
Composer and Conductor Eric Whitacre to Receive Honorary Doctorate at Berklee Va...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Technology collaboration to validate AMPP and Lawo HOME orchestration integration, showcasing Dynamic Media Facility principles in practice.
Grass Valley and ...
09/06/2026
Bitmovin, a leading provider of video streaming solutions, today announced that Axel Springer SE, international media and technology company, has deployed Playe...
09/06/2026
LiveU, the global leader in live IP-video solutions, today announced a landmark deployment with the Oceania Football Confederation (OFC) that has brought Video ...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Two Alumni Win Tony Awards Mike Morris and Cedric Leiba Jr. won awards for Best Orchestrations and Best Play, respectively.
June 8, 2026
By
Tori Donahue
...
09/06/2026
Tuesday 9 June 2026
Katie Price: Nothing to Hide, a candid and unfiltered accou...
09/06/2026
Back to All News
Netflix Unveils First Images And Poster For Wrath, A New Brazi...
09/06/2026
Enni Continues to Rely on Arvato Systems - And Will Be Using AEP.EnerS4 Billing Solution
Arvato Systems to implement transformation project for SAP S/4HANA Ut...
09/06/2026
These special programmes will highlight RT 's connection with the Irish diaspora
This year, RT is marking 100 years of public broadcasting in Ireland with...
Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
