Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
December 09, 2024
LA JOLLA, CA Imagine an artificial intelligence (AI) model that can watch and understand moving images with the subtlety of a human brain. Now, scientists at Scripps Research have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.
This brain-inspired AI model, detailed in a study published in the Proceedings of the National Academy of Sciences on November 19, 2024, can perceive moving scenes by simulating how neurons or brain cells make real-time sense of the world. Conventional AI excels at recognizing still images, but MovieNet introduces a method for machine-learning models to recognize complex, changing scenes a breakthrough that could transform fields from medical diagnostics to autonomous driving, where discerning subtle changes over time is crucial. MovieNet is also more accurate and environmentally sustainable than conventional AI.
The brain doesn't just see still frames; it creates an ongoing visual narrative, says senior author Hollis Cline, PhD, the director of the Dorris Neuroscience Center and the Hahn Professor of Neuroscience at Scripps Research. Static image recognition has come a long way, but the brain's capacity to process flowing scenes like watching a movie requires a much more sophisticated form of pattern recognition. By studying how neurons capture these sequences, we've been able to apply similar principles to AI.
To create MovieNet, Cline and first author Masaki Hiramoto, PhD, a staff scientist at Scripps Research, examined how the brain processes real-world scenes as short sequences, similar to movie clips. Specifically, the researchers studied how tadpole neurons responded to visual stimuli.
Tadpoles have a very good visual system, plus we know that they can detect and respond to moving stimuli efficiently, explains Hiramoto.
Left to right: Hollis Cline, PhD, and Masaki Hiramoto, PhD. Credit: Scripps Research.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
16/07/2026
33 leading exhibitors are taking part in the GREAT Britain and Northern Ireland Pavilions and linked locations across IBC2026 (Amsterdam RAI, 11 14 September)...
16/07/2026
Hitomi Broadcast will introduce Spectra, a new HDR colour verification solution measured in picture, not using VPID, at IBC2026 (Hall 10, Stand A40). Expanding ...
16/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
16/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
16/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
16/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
16/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
16/07/2026
Zixi, a leader in live video delivery and workflow orchestration, and Comcast Technology Solutions (CTS) today announced a strategic new integration to deliver ...
16/07/2026
Blackmagic Design Cameras Capture Immersive Flight for New Cirrus App
Brie Clayton July 15, 2026
0 Comments
Leader in Personal Aviation taps URSA Cin...
16/07/2026
XenData Announces LTO Archive Appliances with both File and S3 Object Storage In...
16/07/2026
Onimusha: Way of the Sword is coming to GeForce NOW at launch, with the playable...
16/07/2026
Together the semi-finals had a combined reach of 1.98 million unique individuals...
15/07/2026
The 2026 FIFA World Cup is a big deal for DAZN, which has distribution rights in three markets: Italy, Spain, and Japan. Each requires a different editorial app...
15/07/2026
As sports-media organizations manage rapidly growing content libraries and incre...
15/07/2026
HBS director of digital Johannes Franken talks SVG Europe through the operation built to serve FIFA World Cup 2026 rights holders remotely from Stratford, east ...
15/07/2026
IBC has unveiled the conference program for IBC2026, with this year's event ...
15/07/2026
Software-defined wideband RF platform supports 96-kHz monitoring, streamlined fr...
15/07/2026
New AI-powered module enables broadcasters and content owners to extract dialogu...
15/07/2026
Weeklong gathering at EBU headquarters will test new IPMX capabilities and expand certified product ecosystem...
15/07/2026
Force Tech has announced the appointment of Bryan Adams, CTS, as Vice President of Integration. Adams will oversee AV and broadcast integration project delivery...
15/07/2026
USA Sports has announced an exclusive English-language agreement with the Bundes...
15/07/2026
ITV Sport's FIFA World Cup 2026 coverage has been produced from one of the m...
15/07/2026
Program will provide professional camera kits, training, and technical support to participating local newsrooms...
15/07/2026
San Francisco church becomes first U.S. deployment of the 2 M/E production switcher...
15/07/2026
Former ESPN and NFL Network executive to advise startup league on media, distribution, technology, and fan engagement...
15/07/2026
The Houston-based RSN is the live-game home of the Astros and Rockets...
15/07/2026
Launched alongside new FreqSoft installer
Designed to bridge the gap between hardware and software, Freqport's FreqInOut FO1 unit provides a simple way ...
15/07/2026
Save up to 55% on software until 23 July 2026
Expressive E have just launched their Summer Offer sale, with discounts of up to 55% now applied across their ...
15/07/2026
Real-time stem-separation tool updated
zplane have recently released a new and improved version of their real-time stem-separation plug-in which they say ma...
15/07/2026
A new benchmark in bass enhancement
Described as a new benchmark in bass enhancement , Baby Audio's latest release has been designed to augment the lo...
15/07/2026
DMC Production's AR 1 and AR 2 units reverse the conventional OB workflow, keeping all production-critical processing at the venue while operators work remo...
15/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
15/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
15/07/2026
GigaCloud, a leading Ukrainian cloud service provider, and Cubbit, the first geo-distributed cloud storage enabler, today announced a new Business Alliance Part...
15/07/2026
SMPTE, the global society for media professionals, technologists, and engineers, has announced the launch of the SMPTE 110th Anniversary Campaign, a fundraising...
15/07/2026
Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, unveils the new StudioComm Model 762 Stereo Level Control, ...
15/07/2026
COW Jobs: Producer, Virtual Events - Hybrid, Full Time, Salaried
Brie Clayton July 15, 2026
0 Comments
Producer, Virtual Events (Hybrid | Full-time | ...
15/07/2026
Brazilian media organization builds nationwide CDN with Broadpeak's high-performance software for low-latency streaming and new content distribution service...
15/07/2026
DHD announces a new utility designed to increase the efficiency of its audio mixing systems during initial installation and subsequent configuration.
Anyone w...
15/07/2026
BCNEXXT Brings Next-Generation Vipe to IBC2026, Breaking the 1:1 Channel-to-Server Ratio New innovations liberate broadcasters from legacy playout infrastructur...
15/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
15/07/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
15/07/2026
General-purpose robots and autonomous machines are moving from research labs to ...
15/07/2026
Wednesday 15 July 2026
Screeners and press pack now available: Gomorrah: The Or...
15/07/2026
Trinity's Treasures features Ruth Negga, Eleanor McEvoy, and David Norris, a...
Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
