Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
December 09, 2024
LA JOLLA, CA Imagine an artificial intelligence (AI) model that can watch and understand moving images with the subtlety of a human brain. Now, scientists at Scripps Research have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.
This brain-inspired AI model, detailed in a study published in the Proceedings of the National Academy of Sciences on November 19, 2024, can perceive moving scenes by simulating how neurons or brain cells make real-time sense of the world. Conventional AI excels at recognizing still images, but MovieNet introduces a method for machine-learning models to recognize complex, changing scenes a breakthrough that could transform fields from medical diagnostics to autonomous driving, where discerning subtle changes over time is crucial. MovieNet is also more accurate and environmentally sustainable than conventional AI.
The brain doesn't just see still frames; it creates an ongoing visual narrative, says senior author Hollis Cline, PhD, the director of the Dorris Neuroscience Center and the Hahn Professor of Neuroscience at Scripps Research. Static image recognition has come a long way, but the brain's capacity to process flowing scenes like watching a movie requires a much more sophisticated form of pattern recognition. By studying how neurons capture these sequences, we've been able to apply similar principles to AI.
To create MovieNet, Cline and first author Masaki Hiramoto, PhD, a staff scientist at Scripps Research, examined how the brain processes real-world scenes as short sequences, similar to movie clips. Specifically, the researchers studied how tadpole neurons responded to visual stimuli.
Tadpoles have a very good visual system, plus we know that they can detect and respond to moving stimuli efficiently, explains Hiramoto.
Left to right: Hollis Cline, PhD, and Masaki Hiramoto, PhD. Credit: Scripps Research.
North America Stories
18/01/2025
10 Projects to Be Developed at Annual January Screenwriters Lab;
10 Projects t...
18/01/2025
BALTIMORE In a move to redefine how it works with advertisers and audiences, Sinclair Broadcast Group has announced the rebranding and launch of new sales and c...
18/01/2025
ATLANTA Gray Media has announced that it will air ten Spring Training Major League Baseball games with the Atlanta Braves on two dozen Gray Media stations, begi...
18/01/2025
Lawo has announced it will be showcasing a variety of IP-based solutions at ISE 2025 in Barcelona (Feb. 4-7) at booth 5H700....
18/01/2025
WASHINGTON The National Association of Broadcasters today released the long-awaited Future of Television Initiative report, written to give the Federal Communic...
18/01/2025
DigitalGlue has announced that its creative.space shared storage solution was selected by the Ryan Seacrest Foundation (RSF) to house, organize and provide remo...
18/01/2025
Starin, a leading distributor specializing in the AV and Broadcast/M&E markets, is proud to announce a new partnership with Absen Inc., the US subsidiary of Abs...
18/01/2025
CVP, one of Europe's leading resellers and providers of professional video and broadcast solutions, will showcase a selection of its extensive range of prod...
18/01/2025
DPA Microphones unveils MicroLock , its new compact microphone connector, which builds on the strengths of the renowned MicroDot connector currently deployed wi...
18/01/2025
Friend MTS, a leading global provider of content protection services, today announced that it is expanding its business intelligence services with a new team he...
18/01/2025
Transforming Visual Collaboration with 5K Clarity and Versatile Design
MAXHUB, a global leader in integrated communication displays and unified communications ...
18/01/2025
Witbe (Euronext Growth FR0013143872 ALWIT), a global leader in test automation and monitoring technology for video service providers, today announced that i...
18/01/2025
Digital Alert Systems, the global leader in emergency communications solutions for media providers, today announced the appointment of Daniel Dillon as a produc...
18/01/2025
Riedel Communications today announced that the prestigious Daegu Concert House in South Korea has upgraded its communications systems with a shift to Riedel'...
18/01/2025
Telos Alliance (stand #4L700), trusted global leader in broadcast audio for more than three decades, announces it will showcase a range of industry-leading sol...
18/01/2025
Grass Valley, the media and entertainment industry's leading technology provider, today announced the appointment of three industry veterans to key position...
18/01/2025
Grass Valley, the media and entertainment industry's leading technology provider, is bringing its media production expertise to ISE 2025 to showcase how bro...
18/01/2025
At ISE 2025, Black Box will showcase its advanced IP KVM solutions, providing systems integrators, control room designers, live event producers, and Pro AV and...
18/01/2025
Back to All News
Lunar New Year Must-Watch: Period Rom-Com Drama Series Perfec...
17/01/2025
Discover how EVO shared storage can add value to your existing cloud and NAS systems, including Avid Nexis, Dell Isilon, and more.
Your team's storage syst...
17/01/2025
Studio Technologies Latest ST 2110 to Dante Bridge and Related Innovations Prese...
17/01/2025
Flying through clouds with no plugins and AI images
Graham Quince January 17, 2025
0 Comments
I've long been wondering about the best way to creat...
17/01/2025
Spectrum The Psychological Reasoning Behind Adobe's Design System!
Colin Smith January 17, 2025
0 Comments
This is a look at the new interface i...
17/01/2025
NEW YORK Despite record-breaking ad revenues in 2024 fueled by massive political spending and the Olympics, a new Internet Advertising Bureau (IAB) survey indic...
17/01/2025
PHILADELPHIA, Pa. In an important move towards making it much easier to bet on live sports, Comcast has added sports betting odds from FanDuel into Xfinity Odds...
17/01/2025
WASHINGTON, D.C. President-elect Donald Trump has nominated Olivia Trusty to serve on the Federal Communications Commission....
17/01/2025
Boston Conservatory at Berklee Presents: Commercial Dance BFA Concert Celebrating the Conservatory's first-ever class of commercial dance students, the co...
17/01/2025
SHAKOPEE, Minn. - January 17, 2025 -
Leading control and automation manufacturer RTI today announced that David Cesar has joined the company as Western Region...
17/01/2025
Ratings Roundup: NFL Sees 8% Drop During Wild Card Weekend; ESPN Experiences Mos...
17/01/2025
SVG Sit-Down: Vizrt's Per von Rosen on How Viz Libero Certified Training, Vi...
17/01/2025
Sports Broadcasting Hall of Famer Sean McManus on the Authenticity of September ...
17/01/2025
NFL Playoffs 2025: FOX Sports Puts New Tech Through Paces To Ensure Super Bowl L...
17/01/2025
Unrivaled Revealed, Part 2: TNT Sports' Studio Show Revels in Behind-the-Sce...
17/01/2025
Unrivaled Revealed, Part 1: At Mediapro Facility, TNT Sports Operations Team Dev...
17/01/2025
SVG Rewind: Producer Katie Halter, Director Amanda Smerage Reflect on PWHL Takeo...
17/01/2025
FloSports Elevates Production Plans for UCA & UDA College Cheerleading and Dance...
17/01/2025
Back to All News
Go on a Journey of Love and Healing this Valentine's Day w...
17/01/2025
Back to All News
Netflix Announces Release Date and First Look of Upcoming Roma...
16/01/2025
MELBOURNE, Fla., Jan. 15, 2025 - L3Harris Technologies (NYSE: LHX) Co-founder, C...
16/01/2025
MONTREAL, CANADA - January 16, 2025 - Grass Valley, the media and entertainment ...
16/01/2025
MONTREAL Grass Valley, a provider of end-to-end live entertainment and media technology, has strengthened its North American sports and live production expertis...
16/01/2025
NEW YORK Fox Sports said will be streaming the Feb. 9 Super Bowl for the first time via free streaming service Tubi, as well as providing coverage of the big ga...
16/01/2025
Dalet Appoints Erik Holt as Senior Vice President, Global Channels
Brie Clayton January 16, 2025
0 Comments
Dalet, a leading technology and service pr...
16/01/2025
Post Completed with DaVinci Resolve Studio for The Stargate Music Video
Brie Clayton January 16, 2025
0 Comments
Hit band Blood Incantation uses DaVin...
16/01/2025
Laowa Sets the Stage for a Zoom Probe Lens with an Ultra-Wide 15mm Perspective, ...
16/01/2025
TEL AVIV, Israel AI-powered voice solutions provider Deepdub today launched its AI Audio API enterprise-grade platform designed to deliver Hollywood-vetted audi...
16/01/2025
NEW YORK and BALTIMORE Sinclair and NBUCniversal said they have struck a major multiyear agreement renewing all 21 of Sinclair's owned and/or operated NBC a...
16/01/2025
STAMFORD, Conn. Charter Communications' Spectrum brand has announced that it is now accepting applications for Spectrum Scholars, the cable operator's a...
16/01/2025
Dalet has hired Erik Holt as senior vice president, global channels, responsible for the media technology and service provider's global partner strategy....
Scripps Research scientists create AI that watches videos by mimicking the brain A new, more sustainable AI model recognizes visual scenes by mirroring brain processes, opening doors for applications in medical diagnostics, drug discovery and beyond.
