Sony Pixel Power calrec Sony

Give AI a Look: Any Industry Can Now Search and Summarize Vast Volumes of Visual Data

04/11/2024

Enterprises and public sector organizations around the world are developing AI agents to boost the capabilities of workforces that rely on visual information from a growing number of devices - including cameras, IoT sensors and vehicles.

To support their work, a new NVIDIA AI Blueprint for video search and summarization will enable developers in virtually any industry to build visual AI agents that analyze video and image content. These agents can answer user questions, generate summaries and enable alerts for specific scenarios.

Part of NVIDIA Metropolis, a set of developer tools for building vision AI applications, the blueprint is a customizable workflow that combines NVIDIA computer vision and generative AI technologies.

Global systems integrators and technology solutions providers including Accenture, Dell Technologies and Lenovo are bringing the NVIDIA AI Blueprint for visual search and summarization to businesses and cities worldwide, jump-starting the next wave of AI applications that can be deployed to boost productivity and safety in factories, warehouses, shops, airports, traffic intersections and more.

Announced ahead of the Smart City Expo World Congress, the NVIDIA AI Blueprint gives visual computing developers a full suite of optimized software for building and deploying generative AI-powered agents that can ingest and understand massive volumes of live video streams or data archives.

Users can customize these visual AI agents with natural language prompts instead of rigid software code, lowering the barrier to deploying virtual assistants across industries and smart city applications.

NVIDIA AI Blueprint Harnesses Vision Language Models Visual AI agents are powered by vision language models (VLMs), a class of generative AI models that combine computer vision and language understanding to interpret the physical world and perform reasoning tasks.

The NVIDIA AI Blueprint for video search and summarization can be configured with NVIDIA NIM microservices for VLMs like NVIDIA VILA, LLMs like Meta's Llama 3.1 405B and AI models for GPU-accelerated question answering and context-aware retrieval-augmented generation. Developers can easily swap in other VLMs, LLMs and graph databases and fine-tune them using the NVIDIA NeMo platform for their unique environments and use cases.

Adopting the NVIDIA AI Blueprint could save developers months of effort on investigating and optimizing generative AI models for smart city applications. Deployed on NVIDIA GPUs at the edge, on premises or in the cloud, it can vastly accelerate the process of combing through video archives to identify key moments.

In a warehouse environment, an AI agent built with this workflow could alert workers if safety protocols are breached. At busy intersections, an AI agent could identify traffic collisions and generate reports to aid emergency response efforts. And in the field of public infrastructure, maintenance workers could ask AI agents to review aerial footage and identify degrading roads, train tracks or bridges to support proactive maintenance.

Beyond smart spaces, visual AI agents could also be used to summarize videos for people with impaired vision, automatically generate recaps of sporting events and help label massive visual datasets to train other AI models.

The video search and summarization workflow joins a collection of NVIDIA AI Blueprints that make it easy to create AI-powered digital avatars, build virtual assistants for personalized customer service and extract enterprise insights from PDF data.

NVIDIA AI Blueprints are free for developers to experience and download, and can be deployed in production across accelerated data centers and clouds with NVIDIA AI Enterprise, an end-to-end software platform that accelerates data science pipelines and streamlines generative AI development and deployment.

AI Agents to Deliver Insights From Warehouses to World Capitals Enterprise and public sector customers can also harness the full collection of NVIDIA AI Blueprints with the help of NVIDIA's partner ecosystem.

Global professional services company Accenture has integrated NVIDIA AI Blueprints into its Accenture AI Refinery, which is built on NVIDIA AI Foundry and enables customers to develop custom AI models trained on enterprise data.

Global systems integrators in Southeast Asia - including ITMAX in Malaysia and FPT in Vietnam - are building AI agents based on the video search and summarization NVIDIA AI Blueprint for smart city and intelligent transportation applications.

Developers can also build and deploy NVIDIA AI Blueprints on NVIDIA AI platforms with compute, networking and software provided by global server manufacturers.

Dell will use VLM and agent approaches with Dell's NativeEdge platform to enhance existing edge AI applications and create new edge AI-enabled capabilities. Dell Reference Designs for the Dell AI Factory with NVIDIA and the NVIDIA AI Blueprint for video search and summarization will support VLM capabilities in dedicated AI workflows for data center, edge and on-premises multimodal enterprise use cases.

NVIDIA AI Blueprints are also incorporated in Lenovo Hybrid AI solutions powered by NVIDIA.

Companies like K2K, a smart city application provider in the NVIDIA Metropolis ecosystem, will use the new NVIDIA AI Blueprint to build AI agents that analyze live traffic cameras in real time. This will enable city officials to ask questions about street activity and receive recommendations on ways to improve operations. The company also is working with city traffic managers in Palermo, Italy, to deploy visual AI agents using NIM microservices and NVIDIA AI Blueprints.

Discover more about the NVIDIA AI Blueprint for video search and summarization by visiting the NVIDIA booth at the Smart Cities Expo World Congress, taking place in Barcelona through Nov. 7.

Le
LINK: https://blogs.nvidia.com/blog/video-search-summarization-ai-agents/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

17/10/2025

HBO Maxs Global Expansion Surpasses 100 Market Milestone

HBO Max is reporting that it has launched in 15 new markets, including Bangladesh, Cambodia, Macau, Pakistan, Sri Lanka and Ukraine, boosting the streaming serv...

17/10/2025

Netflix Expands Into Video Podcasts With Spotify Deal

Netflix said it will make a major push into video podcasts, inking a wide-ranging deal with Spotify through which it will offer 16 podcasts in the U.S. starting...

17/10/2025

Viamedia Rebrands as Viamedia.ai

Lexington, Ky. As part of a push to highlight its advanced advertising capabilities, Viamedia has launched a new AI-powered ad tech platform and officially rebr...

17/10/2025

QuickLink to Showcase StudioPro Version 4 at NAB Show New York

NEW YORK QuickLink has announced the release of StudioPro Version 4, which the company is calling the most significant upgrade yet to its flagship video product...

17/10/2025

Apple, NBCU to Launch Apple TV, Peacock Streaming Bundles

NEW YORK and CUPERTINO, Calif. Apple and NBCUniversal said they will sell Apple TV and Peacock streaming bundles to U.S. subscribers starting Oct. 20....

17/10/2025

Q&A with Boston Conservatory Choral Conductor Stephen Spinelli

Q&A with Boston Conservatory Choral Conductor Stephen Spinelli How his research into the lost manuscripts of composer Florence Price led to a Grammy-winning c...

16/10/2025

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Depth-of-Field Production

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Dept...

16/10/2025

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Business U.S. Open

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Busin...

16/10/2025

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Content Division

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Con...

16/10/2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA Club World Cup 2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA...

16/10/2025

Prime Video Offers Sneak Peak at New NBA on Prime Studio

Prime Video Offers Sneak Peak at New NBA on Prime StudioThe massive 13,000-sq-ft, two-story studio features a LED regulation half court and hoopBy Jason Dachman...

16/10/2025

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, Deep Dive Into REMI Workflows

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, De...

16/10/2025

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live-Sports World

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live...

16/10/2025

CultureCon Uncut' Video Podcast Returns for Season 2 With Host Imani Ellis

In 2017, Imani Ellis launched CultureCon, a conference that's become a must-attend event for more than 10,000 diverse creatives and Black professionals to c...

16/10/2025

Fresh Spins on Holiday Standards: The 2025 Spotify Singles Have Arrived

It might still be a little early to break out the tinsel and mistletoe, but Spotify's already queuing up some holiday magic. This year's Spotify Singles...

16/10/2025

Spotify to Publish First Independent Author Releases Through Audiobook Selects, With More Planned Ahead

Earlier this year, our in-house publishing imprint, Spotify Audiobooks, put out ...

16/10/2025

L3Harris Integrates VAMPIRE Aboard GM Defense's Infantry Squad Vehicle

VAMPIRE has been integrated onto GM Defenses Infantry Squad Vehicle (ISV), providing a mobile solution to effectively and affordably counter small drone threat...

16/10/2025

Unseen and Unmatched: L3Harris Marks a First in Infrared Tracking Technology

The AgilePod mounted on the host aircraft....

16/10/2025

Consumer attitudes toward in-car entertainment and media preferences highlighted in new Gracenote automotive report

60% say infotainment systems are a critical purchasing or leasing consideration,...

16/10/2025

Broadcasters Foundation Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign, which seeks to raise donations from tax-deductible personal and ...

16/10/2025

Roku Adds Live Sports Scores, AI-Powered Voice Discovery, New Hardware

Roku has added several new features to its user interface and operating system meant to make it easier to discover and personalize content, the company said....

16/10/2025

CNN to Launch New All Access Subscription Tier Oct. 28

NEW YORK CNN has announced that its All Access subscription tier will launch in the U.S. on Oct. 28, providing audiences with a centralized destination for CNN&...

16/10/2025

Student Spotlight: Alan Villanueva

Student Spotlight: Alan Villanueva The graduate student and saxophonist, who performed on Natalia Lafourcades Latin Grammy-nominated Live at Carnegie Hall alb...

16/10/2025

XR Sports Alliance Announces New Members

The XR Sports Alliance (XRSA) has announced the third cohort of members. The new members include Maple Leafs Sports & Entertainment (MLSE), the Vegas Golden Kni...

16/10/2025

Broadcasters Foundation of America Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign which seeks to raise donations from tax-deductible personal and c...

16/10/2025

Australia's Nine to Broadcast Live NHL Games

NEW YORK Australia's Nine Network and the NHL today announced a media partnership that will bring the world's premier professional ice hockey league to ...

16/10/2025

Study: 45% of U.S. Internet Households Now Watch FAST Services

Parks Associates has released new data showing that nearly half (45%) of U.S. internet homes watch free ad-supported streaming TV (FAST) services and 89% of U.S...

16/10/2025

J.D. Power: Wireless Internet Signups Soar Over Last 6 Months

TROY, Mich. -New data from J.D. Power's 2025 U.S. Residential Internet Service Provider Study shows that residential wireless internet providers are growing...

16/10/2025

Shakespeare & Hathaway: Private Investigators recommissioned for sixth series, as filming gets underway in Stratford-Upon-Avon

TV's most charming detective drama * Shakespeare & Hathaway: Private Investi...

16/10/2025

Thailand's Legendary Outlaw Returns: Tee Yai: Born to be Bad' Premieres November 13

Back to All News Thailand's Legendary Outlaw Returns: Tee Yai: Born to be ...

16/10/2025

Christmas Is Just Around The Corner: 'Home For Christmas' Season 3 is Coming to Netflix on December 12

Back to All News Christmas Is Just Around The Corner: Home For Christmas Season...

16/10/2025

Tristn Ulloa Stars in 'El crimen de Pazos', the New Netflix Series Inspired by a True Story

Back to All News Trist n Ulloa Stars in El crimen de Pazos, the New Netflix Ser...

16/10/2025

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategic Transformation

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategi...

16/10/2025

KATJA MIA ANNOUNCED AS NEW 2FM WEEKEND PRESENTER

This Saturday October 18 Katja Mia will burst onto the radio airwaves for the first time as she joins 2FM. Katja will be standing in for Bl thnaid Treacy on Sat...

16/10/2025

RT is Supporting 39 Arts and Cultural Events across Ireland this October

This October, RT is delighted to support Wexford Festival Opera, Babor International Arts Festival for Children, Open House Dublin and 36 other arts and cultu...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...