Sony Pixel Power calrec Sony

Give AI a Look: Any Industry Can Now Search and Summarize Vast Volumes of Visual Data

04/11/2024

Enterprises and public sector organizations around the world are developing AI agents to boost the capabilities of workforces that rely on visual information from a growing number of devices - including cameras, IoT sensors and vehicles.

To support their work, a new NVIDIA AI Blueprint for video search and summarization will enable developers in virtually any industry to build visual AI agents that analyze video and image content. These agents can answer user questions, generate summaries and enable alerts for specific scenarios.

Part of NVIDIA Metropolis, a set of developer tools for building vision AI applications, the blueprint is a customizable workflow that combines NVIDIA computer vision and generative AI technologies.

Global systems integrators and technology solutions providers including Accenture, Dell Technologies and Lenovo are bringing the NVIDIA AI Blueprint for visual search and summarization to businesses and cities worldwide, jump-starting the next wave of AI applications that can be deployed to boost productivity and safety in factories, warehouses, shops, airports, traffic intersections and more.

Announced ahead of the Smart City Expo World Congress, the NVIDIA AI Blueprint gives visual computing developers a full suite of optimized software for building and deploying generative AI-powered agents that can ingest and understand massive volumes of live video streams or data archives.

Users can customize these visual AI agents with natural language prompts instead of rigid software code, lowering the barrier to deploying virtual assistants across industries and smart city applications.

NVIDIA AI Blueprint Harnesses Vision Language Models Visual AI agents are powered by vision language models (VLMs), a class of generative AI models that combine computer vision and language understanding to interpret the physical world and perform reasoning tasks.

The NVIDIA AI Blueprint for video search and summarization can be configured with NVIDIA NIM microservices for VLMs like NVIDIA VILA, LLMs like Meta's Llama 3.1 405B and AI models for GPU-accelerated question answering and context-aware retrieval-augmented generation. Developers can easily swap in other VLMs, LLMs and graph databases and fine-tune them using the NVIDIA NeMo platform for their unique environments and use cases.

Adopting the NVIDIA AI Blueprint could save developers months of effort on investigating and optimizing generative AI models for smart city applications. Deployed on NVIDIA GPUs at the edge, on premises or in the cloud, it can vastly accelerate the process of combing through video archives to identify key moments.

In a warehouse environment, an AI agent built with this workflow could alert workers if safety protocols are breached. At busy intersections, an AI agent could identify traffic collisions and generate reports to aid emergency response efforts. And in the field of public infrastructure, maintenance workers could ask AI agents to review aerial footage and identify degrading roads, train tracks or bridges to support proactive maintenance.

Beyond smart spaces, visual AI agents could also be used to summarize videos for people with impaired vision, automatically generate recaps of sporting events and help label massive visual datasets to train other AI models.

The video search and summarization workflow joins a collection of NVIDIA AI Blueprints that make it easy to create AI-powered digital avatars, build virtual assistants for personalized customer service and extract enterprise insights from PDF data.

NVIDIA AI Blueprints are free for developers to experience and download, and can be deployed in production across accelerated data centers and clouds with NVIDIA AI Enterprise, an end-to-end software platform that accelerates data science pipelines and streamlines generative AI development and deployment.

AI Agents to Deliver Insights From Warehouses to World Capitals Enterprise and public sector customers can also harness the full collection of NVIDIA AI Blueprints with the help of NVIDIA's partner ecosystem.

Global professional services company Accenture has integrated NVIDIA AI Blueprints into its Accenture AI Refinery, which is built on NVIDIA AI Foundry and enables customers to develop custom AI models trained on enterprise data.

Global systems integrators in Southeast Asia - including ITMAX in Malaysia and FPT in Vietnam - are building AI agents based on the video search and summarization NVIDIA AI Blueprint for smart city and intelligent transportation applications.

Developers can also build and deploy NVIDIA AI Blueprints on NVIDIA AI platforms with compute, networking and software provided by global server manufacturers.

Dell will use VLM and agent approaches with Dell's NativeEdge platform to enhance existing edge AI applications and create new edge AI-enabled capabilities. Dell Reference Designs for the Dell AI Factory with NVIDIA and the NVIDIA AI Blueprint for video search and summarization will support VLM capabilities in dedicated AI workflows for data center, edge and on-premises multimodal enterprise use cases.

NVIDIA AI Blueprints are also incorporated in Lenovo Hybrid AI solutions powered by NVIDIA.

Companies like K2K, a smart city application provider in the NVIDIA Metropolis ecosystem, will use the new NVIDIA AI Blueprint to build AI agents that analyze live traffic cameras in real time. This will enable city officials to ask questions about street activity and receive recommendations on ways to improve operations. The company also is working with city traffic managers in Palermo, Italy, to deploy visual AI agents using NIM microservices and NVIDIA AI Blueprints.

Discover more about the NVIDIA AI Blueprint for video search and summarization by visiting the NVIDIA booth at the Smart Cities Expo World Congress, taking place in Barcelona through Nov. 7.

Le
LINK: https://blogs.nvidia.com/blog/video-search-summarization-ai-agents/...
See more stories from nvidia

Most recent headlines

10/12/2025

Sound-Alike Commercials Are Part of Sports' Soundtrack

Sound-Alike Commercials Are Part of Sports' Soundtrack Johnny Cash for Coca-Cola is the latest in a long litany of sonic approximationsBy Dan Daley, Audio ...

10/12/2025

Immersive Sound Is Logical Next Step for Sports Venues

Immersive Sound Is Logical Next Step for Sports VenuesSound-systems suppliers are sanguine, but the market has its challengesBy Dan Daley, Audio Editor Wednes...

10/12/2025

The Romans Built Arenas for Immersive Sound 2,000 Years Ago

The Romans Built Arenas for Immersive Sound 2,000 Years AgoThe historic Arena of Nimes in France is still in use todayBy Dan Daley, Audio Editor Wednesday, De...

10/12/2025

SVG Summit 2025 Preview: Audio Workshop Hits on Immersive, Virtualized, and Next-Gen Streaming Workflows

SVG Summit 2025 Preview: Audio Workshop Hits on Immersive, Virtualized, and Next...

10/12/2025

SVG Summit 2025 Technology Exhibits Preview: Audio Spotlight

SVG Summit 2025 Technology Exhibits Preview: Audio SpotlightBy SVG Staff Wednesday, December 10, 2025 - 8:21 am Print This Story | Subscribe Story Highlig...

10/12/2025

SVG Europe Audio: Listening to the Sounds of Powder and Ice at Milano Cortina with a Behind the Scenes Tour of OBS and NBC's Audio Set Ups

SVG Europe Audio: Listening to the sounds of powder and ice at Milano Cortina wi...

10/12/2025

Advancements in Audio Technology: Capturing the Atmosphere of Live Sports

Advancements in audio technology: Capturing the atmosphere of live sports By David Davies Tuesday, November 25, 2025 - 09:27 Print This Story Although wor...

10/12/2025

Everything Smelled of Popcorn: The Art of Bringing the Complex Sound of Esports to Fans With Sound Supervisor Matt Gilbert

Everything smelled of popcorn: The art of bringing the complex sound of esports ...

10/12/2025

2026 Sundance Film Festival Unveils 97 Projects Selected for the Feature Film and Episodic Program

Top L-R: Ha-Chan, Shake Your Booty!, Hanging by a Wire, Broken English, Buddy C...

10/12/2025

You're in Control: Spotify Lets You Steer the Algorithm

For the first time, Spotify is giving users the power to steer the algorithm. Gustav S derstr m, Spotify's Co-President, CPO, and CTO, shares the vision beh...

10/12/2025

L3Harris to Produce Additional Solid Rocket Motors for Precision-Guided Artillery System

L3Harris' new contract for Guided Multiple Launch Rocket System Insensitive ...

10/12/2025

US Space Force Expands Offensive Space Programs Through L3Harris Foreign Sales

L3Harris Meadowlands system has been designed with an open architecture software system that allows for more flexible and efficient software updates. This capab...

10/12/2025

Football Shifts TV Viewing Towards Ad Supported, Nielsen's Q3 2025 Ad Supported Gauge Finds

During this interval, streaming comprised the majority of ad supported TV (46.4%...

10/12/2025

Bitcentral Names Venture Capital Exec Rick Arnold to Board

NEWPORT BEACH, Calif. Bitcentral, a provider of production, asset management, playout and streaming workflow solutions, has named technology veteran Rick Arnold...

10/12/2025

TV Tech Announces Winners of 2025 Best in Market Awards for M&E Tech

TV Tech is delighted to reveal the winners of the 2025 Media & Entertainment: Best in Market Awards....

10/12/2025

AIMS, VSF, AMWA, EBU To Hold Inaugural IPMX Testing, Certification Event

BOTHELL, Wash. The Alliance for IP Media Solutions (AIMS), the Video Services Forum (VSF), the Advanced Media Workflow Association (AMWA) and the European Broad...

10/12/2025

DirecTV Launches Peacock Games

In a notable example of how pay TV operators are integrating streaming services into their lineup and using those services to retain or attract subscribers, Dir...

10/12/2025

Chaos Brings Real-Time Rendering to Maya and Houdini

Today, Chaos builds instant feedback into the viewport, connecting Maya and Houdini to Chaos Vantage's real-time path tracer. Artists can now assess 3D asse...

10/12/2025

Smeup doubles capacity with Cubbit under a new agreement...

Smeup, a key partner for companies engaged in digital transformation, today announced the expansion of its adoption of Cubbit, the first geo-distributed cloud s...

10/12/2025

Mediagenix Strengthens Its Security Posture with ISO 2700...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, today announced two significant milestones...

10/12/2025

HDR10+ Technologies Unveils HDR10+ ADVANCED Dynamic Metadata Technology

BEAVERTON, Ore. HDR10+ Technologies, LLC has announced that they will soon begin the licensing and certification of devices, content, and services that support ...

10/12/2025

SMPTE, EBU, ETC Publish Report on AI's Impact on the Media

SMPTE has joined forces with the European Broadcasting Union (EBU) and Entertainment Technology Center (ETC) to publish an updated report on AI and its impact o...

10/12/2025

Clear-Com Appoints Kris Koch as New Director of Sales - N...

Clear-Com is pleased to announce the appointment of Kris Koch as Director of Sales - North & South America. In this expanded leadership role, Kris will oversee...

10/12/2025

Mavis Camera Launches Film Kit Unlocking LUT Workflows an...

Mavis today announced the latest version of Mavis Camera (v7.4), a major update to its professional iOS camera app, headlined by the launch of Film Kit - an opt...

10/12/2025

Creamsource Taps Industry Heavyweight Markus Zeiler as Gr...

Creamsource, renowned for its Vortex series of cinematic lighting, is laying the groundwork for its next phase of growth with the addition of Markus Zeiler as G...

10/12/2025

Digital Alert Systems Introduces DAS3-DC-PS DASDEC-III DC...

Digital Alert Systems, a global leader in emergency communications solutions for media providers, today announced that the DAS3-DC-PS, a new DC power supply opt...

10/12/2025

Riedel and Racing Electronics Announce Strategic Partners...

Riedel Communications today announced it has formed a strategic partnership with Racing Electronics, a premier provider of motorsport communication equipment in...

10/12/2025

GALSNGEAR Announces 2026 Leadership Retreats on East and...

#GALSNGEAR is launching two signature leadership retreats in early 2026, designed to equip women in media, entertainment, and technology with the tools to lead...

10/12/2025

CVP Launches Global Price Guarantee for Seamless Internat...

Providing worldwide customers with total confidence through transparent, all-inclusive pricing CVP, one of Europe's leading suppliers of professional video...

10/12/2025

Securing the Future of Broadcast TV in the U.S.

With the Federal Communications Commission working on new rules for the deployment of NextGen TV, next year promises to be an important one for both the future ...

10/12/2025

Former Charter CEO Tom Rutledge to Receive Cable Centers Bresnan Award

DENVER Tom Rutledge, director emeritus and former president and CEO of Charter Communications, will be honored with the 2026 Bresnan Ethics in Business Award by...

10/12/2025

Cadent Acquires YouTube Measurement Firm VuePlanner

NEW YORK Novocap's Cadent has acquired VuePlanner, a YouTube video ad planning, optimization, and measurement company in a deal that will help Cadent expand...

10/12/2025

Avoid Playlist Conflicts: Scheduling Back-to-Back Special Playlists

In preparation for the madness of March, here are some important reminders for scheduling back-to-back Special Playlists. The first Special Playlist MUST end b...

10/12/2025

VEON's Rising Capital Markets Profile Strengthened by Inclusion in Key Global Indices

10 Dec 2025 VEON's Rising Capital Markets Profile Strengthened by Inclusion...

10/12/2025

VEON Recognized for JazzCash, Kyivstar and Jazz at the World Communication Awards 2025

10 Dec 2025 VEON Recognized for JazzCash, Kyivstar and Jazz at the World Commun...

10/12/2025

Tribeca Films to Release the Independent Documentary Film Beam Me Up, Sulu by Timour Gregory and Sasha Schneider

December 10th, 2025 TRIBECA FILMS TO RELEASE THE INDEPENDENT DOCUMENTARY FILM...

10/12/2025

Sky extends partnership with the Ladies European Tour for a landmark 30th year

Wednesday 10 December 2025 Sky extends partnership with the Ladies European Tour for a landmark 30th year Sky and the Ladies European Tour (LET) have announce...

10/12/2025

Walk-on if you love the darts: James Maddison, Luke Littler and Big John star as Club 180 opens before 2026 PDC World Darts Championship

Wednesday 10 December 2025 Walk-on if you love the darts: James Maddison, Luke ...

10/12/2025

Rohde & Schwarz presents world's first RF power sensor with 0.80 mm RF connector for gapless DC to 150 GHz coverage

Rohde & Schwarz presents world's first RF power sensor with 0.80 mm RF conne...

10/12/2025

2026 Starts With a Swoon: Kim Seon-ho and Go Youn-jung Lead Can This Love Be Translated?', Premiering January 16

Back to All News 2026 Starts With a Swoon: Kim Seon-ho and Go Youn-jung Lead C...

10/12/2025

'Berlin and the Lady with an Ermine' Arrives to Netflix on May 15

Back to All News Berlin and the Lady with an Ermine Arrives to Netflix on May 15 Entertainment 10 December 2025 GlobalSpain Link copied to clipboard THE N...

10/12/2025

From stand-up to Foxtrot: Comedian Michael Fry revealed as fourth contestant for Dancing with the Stars 2026

It's out of the frying pan and into the sequins for comedian and actor Micha...

10/12/2025

Documentary film on the extraordinary life of Patrick Lydon, pioneer of social inclusion and disability, to premiere on RT

Born That Way airs Thursday 18 December on RT One and RT Player Born That ...

09/12/2025

2025 Sports Broadcasting Hall of Fame: Pam Oliver, Sideline Icon Who Redefined the Role

2025 Sports Broadcasting Hall of Fame: Pam Oliver, Sideline Icon Who Redefined t...

09/12/2025

SVG Summit 2025 Technology Exhibits Preview, Part 2

SVG Summit 2025 Technology Exhibits Preview, Part 2By Jason Dachman, Editorial Director, U.S. Tuesday, December 9, 2025 - 7:17 am Print This Story | Subscr...

09/12/2025

SVG Summit 2025 Preview: Cloud Production Workshop Spotlights Live and Non-Live Workflows in the Cloud

SVG Summit 2025 Preview: Cloud Production Workshop Spotlights Live and Non-Live ...

09/12/2025

Next-Generation Content Protection: Multi-Technology Security is Integral to Combating New Threats

Next-generation content protection: Multi-technology security is integral to com...

09/12/2025

CBS Sports Provides One-of-a-Kind Production' for UEFA Champions League Crossover Event

CBS Sports Provides One-of-a-Kind Production' for UEFA Champions League Cro...

09/12/2025

Spanish Professional Basketball League Relies on NETGEAR AV, MAM Tech for Seamless Production

Spanish Professional Basketball League Relies on NETGEAR AV, MAM Tech for Seamle...