Sony Pixel Power calrec Sony

Give AI a Look: Any Industry Can Now Search and Summarize Vast Volumes of Visual Data

04/11/2024

Enterprises and public sector organizations around the world are developing AI agents to boost the capabilities of workforces that rely on visual information from a growing number of devices - including cameras, IoT sensors and vehicles.

To support their work, a new NVIDIA AI Blueprint for video search and summarization will enable developers in virtually any industry to build visual AI agents that analyze video and image content. These agents can answer user questions, generate summaries and enable alerts for specific scenarios.

Part of NVIDIA Metropolis, a set of developer tools for building vision AI applications, the blueprint is a customizable workflow that combines NVIDIA computer vision and generative AI technologies.

Global systems integrators and technology solutions providers including Accenture, Dell Technologies and Lenovo are bringing the NVIDIA AI Blueprint for visual search and summarization to businesses and cities worldwide, jump-starting the next wave of AI applications that can be deployed to boost productivity and safety in factories, warehouses, shops, airports, traffic intersections and more.

Announced ahead of the Smart City Expo World Congress, the NVIDIA AI Blueprint gives visual computing developers a full suite of optimized software for building and deploying generative AI-powered agents that can ingest and understand massive volumes of live video streams or data archives.

Users can customize these visual AI agents with natural language prompts instead of rigid software code, lowering the barrier to deploying virtual assistants across industries and smart city applications.

NVIDIA AI Blueprint Harnesses Vision Language Models Visual AI agents are powered by vision language models (VLMs), a class of generative AI models that combine computer vision and language understanding to interpret the physical world and perform reasoning tasks.

The NVIDIA AI Blueprint for video search and summarization can be configured with NVIDIA NIM microservices for VLMs like NVIDIA VILA, LLMs like Meta's Llama 3.1 405B and AI models for GPU-accelerated question answering and context-aware retrieval-augmented generation. Developers can easily swap in other VLMs, LLMs and graph databases and fine-tune them using the NVIDIA NeMo platform for their unique environments and use cases.

Adopting the NVIDIA AI Blueprint could save developers months of effort on investigating and optimizing generative AI models for smart city applications. Deployed on NVIDIA GPUs at the edge, on premises or in the cloud, it can vastly accelerate the process of combing through video archives to identify key moments.

In a warehouse environment, an AI agent built with this workflow could alert workers if safety protocols are breached. At busy intersections, an AI agent could identify traffic collisions and generate reports to aid emergency response efforts. And in the field of public infrastructure, maintenance workers could ask AI agents to review aerial footage and identify degrading roads, train tracks or bridges to support proactive maintenance.

Beyond smart spaces, visual AI agents could also be used to summarize videos for people with impaired vision, automatically generate recaps of sporting events and help label massive visual datasets to train other AI models.

The video search and summarization workflow joins a collection of NVIDIA AI Blueprints that make it easy to create AI-powered digital avatars, build virtual assistants for personalized customer service and extract enterprise insights from PDF data.

NVIDIA AI Blueprints are free for developers to experience and download, and can be deployed in production across accelerated data centers and clouds with NVIDIA AI Enterprise, an end-to-end software platform that accelerates data science pipelines and streamlines generative AI development and deployment.

AI Agents to Deliver Insights From Warehouses to World Capitals Enterprise and public sector customers can also harness the full collection of NVIDIA AI Blueprints with the help of NVIDIA's partner ecosystem.

Global professional services company Accenture has integrated NVIDIA AI Blueprints into its Accenture AI Refinery, which is built on NVIDIA AI Foundry and enables customers to develop custom AI models trained on enterprise data.

Global systems integrators in Southeast Asia - including ITMAX in Malaysia and FPT in Vietnam - are building AI agents based on the video search and summarization NVIDIA AI Blueprint for smart city and intelligent transportation applications.

Developers can also build and deploy NVIDIA AI Blueprints on NVIDIA AI platforms with compute, networking and software provided by global server manufacturers.

Dell will use VLM and agent approaches with Dell's NativeEdge platform to enhance existing edge AI applications and create new edge AI-enabled capabilities. Dell Reference Designs for the Dell AI Factory with NVIDIA and the NVIDIA AI Blueprint for video search and summarization will support VLM capabilities in dedicated AI workflows for data center, edge and on-premises multimodal enterprise use cases.

NVIDIA AI Blueprints are also incorporated in Lenovo Hybrid AI solutions powered by NVIDIA.

Companies like K2K, a smart city application provider in the NVIDIA Metropolis ecosystem, will use the new NVIDIA AI Blueprint to build AI agents that analyze live traffic cameras in real time. This will enable city officials to ask questions about street activity and receive recommendations on ways to improve operations. The company also is working with city traffic managers in Palermo, Italy, to deploy visual AI agents using NIM microservices and NVIDIA AI Blueprints.

Discover more about the NVIDIA AI Blueprint for video search and summarization by visiting the NVIDIA booth at the Smart Cities Expo World Congress, taking place in Barcelona through Nov. 7.

Le
LINK: https://blogs.nvidia.com/blog/video-search-summarization-ai-agents/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

28/01/2026

OpenDrives Announces New Funding, Appoints Trevor Morgan CEO

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

AWARN Alliance Backs ATSC Sunset, NextGen TV Security Measures

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

More Than Two Dozen Groups Tell FCC to Reject Nexstar-Tegna Deal

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Screen Australia refreshes Market & Audience approach to increase the impact of local content

28 01 2026 - Media release Screen Australia refreshes Market & Audience approach...

28/01/2026

Boston Conservatory Orchestra Premieres a New Piano Concerto by Peter and Leonardo Dugan

Boston Conservatory Orchestra Premieres a New Piano Concerto by Peter and Leonar...

27/01/2026

Akamai and Yospace Deliver Seamless, Personalised Ad Experiences to Tens of Millions of ABEMA Users

Click for Japanese version Tokyo, Japan - January 27, 2026 - Akamai Technolo...

27/01/2026

Alfred P. Sloan Foundation and Sundance Institute Name Winners of Science-In-Film Initiative's Feature Film Prize and Artist Grants

L-R: Jonathan Cuchacovich, Sonia Kennebeck, Alan Fischer, Daeil Kim, Andrew Sta...

27/01/2026

B-LINE Is Here to Help: Backline Launches 24/7 Music Industry Mental Health & Crisis Support Line in Partnership with Spotify

Today, Spotify is proud to support our partner Backline, an industry-leading men...

27/01/2026

Netn Vega's Genre-Bending Sound Hits a Crossover Moment on Spotify's RADAR

With nearly 29 million monthly listeners and clear momentum on Spotify, Net n Ve...

27/01/2026

25 Ontario Named One of Torontos Best New Buildings

January 14, 2026 We are proud to share that 25 Ontario, First Gulf's commercial project located just two minutes from our head office, has been recognized ...

27/01/2026

Full-Building Lease Secured at Speers Road

January 22, 2026 First Gulf is excited to share that a full-building lease has been secured at 625 Bronte Rd in Oakville, part of Bronte Station Business Park,...

27/01/2026

Another Gold for First Gulf and 351 King Street East

January 23, 2026 First Gulf continues to demonstrate its commitment to high-performance, sustainable real estate with 351 King Street East achieving BOMA BEST ...

27/01/2026

Clear-Com Empowers Reykjavik City Theatre with New Upgrades

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

27/01/2026

Hubbard Broadcasting Renews Partnership With Nielsen in Albany and Albuquerque-Santa Fe Markets

Nielsen will continue to drive growth and provide local audience measurement in...

27/01/2026

Pebble Adds Paul Nagle-Smith as VP of Customer Fulfillment

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Study: Top Reason for Cancelling Streaming Service Is Programming

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

U.K.'s Digital TV Group Taps Leslie Mackenzie as Chair

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Amagi becomes the first cloud-native SaaS company offerin...

Amagi Media Labs Limited, the only cloud-native SaaS provider offering end-to-end solutions across live production, content preparation, distribution, and monet...

27/01/2026

Miri Technologies Launches V410 Live 4K Video Encoder-Dec...

Miri Technologies Inc. today unveiled its V410 live 4K video encoder/decoder for streaming, IP-based production workflows and AV-over-IP distribution. Designed ...

27/01/2026

UML Tsongas Center Upgrades with Ikegami UHK-X600 Cameras

The Paul E. Tsongas Center at UMass Lowell in Massachusetts has chosen Ikegami cameras for incorporation into its broadcast-quality television production facili...

27/01/2026

SipRadius provides simplicity and security for AV content...

SipRadius, specialists in secure, low latency media transport, will show the pro AV community its end-to-end solution for high quality content distribution and ...

27/01/2026

Hiltron to Showcase its Full Range of Satcom Solutions at...

Hiltron will highlight the fruits of its 45-plus years of experience in satellite communications system integration and product development at the annual GovSat...

27/01/2026

Broadcast and pro AV professionals cut costs and single-u...

Klvr will demonstrate how its Charger Pro solution is delivering cost reduction and performance benefits for live entertainment and pro AV markets at ISE 2026 (...

27/01/2026

Amino Showcases Single Player Digital Signage and Enterpr...

Amino, a global media technology leader in enterprise video and digital signage, today announced that its Integrated Systems Europe (ISE) 2026 booth (4N700) wil...

27/01/2026

ANI Expands Strategic Partnership with LiveU

ANI, India's leading news agency and a major content provider across the Asia Pacific region, today announced a significant expansion of its long standing p...

27/01/2026

VisualOn and The Channel Store Demonstrate Up to 65 Perce...

Independent analysis confirms faster encoding, lower CPU usage, and improved perceptual quality compared to CBR and CRF VisualOn, a leader in multimedia playba...

27/01/2026

EVS Officially Launches eShop

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Miri to Showcase New V410 Video Encoder/Decoder at ISE 2026

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

FCC Settles Two Investigations, Renews Three TV Station Licenses

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

UML Tsongas Center Upgrades to Ikegami UHK-X600 Cameras

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

27/01/2026

Australian Defence Force Secures Satellite Communications on SES IS-22

New agreement for uninterrupted UHF connectivity for Australian Defence Force through 2033, With Options Extending to 2041 Luxembourg, January 13, 2026 - Satel...

27/01/2026

SNL UK creative team expands as Pauli Lovejoy, Annie Hardinge and Kevin Fortune join series

Tuesday 27 January 2026 SNL UK creative team expands as Pauli Lovejoy, Annie Ha...

27/01/2026

When It Feels Real, Is It Still a Lie? The Art of Sarah' Premieres February 13

Back to All News When It Feels Real, Is It Still a Lie? The Art of Sarah' ...

27/01/2026

That Night premiering on Netflix March 13

Back to All News That Night premiering on Netflix March 13 Entertainment 27 January 2026 GlobalSpain Link copied to clipboard DOWNLOAD THE KEY ART DOWNLO...

27/01/2026

Netflix Revealed the Future of Mexican Stories Coming in 2026

Back to All News Netflix Revealed the Future of Mexican Stories Coming in 2026 Entertainment 27 January 2026 GlobalMexico Link copied to clipboard Among t...

27/01/2026

What's Next on Netflix from Japan: Expanding the Possibilities of Storytelling in 2026

Back to All News What's Next on Netflix from Japan: Expanding the Possibili...

27/01/2026

FOR-A to show cutting edge technology at FOMEX 2026

AI, graphics and virtual software power new production capabilities...

27/01/2026

RT is Supporting 20 Arts and Cultural Events all over Ireland this February

RT Supporting the Arts is delighted to support a dynamic programme of cultural events taking place across Ireland this February. From visual art, film, music, ...

26/01/2026

New Directed By' Series Explores the Making of Music Videos and Kicks Off With Maisie Peters

Music videos play a huge part in how fans connect with their favorite songs, but...

26/01/2026

NAIDOC launches 2026 theme 50 Years of Deadly, marks major milestone

NAIDOC launches 2026 theme 50 Years of Deadly , marks major milestone 25 January, 2026 Media releases The National NAIDOC Committee has today unveiled its...

26/01/2026

Amagi Lists on Indian Stock Exchanges

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

26/01/2026

FCC Releases Tentative Agenda for Jan. 29 Open Meeting

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

26/01/2026

Dante Turns 20

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

26/01/2026

APTS, PBS Tell FCC Not to Set a Firm Date for ATSC 1.0 Sunset

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...