Sony Pixel Power calrec Sony

Give AI a Look: Any Industry Can Now Search and Summarize Vast Volumes of Visual Data

04/11/2024

Enterprises and public sector organizations around the world are developing AI agents to boost the capabilities of workforces that rely on visual information from a growing number of devices - including cameras, IoT sensors and vehicles.

To support their work, a new NVIDIA AI Blueprint for video search and summarization will enable developers in virtually any industry to build visual AI agents that analyze video and image content. These agents can answer user questions, generate summaries and enable alerts for specific scenarios.

Part of NVIDIA Metropolis, a set of developer tools for building vision AI applications, the blueprint is a customizable workflow that combines NVIDIA computer vision and generative AI technologies.

Global systems integrators and technology solutions providers including Accenture, Dell Technologies and Lenovo are bringing the NVIDIA AI Blueprint for visual search and summarization to businesses and cities worldwide, jump-starting the next wave of AI applications that can be deployed to boost productivity and safety in factories, warehouses, shops, airports, traffic intersections and more.

Announced ahead of the Smart City Expo World Congress, the NVIDIA AI Blueprint gives visual computing developers a full suite of optimized software for building and deploying generative AI-powered agents that can ingest and understand massive volumes of live video streams or data archives.

Users can customize these visual AI agents with natural language prompts instead of rigid software code, lowering the barrier to deploying virtual assistants across industries and smart city applications.

NVIDIA AI Blueprint Harnesses Vision Language Models Visual AI agents are powered by vision language models (VLMs), a class of generative AI models that combine computer vision and language understanding to interpret the physical world and perform reasoning tasks.

The NVIDIA AI Blueprint for video search and summarization can be configured with NVIDIA NIM microservices for VLMs like NVIDIA VILA, LLMs like Meta's Llama 3.1 405B and AI models for GPU-accelerated question answering and context-aware retrieval-augmented generation. Developers can easily swap in other VLMs, LLMs and graph databases and fine-tune them using the NVIDIA NeMo platform for their unique environments and use cases.

Adopting the NVIDIA AI Blueprint could save developers months of effort on investigating and optimizing generative AI models for smart city applications. Deployed on NVIDIA GPUs at the edge, on premises or in the cloud, it can vastly accelerate the process of combing through video archives to identify key moments.

In a warehouse environment, an AI agent built with this workflow could alert workers if safety protocols are breached. At busy intersections, an AI agent could identify traffic collisions and generate reports to aid emergency response efforts. And in the field of public infrastructure, maintenance workers could ask AI agents to review aerial footage and identify degrading roads, train tracks or bridges to support proactive maintenance.

Beyond smart spaces, visual AI agents could also be used to summarize videos for people with impaired vision, automatically generate recaps of sporting events and help label massive visual datasets to train other AI models.

The video search and summarization workflow joins a collection of NVIDIA AI Blueprints that make it easy to create AI-powered digital avatars, build virtual assistants for personalized customer service and extract enterprise insights from PDF data.

NVIDIA AI Blueprints are free for developers to experience and download, and can be deployed in production across accelerated data centers and clouds with NVIDIA AI Enterprise, an end-to-end software platform that accelerates data science pipelines and streamlines generative AI development and deployment.

AI Agents to Deliver Insights From Warehouses to World Capitals Enterprise and public sector customers can also harness the full collection of NVIDIA AI Blueprints with the help of NVIDIA's partner ecosystem.

Global professional services company Accenture has integrated NVIDIA AI Blueprints into its Accenture AI Refinery, which is built on NVIDIA AI Foundry and enables customers to develop custom AI models trained on enterprise data.

Global systems integrators in Southeast Asia - including ITMAX in Malaysia and FPT in Vietnam - are building AI agents based on the video search and summarization NVIDIA AI Blueprint for smart city and intelligent transportation applications.

Developers can also build and deploy NVIDIA AI Blueprints on NVIDIA AI platforms with compute, networking and software provided by global server manufacturers.

Dell will use VLM and agent approaches with Dell's NativeEdge platform to enhance existing edge AI applications and create new edge AI-enabled capabilities. Dell Reference Designs for the Dell AI Factory with NVIDIA and the NVIDIA AI Blueprint for video search and summarization will support VLM capabilities in dedicated AI workflows for data center, edge and on-premises multimodal enterprise use cases.

NVIDIA AI Blueprints are also incorporated in Lenovo Hybrid AI solutions powered by NVIDIA.

Companies like K2K, a smart city application provider in the NVIDIA Metropolis ecosystem, will use the new NVIDIA AI Blueprint to build AI agents that analyze live traffic cameras in real time. This will enable city officials to ask questions about street activity and receive recommendations on ways to improve operations. The company also is working with city traffic managers in Palermo, Italy, to deploy visual AI agents using NIM microservices and NVIDIA AI Blueprints.

Discover more about the NVIDIA AI Blueprint for video search and summarization by visiting the NVIDIA booth at the Smart Cities Expo World Congress, taking place in Barcelona through Nov. 7.

Le
LINK: https://blogs.nvidia.com/blog/video-search-summarization-ai-agents/...
See more stories from nvidia

Most recent headlines

02/12/2025

Case Study: How Mid-Atlantic Sports Network Moved to All-IP Distribution in 60 Days

Case Study: How Mid-Atlantic Sports Network Moved to All-IP Distribution in 60 D...

02/12/2025

2025 Sports Broadcasting Hall of Fame: Lee Corso, Coach, Commentator, Firebrand

2025 Sports Broadcasting Hall of Fame: Lee Corso, Coach, Commentator, FirebrandBy Ken Kerschbaumer Tuesday, December 2, 2025 - 7:00 am Print This Story | S...

02/12/2025

SVG All-Stars: Dan Nabors, Senior Director, Remote Engineering, TNT Sports

SVG All-Stars: Dan Nabors, Senior Director, Remote Engineering, TNT SportsThe veteran tech leader is helping guide Warner Bros. Discovery's at-home' re...

02/12/2025

National Lacrosse League Opens Season With New Cloud-Based Official Replay-Review System

National Lacrosse League Opens Season With New Cloud-Based Official Replay-Revie...

02/12/2025

Platinum White Paper: The Cinematic Look in Live Production - Bridging Aesthetics and Real-Time Broadcast Technology with Grass Valley

Platinum White Paper: The Cinematic Look in Live Production - Bridging Aesthetic...

02/12/2025

SVG India Announces Advisory Board; JioStar's Prashant Khanna Named Chairman

SVG India Announces Advisory Board; JioStar's Prashant Khanna Named ChairmanBy Ken Kerschbaumer Tuesday, December 2, 2025 - 11:15 am Print This Story |...

02/12/2025

SVG Summit 2025 Preview: New AI Production Tools Workshop' Features ESPN, Fox Sports, NBC Sports NEXT, PGA Tour, PlayOn, and USGA

SVG Summit 2025 Preview: New AI Production Tools Workshop' Features ESPN, F...

02/12/2025

Release Rundown: What to Watch in December, From Atropia to Endless Cookie

Written and directed by Hailey Gates, Atropia won the U.S. Grand Jury Prize: Dramatic at the 2025 Sundance Film Festival....

02/12/2025

Revolutionizing Defense: L3Harris' Advanced Counter-UAS Cutting-Edge Technologies Offer Scalable Solutions for NATO

The lightweight and highly portable CORVUS-RAVEN, recently demonstrated at the V...

02/12/2025

L3Harris Enhancing Marine Corps' Resilient, Multi-Orbit SATCOM Operations

The lightweight, rugged Panther 2 tri-band VSAT delivers high-speed data communications for Internet, VPN connectivity and video transmission over commercial an...

02/12/2025

Clear-Com's Gen-IC Virtual Intercom Delivers Fast, Flexible Communications for...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

02/12/2025

Nielsen Global Impact Day 2025: Expanding our global impact

NGID volunteers in the United States NGID volunteers in Mexico NGID volunteers in India NGID volunteers in Spain NGID volunteers in Australia NGID voluntee...

02/12/2025

FCC Issues Reminder on Audio-Description Rule Deadlines

WASHINGTON The Federal Communications Commission's Media Bureau has issued a reminder that stations in DMAs 111 through 120 must implement its audio descrip...

02/12/2025

Sony Unveils Alpha 7 V Full-Frame Mirrorless Camera

SAN DIEGO Sony Electronics today introduced the Alpha 7 V (ILCE-7M5), the fifth generation of its Alpha 7 full-frame mirrorless lineup, powered by the newly dev...

02/12/2025

FCC Sets Comment Deadlines for Nexstar-Tegna Merger

WASHINGTON The Federal Communications Commission has opened a docket for comments on Nexstar Media Group's proposed $6.2 billion acquisition of Tegna and se...

02/12/2025

Veronica Rodriguez, Matt Schnaars and Jeff Warshaw Join NAB Board

WASHINGTON The National Association of Broadcasters has added a trio of media executives, Veronica Rodriguez, Matt Schnaars and Jeff Warshaw, to its board of di...

02/12/2025

Brightcove Unveils New Features

MILAN, Italy Brightcove has released seven new features designed to expand global reach, improve audience engagement, enhance live-streaming quality and streaml...

02/12/2025

BCNEXXT and NPC Media Sign Partnership Agreement for Vipe...

BCNEXXT, the developers of the advanced playout platform Vipe, today announced a new Service Provider Partner agreement with NPC Media, the Australian managed p...

02/12/2025

DPA Microphones N Series Wireless Mic System Now Availabl...

DPA Microphones today announces the immediate availability of its new N-Series Digital Wireless Microphone System for customers throughout the U.S. In addition ...

02/12/2025

Hiltron Reports a Well Attended and Successful Space Tech...

Hiltron Communications reports a well attended and successful Space Tech Expo exhibition, held at the Messe Bremen from Tuesday November 18 through Thursday Nov...

02/12/2025

The HELM powers Riverfire with flawless timecode precisio...

The beginning of September saw Riverfire by Australian Retirement Trust, in association with Channel 9 and Triple M, kick off the 2025 Brisbane Festival in spec...

02/12/2025

SGM Lighting and ACT Entertainment Announce Exclusive US...

SGM Lighting is pleased to announce an exciting new partnership with ACT Entertainment, under which ACT will serve as the exclusive distributor for SGM's ne...

02/12/2025

Harmonic Powers Telias NextGeneration Broadband Upgrade i...

Harmonic (NASDAQ: HLIT) today announced that Telia, the second largest telecom operator in Norway, is modernizing its broadband network with the company's i...

02/12/2025

Keepit and TIM AG enters distribution partnership for the...

European cloud data protection specialist Keepit is expanding its sales network in the DACH region and has gained TIM AG, one of the leading value-added distrib...

02/12/2025

Calrec pushes beyond traditional broadcasting with flexib...

Featured products at ISE 2026 This year s ISE 2026 theme "Push Beyond" reflects Calrec s direction of travel. The company is dedicated to supporting the AV an...

02/12/2025

Czech TV Implements Landmark LiveU OB Project in Central...

Czech Television, the national public broadcaster, has deployed one of the largest LiveU live production projects in the region for live sports and news coverag...

02/12/2025

Leader expands cinematic camera support for Live Producti...

Test & measurement innovator, Leader Electronics, has announced the release of v8.2 software for its ZEN and ZEN-W Series, bringing advanced cinematic camera se...

02/12/2025

Accedo and Magine Pro agree to merge SaaS businesses

Global provider of video streaming software and services, Accedo, and OTT platform provider, Magine Pro, have signed a binding agreement to carve out and merge ...

02/12/2025

Skandha Media Services New VP Sales Role Signals Bold Gro...

With proven success in broadcast, OTT, and content supply chains, K.S Avinash set to scale Skandha's service-first approach across APAC Skandha Media Servi...

02/12/2025

AJA Video Systems Joins RAVENNA Community

AJA Video Systems has joined the RAVENNA community, a network of partners devoted to advancing the RAVENNA standard for distributing real-time audio over intern...

02/12/2025

Report: ATSC 3.0 Would Boost Wireless Efficiency, Sustainability

HUNT VALLEY, Md. Sinclair and its wholly-owned subsidiary One Media Technologies have released a new report focused on how ATSC 3.0, the IP-based NextGen TV sta...

02/12/2025

FCC Issues a Reminder on Audio Description Rule Deadlines

WASHINGTON The Federal Communications Commission's Media Bureau has issued a reminder that stations in DMAs 111 through 120 must implement its audio descrip...

02/12/2025

ATSC Members Elect 4 to Board of Directors

WASHINGTON Members of the Advanced Television Systems Committee have elected four industry veterans to three-year terms on the organization's board of direc...

02/12/2025

Survey: Younger Gen Z Consumers Spend 5.1 Hours a Day on Social Media

A new survey from S&P Global Market Intelligence Kagan highlights how important social media is for younger consumers, with Gen Z spending 5.1 hours a day on so...

02/12/2025

Faculty Notes: Fall/Winter 2025

Faculty Notes: Fall/Winter 2025 Recent accomplishments, releases, and events by Berklee faculty. December 1, 2025 By Editorial Staff The cast of Kind of M...

02/12/2025

Ring In The Holidays With Our Biggest Sale Ever On Ivory II Pianos!

Ring In The Holidays With Our Biggest Sale Ever On Ivory II Pianos!From now until December 31st, you can save 50% or more on every Ivory II piano and collection...

02/12/2025

Made in America: How Stranger Things' Electrified the US Economy

Back to All News Made in America: How Stranger Things' Electrified the US Economy Entertainment 02 December 2025 GlobalUnited States Link copied to cl...

02/12/2025

International organizations align at International AI Standards Summit

-- The International Electrotechnical Commission (IEC), the International Organization for Standardization (ISO), and the International Telecommunication Unio...

02/12/2025

Harmonic Powers Telia's Next-Generation Broadband Upgrade in Norway

Harmonic's cOS Platform Will Redefine Subscribers' Quality of Experience, Lowering Churn SAN JOSE, Calif. - Dec. 2, 2025 - Harmonic (NASDAQ: HLIT) today...

02/12/2025

NVIDIA and AWS Expand Full-Stack Partnership, Providing the Secure, High-Performance Compute Platform Vital for Future Innovation

At AWS re:Invent, NVIDIA and Amazon Web Services expanded their strategic collab...

02/12/2025

All I want for Christmas is movies: RT unwraps hours of Festive films

S an Nollaig Hollywood blockbusters The Banshees of Inisherin, Barbie and Oppenheimer make their Irish TV debut Tune into the classics such as Love Actual...

02/12/2025

RT and Fs ireann/Screen Ireland unveil four new Storyland dramas for 2025

Showcasing fresh Irish storytelling and emerging talent Storyland 2025 signals a fantastic time for Irish drama RT and F s ireann/Screen Ireland are proud to...

01/12/2025

L3Harris and PentenAmio Formalise Agreement to Advance Key Management and Secure Communications Technology

L3Harris and PentenAmio formalise their teaming agreement at MilCIS 2025, streng...

01/12/2025

Artemis II: A Mission of Veterans, Firsts and Lunar Dreams

Artemis II is NASA's first crewed flight test of the Space Launch System rocket and Orion spacecraft. The crew, from left: Commander Reid Wiseman, Pilot Vic...

01/12/2025

Wooden Camera Releases Accessory Collection for Canon EOS C50

IRVINE, Calif. Wooden Camera has introduced its new Accessory Collection for the Canon EOS C50. The new lineup includes a low-profile, gimbal-ready cage, expand...

01/12/2025

FCC to Vote on LPTV Rules at December Public Meeting

WASHINGTON The Federal Communications Commission has released a tentative agenda for its Dec. 18 Open Commission Meeting that will include a vote on a report an...

01/12/2025

2026 Local TV Ad Forecasts Offer Growth and Uncertainties

In most years, a graph of annual local TV ad spending is about as predictable as an electrocardiogram of a reasonably healthy patient in a doctor's office. ...