Sony Pixel Power calrec Sony

Sharpening Its Edge: U.S. Postal Service Opens AI Apps on Edge Network

06/05/2021

In 2019, the U.S. Postal Service had a need to identify and track items in its torrent of more than 100 million pieces of daily mail.

A USPS AI architect had an idea. Ryan Simpson wanted to expand an image analysis system a postal team was developing into something much broader that could tackle this needle-in-a-haystack problem.

With edge AI servers strategically located at its processing centers, he believed USPS could analyze the billions of images each center generated. The resulting insights, expressed in a few key data points, could be shared quickly over the network.

The data scientist, half a dozen architects at NVIDIA and others designed the deep-learning models needed in a three-week sprint that felt like one long hackathon. The work was the genesis of the Edge Computing Infrastructure Program (ECIP, pronounced EE-sip), a distributed edge AI system that's up and running on the NVIDIA EGX platform at USPS today.

An AI Platform at the Edge It turns out edge AI is a kind of stage for many great performances. ECIP is already running a second app that acts like automated eyes, tracking items for a variety of business needs.

Cameras mounted on the sorting machines capture addresses, barcodes and other data such as hazardous materials symbols. Courtesy of U.S. Postal Service. It used to take eight or 10 people several days to track down items, now it takes one or two people a couple hours, said Todd Schimmel, the manager who oversees USPS systems including ECIP, which uses NVIDIA-Certified edge servers from Hewlett-Packard Enterprise.

Another analysis was even more telling. It said a computer vision task that would have required two weeks on a network of servers with 800 CPUs can now get done in 20 minutes on the four NVIDIA V100 Tensor Core GPUs in one of the HPE Apollo 6500 servers.

Today, each edge server processes 20 terabytes of images a day from more than 1,000 mail processing machines. Open source software from NVIDIA, the Triton Inference Server, acts as the digital mailperson, delivering the AI models each of the 195 systems need - when and how they need it.

Next App for the Edge USPS put out a request for what could be the next app for ECIP, one that uses optical character recognition (OCR) to streamline its imaging workflow.

In the past, we would have bought new hardware, software - a whole infrastructure for OCR; or if we used a public cloud service, we'd have to get images to the cloud, which takes a lot of bandwidth and has significant costs when you're talking about approximately a billion images, said Schimmel.

Today, the new OCR use case will live as a deep learning model in a container on ECIP managed by Kubernetes and served by Triton.

The same systems software smoothed the initial deployment of ECIP in the early weeks of the pandemic. Operators rolled out containers to get the first systems running as others were being delivered, updating them as the full network of nearly nodes was installed.

AI algorithms were developed on NVIDIA DGX servers at a U.S. Postal Service Engineering facility. Courtesy of NVIDIA. The deployment was very streamlined, Schimmel said. We awarded the contract in September 2019, started deploying systems in February 2020 and finished most of the hardware by August - the USPS was very happy with that, he added.

Triton Expedites Model Deliveries Part of the software magic dust under ECIP's hood, Triton automates the delivery of different AI models to different systems that may have different versions of GPUs and CPUs supporting different deep-learning frameworks. That saves a lot of time for edge AI systems like the ECIP network of almost 200 distributed servers.

The app that checks for mail items alone requires coordinating the work of more than a half dozen deep-learning models, each checking for specific features. And operators expect to enhance the app with more models enabling more features in the future.

The models we have deployed so far help manage the mail and the Postal Service - it helps us maintain our mission, Schimmel said.

A Pipeline of Edge AI Apps So far, departments across USPS from enterprise analytics to finance and marketing have spawned ideas for as many as 30 applications for ECIP. Schimmel hopes to get a few of them up and running this year.

One would automatically check if a package carries the right postage for its size, weight and destination. Another one would automatically decipher a damaged barcode and could be online as soon as this summer.

The USPS runs AI inference on HPE Apollo 6500 servers, each equipped with four NVIDIA V100 GPUs. Photo courtesy HPE. This has a benefit for us and our customers, letting us know where a specific parcel is at - it's not a silver bullet, but it will fill a gap and boost our performance, he said.

The work is part of a broader effort at USPS to explore its digital footprint and unlock the value of its data in ways that benefit customers.

We're at the very beginning of our journey with edge AI. Every day, people in our organization are thinking of new ways to apply machine learning to new facets of robotics, data processing and image handling, he said.

Learn more about the benefits of edge computing and the NVIDIA EGX platform, as well as how NVIDIA's edge AI solutions are transforming every industry.

Pictured at top: Postal Service employees perform spot checks to ensure packages are properly handled and sorted. Courtesy of U.S. Postal Service.
LINK: https://blogs.nvidia.com/blog/2021/05/06/edge-ai-usps/...
See more stories from nvidia

North America Stories

28/03/2024

Future-Proofing the B-52

L3Harris is upgrading critical electronic warfare systems to ensure the iconic aircrafts spectrum superiority for decades to come....

28/03/2024

Supporting the RCAF for more than 25 Years with L3Harris' WESCAM MX-Series

L3Harris' WESCAM MX-Series EO/IR systems have supported the RCAF for more than 25 years....

28/03/2024

ENCO to Add AI News Anchor to Qimera Virtual Production Set

NOVI, Mich. During the 2024 NAB Show, ENCO will be showcasing an AI-driven virtual anchor delivering live news from a realistic 3D virtual news set....

28/03/2024

Johan de Nysschen Named President and CEO of ARRI Americas

MUNICH ARRI has announced that Johan de Nysschen has been put in charge of the ARRI Americas team as president and CEO ARRI Americas Inc....

28/03/2024

Fubo Inks Carriage Deal with YES Network

NEW YORK The YES Network and FuboTV have reached a multi-year carriage agreement that will allow Fubo to launch YES in its Pro base channel plan in time for YES...

28/03/2024

Dalet to Demo AI-Enabled Production, Automation and Monetization at NAB 2024

PARIS Dalet has announced that during its 2024 NAB showcase (booth #W1713), attendees can experience firsthand Dalet's collaborative, AI-enabled workflows t...

28/03/2024

Blackmagic Design Used on 2024 Oscar Nominated Films

Blackmagic Design Used on 2024 Oscar Nominated Films Brie Clayton March 28, 2024 0 Comments Blackmagic Design congratulates the many film professional...

28/03/2024

Arkona to Introduce BLADE//master Control and Orchestration Service at NAB 2024

Arkona to Introduce BLADE//master Control and Orchestration Service at NAB 2024 Brie Clayton March 28, 2024 0 Comments New option for BLADE//runner ke...

28/03/2024

Join Maxon for NAB 2024

Join Maxon for NAB 2024 Brie Clayton March 28, 2024 0 Comments Maxon returns to NAB with presentations by artists from around the world and demos of t...

28/03/2024

Boston Conservatory to Present Center Stage Production of A Midsummer Night's Dream at The Huntington

Boston Conservatory to Present Center Stage Production of A Midsummer Night'...

28/03/2024

2024 Big Night In Raises $145k to Support Triangle Arts Councils

Capitol Broadcasting and WRAL-TV once again proudly supported our local arts community with the broadcast of Big Night in for the Arts Thursday, March 7, 2024. ...

28/03/2024

JIC, MRC Announce Accord On Roles In Judging Measurement Companies

With more companies offering different approaches to measuring television viewing and campaign effectiveness, two of the groups that evaluate potential media bu...

28/03/2024

Hulu Added to Disney Plus App for Bundle Subscribers

The Walt Disney Co. said that it launched Hulu on Disney Plus, which makes Hulu programming available via the Disney Plus app....

28/03/2024

GroupM To Double Ad Spending On Women's Sports Programming

Giant media buyer GroupM said it plans to double its media spending on women's sports....

28/03/2024

Scripps Renews State Farm As Sponsor of Friday Night WNBA on Ion

Scripps Sports said that State Farm has signed a new multi-year agreement to continue as the title sponsor of Ion's Friday night WNBA telecasts....

28/03/2024

Elisabeth Moss, Kerry Washington Sign On for Imperfect Women' on Apple TV Plus

Elisabeth Moss and Kerry Washington will star in, and executive produce, Imperfe...

28/03/2024

Telemundo Station Group Addresses Climate Change With Month-Long Initiative

Telemundo Station Group launches the month-long climate change initiative Our Planet Thursday, March 28. The multiplatform campaign ends on Earth Day, April 22,...

28/03/2024

Circle City Broadcasting Renews Nielsen Ratings Deal

Nielsen said that Circle City Broadcasting, owner of WISH-TV in Indianapolis, has renewed its local TV measurement deal....

28/03/2024

Lionsgate Extends Deal With Seth Rogen's Point Grey Pictures

Lionsgate Television said it extended its deal with Point Grey Pictures, the production company led by Seth Rogen, Evan Goldberg and James Weaver....

28/03/2024

Ariana DeBose Back as Tonys Host

Ariana DeBose returns as host of the Tony Awards Sunday, June 16, on CBS and Paramount Plus. It is her third consecutive time hosting, and it will be the 77th T...

28/03/2024

The Steve Wilkos Show' Renewed for Season 18

The Steve Wilkos Show has been renewed for its 18th season in national syndication, Tracie Wilson, executive VP, NBCUniversal Syndication Studios & E! News, sai...

28/03/2024

Sinclair Selects Embrace as Its Media Orchestration Engine

PARIS Embrace, a developer of advanced automation and orchestration software solutions, has announced that Sinclair Broadcast Group has selected Embrace's P...

28/03/2024

Nielsen and Circle City Broadcasting Renew Local TV Measurement Deal

NEW YORK Nielsen has a multi-year renewal with Circle City Broadcasting, Indianas only locally owned and operated broadcast and digital news media network, for ...

28/03/2024

JVC to Demo Its First Ever 40x Zoom PTZ Camera Series at 2024 NAB Show

LAS VEGAS JVC Professional Video has announced that it will debut its new KY-PZ540 Series PTZ Cameras with 40x zoom at 2024 NAB Show (Booth C4720)....

28/03/2024

Brightcove Launches Cloud Playout 2.0

BOSTON Brightcove has announced the launch of Cloud Playout 2.0, a platform that the company said will offer customers new ways to create linear channels, monet...

28/03/2024

NBC Sports Chicago to Air First-Ever Animated Real-Time Local Sports Telecast

The Chicago Blackhawks and NBC Sports Chicago have announced a collaboration with the NHL to bring fans the first-ever local animated real-time sports telecast....

28/03/2024

The Best News Coverage is Real, Live, Balanced, Professional

The Best News Coverage is Real, Live, Balanced, Professional Andy Marken March 28, 2024 0 Comments Hero image source News of the World, Perfect Wo...

28/03/2024

Haivision Showcases World-Leading Live Video Contribution Ecosystem at the 2024 NAB Show

Makito X4 video encoders, Haivision Pro mobile transmitters, StreamHub receiver,...

28/03/2024

FOR-A shows production flexibility for entertainment and sports at CABSAT

Compressed and uncompressed IP solutions alongside SDI...

28/03/2024

Greater Scope: Doctors Get Inside Look at Gut Health With AI-Powered Endoscopy

From humble beginnings as a university spinoff to an acquisition by the leading global medtech company in its field, Odin Vision has been on an accelerated jour...

28/03/2024

Get Cozy With Palia' on GeForce NOW

Ease into spring with the warm, cozy vibes of Palia, coming to the cloud this GFN Thursday. It's part of six new titles joining the GeForce NOW library of ...

27/03/2024

Inside the Archives: It's Lights, Curtains, Action When Sundance Films Become Stage Productions

By Jen Scott It's time to unwrap those noisy candies and put your phone on ...

27/03/2024

Sencore and Showfer Announce Collaboration at NAB 2024, With a Brand-New Content Management and Distribution Solution

Las Vegas, NV, April 14-17, Booth W2401 Sencore, a leading provider of profess...

27/03/2024

I Am L3Harris - Sam Bonelli

I'm proud to be a woman in aerospace making an impact on our world and among my peers, team and future generations of women in STEM....

27/03/2024

Bitmovin to Show Live Encoder Running on Akamai Cloud at NAB Show

DENVER Bitmovin has launched its Live Encoder running on the Akamai Cloud Computing, optimizing live streaming and reducing total streaming costs by up to 90%, ...

27/03/2024

Hulu Launches on Disney+

BURBANK, Calif. The Walt Disney Company has officially launched Hulu on Disney+ in the U.S. in a move that brings together the extensive Disney+ and Hulu librar...

27/03/2024

WJLA Studio A Revamp Features Brightline Lighting

WASHINGTON D.C. WJLA, Sinclair Broadcast Group's flagship TV station in the nation's capital, has revamped its Studio A news studio with lighting soluti...

27/03/2024

NCAA: March Madness Sees Strong Audience Growth

The NCAA has released figures showing that the NCAA Division I Men's Basketball Championship and the Division 1 Women's Basketball Championship both saw...

27/03/2024

Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA Broadcast G2

Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA...

27/03/2024

Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second

Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second Isha Salian March 27, 2024 0 Comments The LATTE3D model rapidly transforms tex...

27/03/2024

NAB Show Exhibitor Insight Matrox Video

TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show? TVT: What will be your most important product news? TVT: Ho...

27/03/2024

CueScript Poised to Transform the Prompting Experience wi...

CueScript, the leading developer of professional teleprompting solutions, is poised to transform the prompting experience with a line-up comprised of world firs...

27/03/2024

BeckTV to Focus on Systems Integration for Sports Venues...

Visit Beck TV at 2024 NAB Show at Booth C4035 BeckTV, a premier systems integrator for the broadcast media industry, will showcase its facility design, enginee...

27/03/2024

Arkona to Introduce BLADE master Control and Orchestratio...

arkona technologies GmbH, provider of IP core infrastructure solutions for top-tier broadcast productions, is cutting through the complexity of live production ...

27/03/2024

KRK Launches ROKIT Generation Five Studio Monitors

As the unwavering cornerstone of professional audio monitoring for over three decades, KRK earned its reputation through a rich history of innovation and precis...

27/03/2024

Join Maxon for NAB 2024

Maxon, developers of professional software solutions for editors, filmmakers, motion designers, visual effects artists, and creators of all types, is excited to...

27/03/2024

OpenDrives Reinvents Media Industry Infrastructure Invest...

OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, will unveil its new Atlas platform and busi...

27/03/2024

Pixotope NAB 2024 Virtual Production Showcase Shapes the...

Pixotope, the leading software platform for end-to-end real-time virtual production solutions, is ushering in a new era of immersive storytelling at NAB 2024. A...

27/03/2024

Dolby Atmos-enabled CMP Studio Tackles Immersive Mixing W...

Like many in the industry, Multi-platinum, Award-winning Producer, Engineer, Mixer, Songwriter and Musician Clint Murphy's latest work has been consumed by ...

27/03/2024

Ateliere Creative Technologies Unveils the Future of Medi...

Ateliere Locations: AWS Partner Village W1343 F, W1343 S and Fontainebleau Hotel Contact: Arianna Ruvalcaba, Arianna.Ruvalcaba@ateliere.com Century City, Cal...