Sony Pixel Power calrec Sony

What Is a Pretrained AI Model?

08/12/2022

Imagine trying to teach a toddler what a unicorn is. A good place to start might be by showing the child images of the creature and describing its unique features.

Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?

Pretrained AI models offer a solution.

A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.

Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.

To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.

This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.

To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.

Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.

As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.

To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.

Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.

Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.

Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.

In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.

Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.

According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.

How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.

Top areas in which pretrained models are advancing AI include:

Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.

Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.

Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.

Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.

Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.

Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.

Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.

Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.

These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.

NVIDIA NGC
LINK: https://blogs.nvidia.com/blog/2022/12/08/what-is-a-pretrained-ai-model...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

28/05/2026

How Thomson's Climate Crisis Toolkit is helping journalists tell the climate story

Thomsons Climate Crisis Toolkit is already being put to work, helping journalist...

28/05/2026

Matt Gangl and Pete Macheska on FOX MLB's Huge Night and Unforgettable Postseason Run

FOX Sports' MLB coverage dominated the night at the 47th Annual Sports Emmy ...

28/05/2026

FOX's Mike Davies and Team on Win as Outstanding Technical Team for 2025 World Series

One of the most memorable postseasons in baseball history would have had no memo...

28/05/2026

NBC Sports' Rob Hyland Reflects on an Unforgettable Sunday Night Football Season

NBC's Sunday Night Football is among the most-decorated and most-watched pro...

28/05/2026

Prime Video's John Ward and Mike Francis on Groundbreaking NBA on Prime Video Studio

The 2026 Sports Emmys marked a watershed moment for Prime Video Sports. After bu...

28/05/2026

18th-Annual SVG College Sports Media Awards Crown Years Best Work in Atlanta

Hosted by ESPN Senior Writer Ryan McGee, the ceremony honored winners from athletic departments, conference offices, professional networks, production companies...

28/05/2026

Networks Unveil 2026 College Football Broadcast Schedules

Major rights-holders rolled out their 2026 college football slates today, offering a first look at marquee windows, kickoff partners, and conference distributio...

28/05/2026

NHL's Steve Mayer on the Behind-the-Scenes Access of 4 Nations Face-Off: Unveiled

The 4 Nations Face-Off, an international competition that launched in February 2...

28/05/2026

ESPN's Manny de la Fe on the Gratifying Conclusion to Inaugural Season in Spanish

Soccer is a truly global sport, and, to match the U.S. viewing audience's in...

28/05/2026

CBS Sports' Graphics Team on the Vision of The NFL Today's Virtual Time Machine

The NFL Today, CBS Sports' top-of-the-line NFL studio show, has a storied hi...

28/05/2026

Prime Video's Mike Muriano on the Immediate Success of Fan Optionality Feature

Prime Video is no stranger to innovation, and, within the realm of live streamin...

28/05/2026

FOX Sports' Jamie McCombs on Showcasing MLB Atmosphere With Immersive Audio

The crack of the bat, the pop of the glove, and the cheer of the crowd: those are three prime examples of the glorious sounds fans hear on televised baseball ga...

28/05/2026

CBS Sports' Harold Bryant on Capturing the Essence of March Madness in the Studio

Every year, March Madness captivates the entire sports world. Nonstop action, un...

28/05/2026

NBC Sports' Chad Hudson on Developing Graphics for the Return of NBA on NBC

NBA on NBC was an integral part to live sports production in the 1990s, and, when the league made these media rights available, NBC Sports saw an opportunity to...

28/05/2026

MLB's Ryan Zander on the Tech Innovation Behind the League's UmpCam AR System

UmpCam is a technological wrinkle that has given fans unprecedented views of wha...

28/05/2026

T-Mobile Brings America's Best Network to the USGA

T-Mobile and the United States Golf Association (USGA) announced a multi-year partnership, making T-Mobile the Official 5G Network Partner of the U.S. Women'...

28/05/2026

Time and Water Is a Moving Portrait of Family History and a Warming Iceland

By Gina McIntyre (L-R) Sara Dosa and Andri Sn r Magnason attend the Time and Water premiere during the 2026 Sundance Film Festival at Library Center Theatre ...

28/05/2026

More Control, Faster Playlist Editing, and Other Updates for Everyday Listening on Spotify

A little refresh can go a long way. We've been making behind-the-scenes upda...

28/05/2026

Introducing the Newest Winners of Spotify's Creator Milestone Awards

Since early last year, our quarterly Creator Milestone Awards have celebrated podcasts from around the world that hit major streaming milestones on Spotify. Tod...

28/05/2026

Rapid Flow launch Omniclock

New software-based MIDI multi-clock announced Rapid Flow have just announced the launch of a new MIDI utility plug-in that aims to solve one of the most per...

28/05/2026

SSL announce the SSL 1

Company introduce most affordable interface yet SSL's range of audio interfaces has just gained its latest, and smallest member, the SSL 1. Designed to ...

28/05/2026

Deconstruct Minimal from Sonicware

New compact drum machine & sampler announced The latest instrument from Sonicware sees the company kick off an all-new Deconstruct series with a compact dru...

28/05/2026

Get fit for the FIFA World Cup 2026 with new SBS On Demand features for the ultimate viewing experience

Get fit for the FIFA World Cup 2026 with new SBS On Demand features for the ult...

28/05/2026

Hellenic Civil Aviation Authority modernizes nationwide ATC voice communications with Rohde & Schwarz CERTIUM Radios

Hellenic Civil Aviation Authority modernizes nationwide ATC voice communications...

28/05/2026

Amazon MGM Studios, AWS Launch GenAI Creators' Fund

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

AudioShake Launches Copyright Compliance System

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Big Blue Marble Advances 5G Broadcast

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Will Must-Carry Make It to NextGen TV?

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Swiss Broadcaster Canal Alpha Streamlines Playout to Deli...

Harmonic (NASDAQ: HLIT) today announced that Swiss broadcaster Canal Alpha has deployed Harmonics award-winning, software-based XOS Advanced Media Processor to ...

28/05/2026

Calrec Scales ImPulseV to Expand Choice in Virtualized Audio Workflows

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Berliner Ensemble Upgrades Backstage Infrastructure With...

Riedel Communications today announced that Berliner Ensemble, one of Berlin's five major theater companies, has expanded its backstage communications and te...

28/05/2026

Digital Alert Systems Ed Czarnecki to Speak on Advanced E...

Company's VP Government and International to Address How Broadcasters Can Operationalize Advanced Emergency Information for NextGen TV Digital Alert Syst...

28/05/2026

Radio BGM Upgrades and Futureproofs with DHD SX2 Audio Mi...

Radio BGM (https://radiobgm.org.uk/), Llanellis multiple-award-winning community and hospital radio station, has invested in a DHD SX2 audio mixing console and ...

28/05/2026

Calrec Scales ImPulseV to Empower Broadcasters with Great...

Further strengthening its virtualisation strategy to fully support broadcasters as they enter a new broadcast age, Calrec announces an expansion to its ImPulseV...

28/05/2026

NAB, MPA and NCTA Defend Current TV Ratings System

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Amazon MGM Studios, AWS Launch the GenAI Creators' Fund

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

AudioShake Launches New Copyright Compliance System

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

ITV Studios Deploys Cuez Live Production Platform

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

ACT Entertainment Introduces Green Hippo Estuary Series a...

Green Hippo, an ACT Entertainment brand, will pull back the curtain on the Estuary Series, a next-generation media control platform engineered for the scale, sp...

28/05/2026

ZEISS Introduces Panoptes 65 Cinema Lenses at Cine Gear E...

First Hands-On Opportunity at Universal Studios Lot, June 5-6 Oberkochen, Germany, May 27, 2026 ZEISS is launching their new Panoptes 65 primes at Cine Gear ...

28/05/2026

Wooden Camera Releases New Accessories for Blackmagic URS...

Irvine, CA May 20, 2026 Wooden Camera today announced the release of new accessories for the Blackmagic URSA Cine Immersive. The new lineup includes a redes...

28/05/2026

Six films, one unmissable collection. First Facts documentaries debut on 10 Streaming

Six films, one unmissable collection. First Facts documentaries debut on 10 Stre...

28/05/2026

Emma Watkins brings all-new Emma's Dance Club to ABC Kids

Emma Watkins brings all-new Emma's Dance Club to ABC Kids 28 May 2026 Emmas Dance Club. Image credit: Sarah Wilson. The ABC, Screen Australia and Screen N...

28/05/2026

Cool Concentric Text for Cavalry

Cool Concentric Text for Cavalry Simon Ubsdell May 27, 2026 0 Comments In this tutorial I'll show you how to make this popular text effect that is...

28/05/2026

Berliner Ensemble Upgrades Backstage Infrastructure With Riedel Stage Systems

Wuppertal May 28, 2026 Berliner Ensemble Upgrades Backstage Infrastructure With Riedel Stage SystemsRiedel Communications today announced that Berliner Ensemb...