Sony Pixel Power calrec Sony

What Is a Pretrained AI Model?

08/12/2022

Imagine trying to teach a toddler what a unicorn is. A good place to start might be by showing the child images of the creature and describing its unique features.

Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?

Pretrained AI models offer a solution.

A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.

Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.

To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.

This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.

To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.

Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.

As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.

To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.

Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.

Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.

Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.

In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.

Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.

According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.

How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.

Top areas in which pretrained models are advancing AI include:

Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.

Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.

Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.

Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.

Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.

Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.

Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.

Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.

These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.

NVIDIA NGC
LINK: https://blogs.nvidia.com/blog/2022/12/08/what-is-a-pretrained-ai-model...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

13/07/2026

BravesVision GM Jeff Cravens on Launching MLB's Newest Team-Owned Network in 35 Days

The Braves opted to keep production in-house rather than hand it off to MLB...

13/07/2026

Behind The Mic: Adam Schefter Signs Multi-Year Extension with ESPN

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

13/07/2026

Eurovision Sport and European Athletics Bring Live Athletics to More Fans with Multilingual AI Commentary Initiative

Eurovision Sport is making live athletics more accessible to fans than ever befo...

13/07/2026

Milwaukee Bucks Return to Full-Season Over-the-Air Television for First Time in 31 Years

The Milwaukee Bucks will return to full-season over-the-air television for the 2...

13/07/2026

SMPTE Expands Education Offerings with Connected Learning Path for IP Media Workflows

SMPTE has announced an expanded education pathway for media technology professio...

13/07/2026

Vizrt Graphics Power Netflix MVP MMA Event at Intuit Dome

Vizrt has announced that its graphics technology was used by broadcast design agency Girraphic for Netflix's debut MVP MMA event, broadcast live from the In...

13/07/2026

ARRI To Sell Global Rental Business to H2 Equity Partners in Management Buyout

ARRI has announced an agreement to sell its global rental activities in Europe, the United Kingdom, and North America to H2 Equity Partners through a management...

13/07/2026

DAZN and Premier Boxing Champions Announce Global Broadcasting Partnership

DAZN has announced a partnership with Premier Boxing Champions (PBC) to bring PBC fight nights to DAZN subscribers globally. The partnership begins Saturday, Ju...

13/07/2026

TikTok and WSC Sports Partner To Connect Sports Rightsholders With Content Creators

TikTok and WSC Sports have announced a strategic partnership that gives sports r...

13/07/2026

Ross Video Powers MLB All-Star In-Venue Production for Seventh Consecutive Year

Two new Ross products -Brushback: Full Count and CapGo - are debuting at Citizens Bank Park All-Star festivities...

13/07/2026

MSG Networks Jackie Lyons on Knicks Title Run Coverage, XR Studio Launch, and RSN Production Strategy

MSG Networks' was given exclusive access during the Knicks' unforgettabl...

13/07/2026

Sundance Institute Announces 2026 Producers Labs Fellows

LOS ANGELES, July 13, 2026 - Sundance Institute today announced the 10 producers selected to participate in its annual Producers Labs taking place July 13-18 fo...

13/07/2026

Techivation release M-Compressor 2

Adds new intelligent Mix Assistant feature With their product range now featuring numerous processors across two distinct line-ups, the M-Series and T-Serie...

13/07/2026

Avalanche Tones release Chainsaw Suite

Plug-ins for heavy music Avalanche Tones is the brainchild of Ava Toton, a 17-year-old musician and developer who says her goal is to make the lives of gui...

13/07/2026

Gamechanger Audio launch the Plus Pedal II

Popular sustain effect overhauled Latvia-based innovators Gamechanger Audio have just launched a new and improved version of their popular sustainer unit. B...

13/07/2026

Millions tuned in for quarter-finals of the FIFA World Cup 2026 on SBS

Millions tuned in for quarter-finals of the FIFA World Cup 2026 on SBS 13 July, 2026 Media releases Norway v England attracted a Total TV reach of 3.7 mil...

13/07/2026

SMPTE Expands Free IP for Media Training Resources

Share Copy link Facebook X Linkedin Bluesky Email...

13/07/2026

Composer Andy Dollerson Transforms Independent Film Sound...

Composer and Producer Andy Dollerson has built a career by blending his electroacoustic training with hands on production work for independent artists and filmm...

13/07/2026

SipRadius-maintained libRIST enables full RIST support in...

The next release of the widely used video player VLC 3.0.24 will incorporate full support for RIST, including main profile and some support for advanced profile...

13/07/2026

ARRI Divests Rental Business

Share Copy link Facebook X Linkedin Bluesky Email...

13/07/2026

Sound Reinforcement for a Live TV Casting Show_An Invisib...

Providing sound reinforcement for a live televised casting show ranks among the most demanding tasks in event technology: the house sound and the broadcast feed...

13/07/2026

Savannah Bananas chooses Calrec to expand broadcast ambit...

Committed to its fans first guiding principle, the genre-defying Savannah Bananas baseball team has placed Calrec at the heart of its growing broadcast story. A...

13/07/2026

Intinor Showcases SMPTE ST 2110 Advancements and DVB comp...

At IBC2026, Intinor will demonstrate its latest developments and present a practical path for broadcasters transitioning to IP workflows. The showcase focuses o...

13/07/2026

Scripps, DirecTV End Blackout, Ink New Retrans Deal

Share Copy link Facebook X Linkedin Bluesky Email...

13/07/2026

20 Years On the Pitch Together

Celebrating Two Decades of ICG and League Football Education This year marks 20 years of working with League Football Education (LFE) the charity responsible ...

13/07/2026

Silver for Arvato Systems at the 2026 Service Provider Award

Silver for Arvato Systems at the 2026 Service Provider Award Award in the AI as a Service Provider category recognizes AI expertise and innovative strength ...

13/07/2026

RT News Appoints Joe Mag Raollaigh as new Managing Editor of Nuacht

RT News is pleased to announce the appointment of Joe Mag Raollaigh as the new Managing Editor of Nuacht, the Irish Language News and Current Affairs service a...

12/07/2026

Korg NTS-4: DIY analogue performance mixer

Offers six-channels and built-in effects Korg's latest release introduces a new analogue mixer that's been designed to act as a hub for live electro...

12/07/2026

COW Jobs: Video Production Specialist, Indie Game - Remote

COW Jobs: Video Production Specialist, Indie Game - Remote Brie Clayton July 12, 2026 0 Comments Video Production Specialist (Indie Game) May 29, 20...

11/07/2026

Night Nurse Is for the Sickos

(L-R) Bruce McKenzie, Mimi Rogers, Cemre Paksoy, Georgia Bernstein, El onore Hendricks, and Colleen Rose Trundy attend the Night Nurse premiere during the 202...

11/07/2026

Handcrafted Mallets from Handcrafted Audio

Promises a vividness and depth rarely found in software Switzerland-based Handcrafted Audio's latest creation is an interesting hybrid instrument that...

11/07/2026

NAB Launches Redesigned Spot Center

Share Copy link Facebook X Linkedin Bluesky Email...

11/07/2026

Fujifilm Introduces Cinema Power Zoom for GFX System

Share Copy link Facebook X Linkedin Bluesky Email...

11/07/2026

NEP Inks New Agreement with Wimbledon

Share Copy link Facebook X Linkedin Bluesky Email...

11/07/2026

Rincon Secures Major Milwaukee Bucks Broadcast Rights Deal

Share Copy link Facebook X Linkedin Bluesky Email...

11/07/2026

Boston Conservatory at Berklee Awards Grants to Five Alumni, Supporting Work in Their Local Communities

Boston Conservatory at Berklee Awards Grants to Five Alumni, Supporting Work in ...

11/07/2026

Berklee Alumni and Faculty Recognized with 2026 Emmy Nominations

Berklee Alumni and Faculty Recognized with 2026 Emmy Nominations The 27 nominees include Trey Parker (South Park) and seven-time Emmy winner Pablo Mungu a of ...

10/07/2026

SVG GameDay, Ep. 23: Nashville Predators Teri Johnson - Throwing a Bash on Broadway

In-venue and creative video staffers at the professional and collegiate level ha...

10/07/2026

Fujifilm Announces FUJINON GF19-35mmT3.5 PZ OIS WR Cinema Power Zoom Lens

FUJIFILM North America Corporation has announced the FUJINON GF19-35mmT3.5 PZ OIS WR, a cinema power zoom lens for the GFX System with native G Mount. The lens ...

10/07/2026

Dalet Releases Long-Term Supported Update to Dalet Flex

Dalet has announced a new Long-Term Supported (LTS) release of Dalet Flex, expanding AI capabilities, workflow automation, and integration with Dalia, Dalet'...

10/07/2026

Blackmagic Design Releases Fairlight Live Audio Mixer Software

Blackmagic Design has released Fairlight Live, a free software-based broadcast audio mixer for Mac and Windows, available for download now. Simultaneously, the ...

10/07/2026

FloSports and USA South Athletic Conference Announce Exclusive Media Rights Partnership

FloSports and the USA South Athletic Conference have announced an exclusive medi...

10/07/2026

Daktronics Installs LED Video Board at Field of Dreams Ballpark in Dyersville, Iowa

Daktronics has manufactured and installed an LED video display at Field of Dream...

10/07/2026

Registration Opens for NAB Show New York 2026, October 21-22 at the Javits Center

Registration is now open for NAB Show New York 2026, taking place October 21-22 ...

10/07/2026

Sphere and Formula 1 Heineken Las Vegas Grand Prix Announce Five-Year Partnership Extension

Sphere Entertainment Co. and the Formula 1 Heineken Las Vegas Grand Prix have an...

10/07/2026

CBS Sports and Asian Football Confederation Announce U.S. Media Rights Agreement

CBS Sports and the Asian Football Confederation (AFC) have announced a media rights partnership covering the AFC Asian Cup Saudi Arabia 2027 and the AFC U23 Asi...