Sony Pixel Power calrec Sony

What Is a Pretrained AI Model?

08/12/2022

Imagine trying to teach a toddler what a unicorn is. A good place to start might be by showing the child images of the creature and describing its unique features.

Now imagine trying to teach an artificially intelligent machine what a unicorn is. Where would one even begin?

Pretrained AI models offer a solution.

A pretrained AI model is a deep learning model - an expression of a brain-like neural algorithm that finds patterns or makes predictions based on data - that's trained on large datasets to accomplish a specific task. It can be used as is or further fine-tuned to fit an application's specific needs.

Why Are Pretrained AI Models Used? Instead of building an AI model from scratch, developers can use pretrained models and customize them to meet their requirements.

To build an AI application, developers first need an AI model that can accomplish a particular task, whether that's identifying a mythical horse, detecting a safety hazard for an autonomous vehicle or diagnosing a cancer based on medical imaging. That model needs a lot of representative data to learn from.

This learning process entails going through several layers of incoming data and emphasizing goals-relevant characteristics at each layer.

To create a model that can recognize a unicorn, for example, one might first feed it images of unicorns, horses, cats, tigers and other animals. This is the incoming data.

Then, layers of representative data traits are constructed, beginning with the simple - like lines and colors - and advancing to complex structural features. These characteristics are assigned varying degrees of relevance by calculating probabilities.

As opposed to a cat or tiger, for example, the more like a horse a creature appears, the greater the likelihood that it is a unicorn. Such probabilistic values are stored at each neural network layer in the AI model, and as layers are added, its understanding of the representation improves.

To create such a model from scratch, developers require enormous datasets, often with billions of rows of data. These can be pricey and challenging to obtain, but compromising on data can lead to poor performance of the model.

Precomputed probabilistic representations - known as weights - save time, money and effort. A pretrained model is already built and trained with these weights.

Using a high-quality pretrained model with a large number of accurate representative weights leads to higher chances of success for AI deployment. Weights can be modified, and more data can be added to the model to further customize or fine-tune it.

Developers building on pretrained models can create AI applications faster, without having to worry about handling mountains of input data or computing probabilities for dense layers.

In other words, using a pretrained AI model is like getting a dress or a shirt and then tailoring it to fit your needs, rather than starting with fabric, thread and needle.

Pretrained AI models are often used for transfer learning and can be based on several model architecture types. One popular architecture type is the transformer model, a neural network that learns context and meaning by tracking relationships in sequential data.

According to Alfredo Ramos, senior vice president of platform at AI company Clarifai - a Premier partner in the NVIDIA Inception program for startups - pretrained models can cut AI application development time by up to a year and lead to cost savings of hundreds of thousands of dollars.

How Are Pretrained Models Advancing AI? Since pretrained models simplify and quicken AI development, many developers and companies use them to accelerate various AI use cases.

Top areas in which pretrained models are advancing AI include:

Natural language processing. Pretrained models are used for translation, chatbots and other natural language processing applications. Large language models, often based on the transformer model architecture, are an extension of pretrained models. One example of a pretrained LLM is NVIDIA NeMo Megatron, one of the world's largest AI models.

Speech AI. Pretrained models can help speech AI applications plug and play across different languages. Use cases include call center automation, AI assistants and voice-recognition technologies.

Computer vision. Like in the unicorn example above, pretrained models can help AI quickly recognize creatures - or objects, places and people. In this way, pretrained models accelerate computer vision, giving applications human-like vision capabilities across sports, smart cities and more.

Healthcare. For healthcare applications, pretrained AI models like MegaMolBART - part of the NVIDIA BioNeMo service and framework - can understand the language of chemistry and learn the relationships between atoms in real-world molecules, giving the scientific community a powerful tool for faster drug discovery.

Cybersecurity. Pretrained models provide a starting point to implement AI-based cybersecurity solutions and extend the capabilities of human security analysts to detect threats faster. Examples include digital fingerprinting of humans and machines, and detection of anomalies, sensitive information and phishing.

Art and creative workflows. Bolstering the recent wave of AI art, pretrained models can help accelerate creative workflows through tools like GauGAN and NVIDIA Canvas.

Pretrained AI models can be applied across industries beyond these, as their customization and fine-tuning can lead to infinite possibilities for use cases.

Where to Find Pretrained AI Models Companies like Google, Meta, Microsoft and NVIDIA are inventing cutting-edge model architectures and frameworks to build AI models.

These are sometimes released on model hubs or as open source, enabling developers to fine-tune pretrained AI models, improve their accuracy and expand model repositories.

NVIDIA NGC
LINK: https://blogs.nvidia.com/blog/2022/12/08/what-is-a-pretrained-ai-model...
See more stories from nvidia

Most recent headlines

01/05/2023

Predicting 2023: Simon shares his thoughts with AAM

Our Chief Executive Simon Redlich was recently invited by Alliance for Audited Media (AAM) to share his views on what 2023 might hold. Read what Simon and other...

31/01/2023

Spotify Reports Fourth Quarter 2022 Earnings

Today, Spotify announced our fourth quarter 2022 financial performance. Click here to review the full earnings release, and take a look at the highlights below:...

31/01/2023

Spotify rapporterar intkter fr fjrde kvartalet 2022

Idag publicerar Spotify sina finansiella resultat f r fj rde kvartalet 2022. Klicka h r f r att ta del av hela den finansiella pressreleasen och kolla in h jdpu...

31/01/2023

Get To Know a New Side of Dr. Harleen Quinzel in DC's Harley Quinn and The Joker: Sound Mind' Podcast

-- -- How did everyone's favorite DC bad girl Harley Quinn get, well, bad...

31/01/2023

Spotify's Artists To Watch Are Primed To Make Moves in 2023

It's always exciting when artists enter the realm of bonafide stardom and bring new sounds and ideas to the music world. And it's even more exciting to ...

31/01/2023

L3Harris included in 2023 Bloomberg Gender-Equality Index

L3Harris will be included in the 2023 Bloomberg Gender Equality Index (GEI), a modified capitalization-weighted index that tracks the performance of public comp...

31/01/2023

All Quiet on the Western Front graded and finished in DaVinci Resolve

All Quiet on the Western Front graded and finished in DaVinci Resolve Brie Clayton January 31, 2023 0 Comments Based on the book of the same name by Er...

31/01/2023

Astrophotography Nebula Fly-through, Part 2

Astrophotography Nebula Fly-through, Part 2 Graham Quince January 31, 2023 0 Comments Take a trip through space, flying past stars to observe amazing n...

31/01/2023

Mediapro to open two new virtual production studios in Spain

The company will invest 3.5 million in the Barcelona production centre, which will feature a 500 m2 studio and 235 m2 of LED paneling By Jenny Priestley Pub...

31/01/2023

ARRI, Rotolight settle patent lawsuits

ARRI no longer contests the validity of Rotolight's patents over its special effects CineSFX patent portfolio in the US, UK and Europe By Jenny Priestley ...

31/01/2023

Meet the head of business development

Accedos Abdul Haleem describes the media tech industry as a roller-coaster ride of ups and downs, and urges everyone to be curious By Jenny Priestley Publish...

31/01/2023

U.S. Digital Commerce Topped $1T for First Time

RESTON, Va. Comscore is reporting that U.S. online retail sales hit a record-breaking milestone in 2022, with digital commerce exceeding $1 trillion in online r...

31/01/2023

Frontier Launches 5 Gig Fiber Internet Service

NORWALK, Conn. Frontier has announced that it has rolled out a 5 Gig internet offering across its entire network, making it the first major ISP to deliver a net...

31/01/2023

Hulu, Fox Ink New Streaming Content Deal

LOS ANGELES Fox Entertainment and Hulu have signed a new multi-year content deal and an extensive multi-platform strategic marketing alliance that will keep Fox...

31/01/2023

Celebration Honors WRAL TechWire Past, Present and Future

A celebration for the 20th Anniversary of WRAL TechWire took place in the WRAL Media Buildings at CBC's Corporate Headquarters in Raleigh on Thursday, Janua...

31/01/2023

Student Spotlight: Cindy Latin

Student Spotlight: Cindy Latin The Berklee NYC songwriter talks about her journey from musical theater to writing songs, getting inspired by the Big Apple, an...

31/01/2023

VEON's Scheme becomes effective

Amsterdam, Netherlands, 31 January 2023 12:30 CET: VEON Ltd. (NASDAQ, Euronext Amsterdam: VEON), a global digital operator that provides converged connectivity ...

31/01/2023

Medical Student Helps New Parents Through Technology

When Benazir Mamytova, a fourth-year medical student in Kazakhstan's Astana, told her parents that she wanted to try her hand at entrepreneurship and IT, th...

31/01/2023

Dolby Is Optimistic About HDR Growth as Fox Sports Preps for HDR Super Bowl Coverage

Dolby Is Optimistic About HDR Growth as Fox Sports Preps for HDR Super Bowl Cove...

31/01/2023

CBS Sports Digital Boosts Studio-Production Ops With Revamped Facilities in Ft. Lauderdale, Stamford

CBS Sports Digital Boosts Studio-Production Ops With Revamped Facilities in Ft. ...

31/01/2023

Habitat XR creates immersive experiences at the new Ellen DeGeneres Campus with Mistika VR

Published On: January 31st, 2023 data-orig-src=https://www.sgo.es/wp-content/u...

31/01/2023

All the New Mobile Games on Netflix in January

Back to All News All the New Mobile Games on Netflix in January Netflix Staff Entertainment 31 January 2023 Global Ubisoft's Valiant Hearts: Coming H...

31/01/2023

eOne to Adapt The Twyford Code

BACKeOne to Adapt The Twyford CodeEntertainment One (eOne) has acquired the rights to Janice Hallett's bestselling novel The Twyford Code. Marking the fi...

31/01/2023

Dalet Enables Business Transformation of Italian Premier Football League

Dalet, a leading technology and service provider for media-rich organizations, and Italian partners EI Towers and CVE announced that the Lega Serie A Lissone-ba...

31/01/2023

Banijay's Mastiff TV Denmark Bolsters its Executive Team

Banijay today announces Mastiff TV Denmark, part of Banijay Nordic, has appointed Cornelius Moulvad as COO and Louise Runge Erichsen as Head of Reality, with bo...

31/01/2023

WATCH: The River - Tonight's teaser E257 S5

WATCH: The River - Tonight's teaser E257 S5Watch tonight's episode of The River and catch the latest episode every weekday at 20:00 on 1 Magic, don'...

31/01/2023

WATCH: 7de Laan - Tonight's teaser E24 S24

WATCH: 7de Laan - Tonight's teaser E24 S24Don't miss out on what's happening on tonight's episode of 7de Laan and Catch the latest episode every...

31/01/2023

WATCH: Diep City - Tonight's teaser E217 S2

WATCH: Diep City - Tonight's teaser E217 S2We've got you covered on what's happening tonight. Episodes of Diep City air on Mzansi Magic from Mondays...

31/01/2023

SKEEM SAAM: Tonight's episode, 31 January 2023 [VIDEO]

SKEEM SAAM: Tonight's episode, 31 January 2023 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch all the latest episodes of Skeem Saam soapie right ...

31/01/2023

Ben Affleck to star in new Michael Jordan documentary AIR

Ben Affleck to star in new Michael Jordan documentary AIR Ben Affleck to portray Nike founder Phil Knight in new film Air , a drama tracing the origins Michae...

31/01/2023

Bridgerton' bombshell: Phoebe Dynevor not returning for season 3

Bridgerton' bombshell: Phoebe Dynevor not returning for season 3Phoebe Dynevor, who played Daphe Bridgerton on Netflix's hit series Bridgerton' wil...

31/01/2023

The search for Miss Drag South Africa 2023 has begun

The search for Miss Drag South Africa 2023 has begunEntries are now open for Miss Drag South Africa 2023, a national queer pageant that espouses the ethos of d...

31/01/2023

RIP: Vusi Ma R5's last moments before getting shot

RIP: Vusi Ma R5's last moments before getting shot I don't know how I'm going to heal from what I saw', says DJ Cooper, who is Itumeleng Mosoeu ...

31/01/2023

Kenya to lay murder charge over killing of LGBTQ activist

Kenya to lay murder charge over killing of LGBTQ activistKenyan prosecutors said they will charge a key suspect with murder over the killing of a prominent LGBT...

31/01/2023

Johnstone: Former All Black rugby player comes out as gay

Johnstone: Former All Black rugby player comes out as gayFormer All Black prop Johnstone says he's decided to come out to help remove the stigma of being ga...

31/01/2023

Comedian Celeste Ntuli bags new show We start 2023 Stronger'

Comedian Celeste Ntuli bags new show We start 2023 Stronger'Popular actress and comedian Celeste Ntuli is host of Mzansi's new financial TV show We st...

31/01/2023

Grammy Awards 2023: Harry Styles and Lizzo set to rock the stage

Grammy Awards 2023: Harry Styles and Lizzo set to rock the stageThe 2023 Grammy Awards is taking place this Sunday and the first round of performers include Har...

31/01/2023

Real Housewives of Durban' S3 LIVE BLOG: All you need to know

Real Housewives of Durban' S3 LIVE BLOG: All you need to knowFollow our LIVE BLOG updates of Real Housewives of Durban' season three while the drama un...

31/01/2023

Real Housewives of Durban': Three bombshells from season two

Real Housewives of Durban': Three bombshells from season twoFrom Annie and LaConco to Jojo throwing a drink at Mabusi, here's three bombshells from Rea...

31/01/2023

Millionaire sportscaster': Robert Marawa's net worth and career

Millionaire sportscaster': Robert Marawa's net worth and careerFrom his show Marawa Sports Worldwide' to his book Gqimm Shelele' and more, her...

31/01/2023

WATCH: Scandal - Tonight's teaser E218 S14

WATCH: Scandal - Tonight's teaser E218 S14Get to know what's happening on tonight's episode!. Scandal episodes airs on e.tv Mondays to Fridays at 19...

31/01/2023

WATCH: Skeem Saam - Tonight's teaser E152 S11

WATCH: Skeem Saam - Tonight's teaser E152 S11Find out what's going on tonight on Skeem Saam!. Skeem Saam episodes airs on SABC1 Mondays to Fridays at 18...

31/01/2023

WATCH: Uzalo - Tonight's teaser E238 S8

WATCH: Uzalo - Tonight's teaser E238 S8Don't get left behind, catch up on Uzalo now! Episodes of Uzalo air on SABC1 from Mondays to Fridays at 20h30. b...

31/01/2023

WATCH: Muvhango - Tonight's teaser E541 S22

WATCH: Muvhango - Tonight's teaser E541 S22Don't miss out on the latest drama in Muvhango! Muvhango episodes airs on SABC2 from Mondays to Fridays at 21...

31/01/2023

WATCH: House of Zwide - Tonight's teaser E142 S2

WATCH: House of Zwide - Tonight's teaser E142 S2Don't miss out on what's happening on tonight's episode of House of Zwide and Catch the latest e...

31/01/2023

WATCH: Imbewu - The Seed, tonight's teaser E208 S5

WATCH: Imbewu - The Seed, tonight's teaser E208 S5Catch up on what's going on to night on Imbewu. Episodes of Imbewu air on e.tv from Mondays to Fridays...

31/01/2023

WATCH: Gomora - Tonight's teaser E202 S3

WATCH: Gomora - Tonight's teaser E202 S3Don't miss out on what's happening on tonight's episode of Gomora, and watch the latest episode every we...

31/01/2023

Pamela, A love story: Overturns stereotypes about victims of abuse

Pamela, A love story: Overturns stereotypes about victims of abusePamela Anderson's Netflix documentary offers one of the greatest lessons, what a victim-su...