Sony Pixel Power calrec Sony

Demystifying AI-Assisted Artistry With Adobe Apps Using NVIDIA RTX

24/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Adobe Creative Cloud applications, which tap NVIDIA RTX GPUs, are designed to enhance the creativity of users, empowering them to work faster and focus on their craft.

These tools seamlessly integrate into existing creator workflows, enabling greater productivity and delivering power and precision.

Look to the Light Generative AI creates new data in forms such as images or text by learning from existing data. It effectively visualizes and generates content to match what a user describes and helps open up fresh avenues for creativity.

Adobe Firefly is Adobe's family of creative generative AI models that offer new ways to ideate and create while assisting creative workflows using generative AI. They're designed to be safe for commercial use and were trained, using NVIDIA GPUs, on licensed content, like Adobe Stock Images, and public domain content where copyright has expired.

Firefly features are integrated in Adobe's most popular creative apps.

Adobe Photoshop features the Generative Fill tool, which uses simple description prompts to easily add content from images. With the latest Reference Image feature currently in beta, users can also upload a sample image to get image results closer to their desired output.

Use Generative Fill to add content and Reference Image to refine it. Generative Expand allows artists to extend the border of their image with the Crop tool, filling in bigger canvases with new content that automatically blends in with the existing image.

Bigger canvas? Not a problem. RTX-accelerated Neural Filters, such as Photo Restoration, enable complex adjustments such as colorizing black-and-white photos and performing style transfers using AI. The Smart Portrait filter, which allows non-destructive editing with filters, is based on work from NVIDIA Research.

The brand-new Generative Shape Fill (beta) in Adobe Illustrator, powered by the latest Adobe Firefly Vector Model, allows users to accelerate design workflows by quickly filling shapes with detail and color in their own styles. With Generative Shape Fill, designers can easily match the style and color of their own artwork to create a wide variety of editable and scalable vector graphic options.

Generative AI. Adobe Illustrator's Generative Recolor feature lets creators type in a text prompt to explore custom color palettes and themes for their vector artwork in seconds.

Color us impressed. NVIDIA will continue working with Adobe to support advanced generative AI models, with a focus on deep integration into the apps the world's leading creators use.

Making Moves on Video Adobe Premiere Pro is one of the most popular and powerful video editing solutions.

Its Enhance Speech tool, accelerated by RTX, uses AI to remove unwanted noise and improve the quality of dialogue clips so they sound professionally recorded. It's up to 4.5x faster on RTX PCs.

Adobe Premiere Pro's AI-powered Enhance Speech tool removes unwanted noise and improves dialogue quality. Auto Reframe, another Adobe Premiere feature, uses GPU acceleration to identify and track the most relevant elements in a video, and intelligently reframes video content for different aspect ratios. Scene Edit Detection automatically finds the original edit points in a video, a necessary step before the video editing stage begins.

Visual Effects Separating a foreground object from a background is a crucial step in many visual effects and compositing workflows.

Adobe After Effects has a new feature that uses a matte to isolate an object, enabling capabilities including background replacement and the selective application of effects to the foreground.

Using the Roto Brush tool, artists can draw strokes on representative areas of the foreground and background elements. After Effects uses that information to create a segmentation boundary between the foreground and background elements, delivering cleaner cutouts with fewer clicks.

Creating 3D Product Shots The Substance 3D Collection is Adobe's solution for 3D material authoring, texturing and rendering, enabling users to rapidly create stunningly photorealistic 3D content, including models, materials and lighting.

Visualizing products and designs in the context of a space is compelling, but it can be time-consuming to find the right environment for the objects to live in. Substance 3D Stager's Generative Background feature, powered by Adobe Firefly, solves this issue by letting artists quickly explore generated backgrounds to composite 3D models.

Once an environment is selected, Stager can automatically match the perspective and lighting to the generated background.

Material Authoring With AI Adobe Substance 3D Sampler, also part of the Substance 3D Collection, is designed to transform images of surfaces and objects into photorealistic physically based rendering (PBR) materials, 3D models and high-dynamic range environment lights. With the recent introduction of new generative workflows powered by Adobe Firefly, Sampler is making it easier than ever for artists to explore variations when creating materials for everything from product visualization projects to the latest AAA games.

Sampler's Text-to-Texture feature allows users to generate tiled images from detailed text prompts. These generated images can then be edited and transformed into photorealistic PBR materials using the machine learning-powered Image-to-Material feature or any Sampler filter.

Image-to-Texture similarly enables the creation of tiled textures from reference images, providing an alternate way to prompt and generate variations from existing visual content.

Adobe 3D Sampler's Image-to-Texture
LINK: https://blogs.nvidia.com/blog/ai-decoded-adobe-firefly-creative-cloud-...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

09/06/2026

Call for Sediba Scriptwriting Training Programme Bloemfontein, Free State

The National Film and Video Foundation (NFVF) is a statutory body mandated to spearhead the equitable growth and development of the South African film and video...

09/06/2026

BBC Casts Edward Bluemel As Poirot In Hercule,' As BritBox Boards Agatha Christie Remake In U.S.

The BBC has found its Hercule Poirot. After Deadline revealed last month that t...

09/06/2026

Nielsen launches Four-Screen Ad Deduplication measurement on YouTube campaigns in Italy

Media buyers and sellers can now compare YouTube reach from computer, mobile, an...

09/06/2026

Andrew Beaudet Joins Brompton as Head of Sales, Americas

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Mediaset Italia Deploys Mediagenix Platform To Modernize Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Mediaset Italia Modernizes Content Supply Chain and Chann...

A project aimed at modernizing scheduling operations across Mediaset's channel portfolio Mediagenix, a global leader in smart content solutions to profitab...

09/06/2026

ACT Entertainment Debuts tvONE 4RU CALICO PRO at InfoComm...

tvONE, an ACT Entertainment brand, debuts its most powerful video processor ever built: the 4RU CALICO PRO (C7-PRO-4200), at InfoComm 2026 (Booth N6813). Engine...

09/06/2026

Composer and Conductor Eric Whitacre to Receive Honorary Doctorate at Berklee Valencia's 2026 Commencement

Composer and Conductor Eric Whitacre to Receive Honorary Doctorate at Berklee Va...

09/06/2026

Comcast Advertising Adds Purchasing Data from Affinity Solutions

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Midwich to Distribute Miri Technologies in North America

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Nielsen: North American Soccer Fans Jump to More Than 136 Million

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Grass Valley and Lawo Collaborate to Advance Open Dynamic...

Technology collaboration to validate AMPP and Lawo HOME orchestration integration, showcasing Dynamic Media Facility principles in practice. Grass Valley and ...

09/06/2026

Bitmovin Player Web X Powers Axel Springer New Audio News...

Bitmovin, a leading provider of video streaming solutions, today announced that Axel Springer SE, international media and technology company, has deployed Playe...

09/06/2026

LiveU Delivers First Remote VAR Deployment Across the Pac...

LiveU, the global leader in live IP-video solutions, today announced a landmark deployment with the Oceania Football Confederation (OFC) that has brought Video ...

09/06/2026

Sam Craig Joins Grass Valley as VP, Global Pre-Sales

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Arkansas TV Will Continue to Air PBS Programming

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Glensound to Show DARK22M Network Audio Interface at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

EVS Rebrands, Trims Its Name

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

FCC Announces Tentative Agenda for June 25 Open Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

09/06/2026

Two Alumni Win Tony Awards

Two Alumni Win Tony Awards Mike Morris and Cedric Leiba Jr. won awards for Best Orchestrations and Best Play, respectively. June 8, 2026 By Tori Donahue ...

09/06/2026

Netflix Unveils First Images And Poster For Wrath, A New Brazilian Series Premiering July 29

Back to All News Netflix Unveils First Images And Poster For Wrath, A New Brazi...

09/06/2026

ENNI Will Be Using AEP.EnerS4 Billing Solution

Enni Continues to Rely on Arvato Systems - And Will Be Using AEP.EnerS4 Billing Solution Arvato Systems to implement transformation project for SAP S/4HANA Ut...

09/06/2026

RT Radio 1 is bringing Arena and Cil House to London celebrating 100 years of RT

These special programmes will highlight RT 's connection with the Irish diaspora This year, RT is marking 100 years of public broadcasting in Ireland with...

08/06/2026

SVG Sit-Down: FIFA's Oscar Sanchez and HBS's Paul King on Deploying 16 Production Teams in 16 World Cup Venues

The two execs discuss the goals and the challenges of building a huge multi-cult...

08/06/2026

SVG All-Stars: Judi Weiss, Senior Manager, Remote Operations (Studio), ESPN

This industry legend has been a road warrior since the early '90s and is, today, a lynchpin on College GameDay The sports-production industry continues to ...

08/06/2026

DAZN Extends Combat Sports Portfolio with EFC Partnership

DAZN has agreed a multi-year rights partnership with Extreme Fighting Championship (EFC), expanding its global combat sports portfolio. DAZN will broadcast EFC...

08/06/2026

Whitepaper: TVU Networks Tackles the Future of Sports Production

As fans move across broadcast, streaming, social, mobile and creator-led platforms, and they expect every angle, in real time, TVU Networks has released a new e...

08/06/2026

Infront Strengthens Diamond League Global Broadcast Network Through Spate of New Agreements

Infront has further strengthened the 2026 Diamond League's international bro...

08/06/2026

Grass Valley Appoints Sam Craig as Vice President, Global Pre-Sales

Grass Valley has announced the appointment of Sam Craig as Vice President, Global Pre-Sales. Based in the United States, Craig will lead Grass Valley's glob...

08/06/2026

SMPTE Announces Summer 2026 IP Networking and ST 2110 Course Lineup

SMPTE has announced its summer 2026 education lineup covering IP networking and SMPTE ST 2110, including two standalone courses, a 13-week boot camp, and a hand...

08/06/2026

Sportradar and Kalshi Announce Multi-Year Data and Infrastructure Partnership for Prediction Markets

Sportradar Group AG has announced a multi-year global agreement with Kalshi, a p...

08/06/2026

FIFA and Gamefam Launch FIFA World Cup 2026 Event on Roblox

FIFA and Gamefam have announced the launch of a FIFA World Cup 2026 event on Roblox, running June 5 through July 31, 2026. The event centers on FIFA Super Socce...

08/06/2026

Stanley Pup 2026: Fun Is the Goal When the Rescue-Dog Competition Returns for Year 3

A collaboration of NHL Productions, Monumental Sports, and Michael Levitt Produc...

08/06/2026

Bryce Adair, CBS Production Assistant, Dies in Car Crash at 31

CBS Sports production staffer Bryce Adair has died at the age of 31 after sustaining injuries during a car accident on Wednesday while in Ohio working the the P...

08/06/2026

Behind the Mic: Russell Wilson and Kyle Long Join CBS Sports The NFL Today

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

08/06/2026

WMT Digital Launches Sports Customer Data Platform Built to Turn Fan Intelligence into Revenue

WMT Digital today announced the launch of WMT Fan Intelligence, designed to unif...

08/06/2026

Miami Heat Ink New Deal With WPLG Local 10, Join NBAs Growing OTA Crowd

The Heat are the seventh NBA team to air their games over-the-air next season...

08/06/2026

Paramount and UFC Expand Media Rights Partnership to Canada Beginning in 2027

Paramount and UFC have announced an expansion of their media rights partnership making Paramount the exclusive home of UFC Numbered Event main cards in Canada ...

08/06/2026

Qatar Football Association Deploys Virtual Advertising Technology for First Time with Sponix

The Qatar Football Association (QFA), in cooperation with Sponix and broadcaster...

08/06/2026

Project B Appoints HBS as Official Host Broadcaster for Global Basketball Circuit

Project B has announced the appointment of Host Broadcast Services (HBS) as Offi...

08/06/2026

Ohio State's Marco Fragale on the Growth of On-Campus B1G+ Productions and StudentU

The Buckeyes now produce and stream upwards of 200 sports events annually with a...

08/06/2026

Meet the New GLOW Ambassadors Leading Spotify's Global Pride Celebration

At Spotify, our commitment to the LGBTQIA community is year-round. Through GLOW, our global music program, we celebrate and amplify the contributions of queer ...

08/06/2026

GearExpo UK: Keyboard & Synth Update

Get Hands-on With Keyboard & Synth Brands GearExpo UK wouldn't be complete without some synth action, and we've got some of the industry's most ...

08/06/2026

IK Multimedia's ARC On-Ear gains IEM support

50 popular in-ear monitoring system profiles added The latest update for IK Multimedia's headphone-correction system has just arrived, and introduces ca...

08/06/2026

Audeze announce the MM-520

Manny Marroquin signature cans upgraded with SLAM Technology The flagship model in Audeze's Manny Marroquin Signature Series has just been treated to an...

08/06/2026

Air domain supremacy redefined - New counter UAS, space solutions and directional communications from Rohde & Schwarz debut at ILA

Air domain supremacy redefined - New counter UAS, space solutions and directiona...