Sony Pixel Power calrec Sony

Demystifying AI-Assisted Artistry With Adobe Apps Using NVIDIA RTX

24/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Adobe Creative Cloud applications, which tap NVIDIA RTX GPUs, are designed to enhance the creativity of users, empowering them to work faster and focus on their craft.

These tools seamlessly integrate into existing creator workflows, enabling greater productivity and delivering power and precision.

Look to the Light Generative AI creates new data in forms such as images or text by learning from existing data. It effectively visualizes and generates content to match what a user describes and helps open up fresh avenues for creativity.

Adobe Firefly is Adobe's family of creative generative AI models that offer new ways to ideate and create while assisting creative workflows using generative AI. They're designed to be safe for commercial use and were trained, using NVIDIA GPUs, on licensed content, like Adobe Stock Images, and public domain content where copyright has expired.

Firefly features are integrated in Adobe's most popular creative apps.

Adobe Photoshop features the Generative Fill tool, which uses simple description prompts to easily add content from images. With the latest Reference Image feature currently in beta, users can also upload a sample image to get image results closer to their desired output.

Use Generative Fill to add content and Reference Image to refine it. Generative Expand allows artists to extend the border of their image with the Crop tool, filling in bigger canvases with new content that automatically blends in with the existing image.

Bigger canvas? Not a problem. RTX-accelerated Neural Filters, such as Photo Restoration, enable complex adjustments such as colorizing black-and-white photos and performing style transfers using AI. The Smart Portrait filter, which allows non-destructive editing with filters, is based on work from NVIDIA Research.

The brand-new Generative Shape Fill (beta) in Adobe Illustrator, powered by the latest Adobe Firefly Vector Model, allows users to accelerate design workflows by quickly filling shapes with detail and color in their own styles. With Generative Shape Fill, designers can easily match the style and color of their own artwork to create a wide variety of editable and scalable vector graphic options.

Generative AI. Adobe Illustrator's Generative Recolor feature lets creators type in a text prompt to explore custom color palettes and themes for their vector artwork in seconds.

Color us impressed. NVIDIA will continue working with Adobe to support advanced generative AI models, with a focus on deep integration into the apps the world's leading creators use.

Making Moves on Video Adobe Premiere Pro is one of the most popular and powerful video editing solutions.

Its Enhance Speech tool, accelerated by RTX, uses AI to remove unwanted noise and improve the quality of dialogue clips so they sound professionally recorded. It's up to 4.5x faster on RTX PCs.

Adobe Premiere Pro's AI-powered Enhance Speech tool removes unwanted noise and improves dialogue quality. Auto Reframe, another Adobe Premiere feature, uses GPU acceleration to identify and track the most relevant elements in a video, and intelligently reframes video content for different aspect ratios. Scene Edit Detection automatically finds the original edit points in a video, a necessary step before the video editing stage begins.

Visual Effects Separating a foreground object from a background is a crucial step in many visual effects and compositing workflows.

Adobe After Effects has a new feature that uses a matte to isolate an object, enabling capabilities including background replacement and the selective application of effects to the foreground.

Using the Roto Brush tool, artists can draw strokes on representative areas of the foreground and background elements. After Effects uses that information to create a segmentation boundary between the foreground and background elements, delivering cleaner cutouts with fewer clicks.

Creating 3D Product Shots The Substance 3D Collection is Adobe's solution for 3D material authoring, texturing and rendering, enabling users to rapidly create stunningly photorealistic 3D content, including models, materials and lighting.

Visualizing products and designs in the context of a space is compelling, but it can be time-consuming to find the right environment for the objects to live in. Substance 3D Stager's Generative Background feature, powered by Adobe Firefly, solves this issue by letting artists quickly explore generated backgrounds to composite 3D models.

Once an environment is selected, Stager can automatically match the perspective and lighting to the generated background.

Material Authoring With AI Adobe Substance 3D Sampler, also part of the Substance 3D Collection, is designed to transform images of surfaces and objects into photorealistic physically based rendering (PBR) materials, 3D models and high-dynamic range environment lights. With the recent introduction of new generative workflows powered by Adobe Firefly, Sampler is making it easier than ever for artists to explore variations when creating materials for everything from product visualization projects to the latest AAA games.

Sampler's Text-to-Texture feature allows users to generate tiled images from detailed text prompts. These generated images can then be edited and transformed into photorealistic PBR materials using the machine learning-powered Image-to-Material feature or any Sampler filter.

Image-to-Texture similarly enables the creation of tiled textures from reference images, providing an alternate way to prompt and generate variations from existing visual content.

Adobe 3D Sampler's Image-to-Texture
LINK: https://blogs.nvidia.com/blog/ai-decoded-adobe-firefly-creative-cloud-...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

11/09/2026

TV Usage Kicks Usual Summer Slowdown, Fueled by World Cup and Streaming in Nielsen's July Gauge Reports

FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...

11/09/2026

Atomos Debuts New HDR Monitors at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Lightware Launches LARA 2 with New Architecture for More...

Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...

11/09/2026

MusiMap launches latest technology unlocking new commerci...

10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...

11/09/2026

Matrox Video Integrates Matrox ORIGIN with NVIDIA Holosca...

Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...

11/09/2026

Net Insight brings cloud-native live media orchestration...

Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Biggest functionality boost yet makes Buttons the perfect...

Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

11/09/2026

Ikegami Announces Four New UNICAM XE Series Cameras

Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...

11/09/2026

DHD Launches New MX3 Consoles - Modular to the Core

DHD.audio has chosen IBC2026 as the launch venue for a major new addition to its broadcast sound production platform: the MX3 console range. MX3 retains the mod...

11/09/2026

Sony To Showcase Latest Production Technology At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

EKT To Feature New Linux-Based ATSC 3.0 STB At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Jimmy Kimmel Shifts Political Interview to YouTube Over FCC Worries

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Remembering 9/11: 25 Years of TV Tech Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Tiger Group To Auction Equipment from a National Broadcasting Studio

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Grass Valley Launches AVORA at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Survey: Low Latency for Live Streaming Is Industrys Top Challenge

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Atomos Debuts New HDR Monitors at 2026 IBC Show

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Grass Valley Launches AVORA at IBC2026 Bringing All in On...

New standalone solution gives production teams everything they need to create, produce and deliver live content from one flexible system. Grass Valley today an...

11/09/2026

Wave Central a Domo Broadcast Company Named Recipient of...

Recognition honors the development of FPV drone camera systems for live sports broadcast coverage Wave Central, a Domo Broadcast Company that develops advanced...

11/09/2026

Teradek Launches Bolt 7 A Unified Wireless System for Zer...

Teradek, the industry leader in zero-delay wireless video solutions, announced the launch of Bolt 7, which now includes a unified wireless video and data system...

11/09/2026

ACT Pixel Academy Announces Autumn Courses

The ACT Entertainment tvONE and Green Hippo Pixel Academy has released its autumn course schedule, with hands-on training dates in September, October and Novemb...

11/09/2026

Scientists discover a new way that a disease-linked protein comes apart

LA JOLLA, CA-Transthyretin amyloid disease (ATTR) is a progressive, life-threatening condition caused when the protein transthyretin (TTR) breaks apart and aggr...

11/09/2026

Major Update to Blackmagic Cloud

Major Update to Blackmagic Cloud Brie Clayton September 10, 2026 0 Comments Blackmagic Design has announced a major update to Blackmagic Cloud which a...

11/09/2026

Dalet Helps Media Organizations Navigate the Rise of Synthetic Content with NVIDIA AI

Dalet Helps Media Organizations Navigate the Rise of Synthetic Content with NVID...

11/09/2026

Get ready to experience iPhone\u00A018\u00A0Pro, the new Apple Watch lineup, and AirPods 5 - UPDATE - Posted on 11 September 2026

It's almost iPhone Pro time. Starting Saturday, September 12, at 1 p.m, cust...

11/09/2026

Agility Beyond Space and Sonema deepen their long-term partnership to strengthen resilient connectivity across Africa

Agility Beyond Space and Sonema deepen their long-term partnership to strengthen...

11/09/2026

Benetti Menswear Tees Up for 2026 Amgen Irish Open on RT

RT has today announced Benetti Menswear as the sponsor of its 2026 Amgen Irish Open coverage for a sixth consecutive year, further strengthening the heritage c...

10/09/2026

First AI-Generated Golf Announcer To Debut During New Mexico Open

Duff Foreman is an AI-generated announcer who will add color to this month's New Mexico Open...

10/09/2026

IBC 2026: Bitmovin Rolls Out Encoder Version 3

Bitmovin is rolling out Encoder Version 3, the next major release of the technology behind its VOD and Live Encoders. Version 3 is built on a premise every stre...

10/09/2026

IBC 2026: Net Insight Highlights Open Live Media for Controlled Live Services

At IBC2026, on booth 1.B47, Net Insight will showcase Open Live Media, its architecture for delivering resilient live media services across networks, partners, ...

10/09/2026

PWHL, Scripps Sports Sign National Television Deal for 2026-27 Season

The Professional Women's Hockey League (PWHL) and Scripps Sports have announced a national broadcast rights agreement for the 2026-27 season, a landmark par...

10/09/2026

IBC 2026: Trusted Partner Network Debuts Fix It or Risk It to Tackle Everyday Security Risks

The Trusted Partner Network (TPN), the global content security initiative powere...

10/09/2026

NFL Brings Back Creator Programs to Deliver Access, Original Storytelling During the 2026 Season

The NFL is launching its most expansive creator programming yet, bringing togeth...

10/09/2026

Sportsnet Removes 150 Blackouts for More National NHL Games Than Ever in 2026-2027 Season

Sportsnet is set to deliver its biggest hockey season ever with a national sched...

10/09/2026

IBC 2026: LiveU Showcases Starlink for News and Sports Broadcast as Clarus Integrated Reseller

LiveU is now a Clarus Integrated Reseller, bringing Starlink's fast, reliabl...

10/09/2026

IBC 2026: Mimir Develops Single Layer for Content, Metadata, AI Orchestration

Mimir is the cloud-native media production platform built for teams that need to move media fast across live, archive, web, social, and broadcast workflows. At ...

10/09/2026

IBC 2026: ATSC 3.0 To Receive Technology & Engineering Emmy Award for Significant Advancement in Television Broadcasting

ATSC is being honored with a 2026 Technology & Engineering Emmy Award by the Nat...

10/09/2026

Audio-Technica Presents BP880R Contact Transducer for Immersive Sports Broadcast, Production Audio Enhancement

Audio-Technica has introduced the BP880R Contact Transducer, a specialized micro...

10/09/2026

ESPN, ION Team Up to Broadcast WTGL Starting on Nov. 8

TMRW Sports in partnership with the LPGA, today announced multiyear U.S. media rights agreements with ESPN and Scripps Sports/ION to bring WTGL, the new women&#...

10/09/2026

SportsNet Pittsburgh Honors Roberto Clemente Day With Second-Annual Live Spanish-Language Pirates Telecast

SportsNet Pittsburgh (SNP) in partnership with Major League Baseball and the Pit...

10/09/2026

Tennis Channel Gives Fans Options With Premium Subscription on Roku

Tennis Channel announced today its launch as a Premium Subscription on The Roku Channel. Tennis Channel offers viewers a single home for Tennis Channel and Ten...

10/09/2026

IBC 2026: Dolby Expands Dolby OptiView Platform With New Capabilities

Dolby has announced major updates to Dolby OptiView, its live sports platform, ahead of IBC 2026. The updates include new AI-powered intelligence to better unde...

10/09/2026

Dalet Names Brian Doheny as CEO

Dalet has appointed Brian Doheny as CEO. Doheny joined Dalet as President and Chief Revenue Officer in April 2026. Since joining Dalet, Doheny has led the compa...

10/09/2026

IBC 2026: Sony Demonstrates Various Creative Solutions for Attendees at the RAI

Sony, as well as its partner company Nevion, is starting IBC 2026 with a handful of announcements for attendees to see on the show floor. Sony Announces the 4t...

10/09/2026

SoFi Stadium Solidifies Production Output With Multi-Layered Tech Renovation

The six-year-old venue is expanding capabilities for NFL action, Super Bowl LXI, 2028 Summer Olympics SoFi Stadium, as well as the surrounding area known as Ho...