Sony Pixel Power calrec Sony

Demystifying AI-Assisted Artistry With Adobe Apps Using NVIDIA RTX

24/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Adobe Creative Cloud applications, which tap NVIDIA RTX GPUs, are designed to enhance the creativity of users, empowering them to work faster and focus on their craft.

These tools seamlessly integrate into existing creator workflows, enabling greater productivity and delivering power and precision.

Look to the Light Generative AI creates new data in forms such as images or text by learning from existing data. It effectively visualizes and generates content to match what a user describes and helps open up fresh avenues for creativity.

Adobe Firefly is Adobe's family of creative generative AI models that offer new ways to ideate and create while assisting creative workflows using generative AI. They're designed to be safe for commercial use and were trained, using NVIDIA GPUs, on licensed content, like Adobe Stock Images, and public domain content where copyright has expired.

Firefly features are integrated in Adobe's most popular creative apps.

Adobe Photoshop features the Generative Fill tool, which uses simple description prompts to easily add content from images. With the latest Reference Image feature currently in beta, users can also upload a sample image to get image results closer to their desired output.

Use Generative Fill to add content and Reference Image to refine it. Generative Expand allows artists to extend the border of their image with the Crop tool, filling in bigger canvases with new content that automatically blends in with the existing image.

Bigger canvas? Not a problem. RTX-accelerated Neural Filters, such as Photo Restoration, enable complex adjustments such as colorizing black-and-white photos and performing style transfers using AI. The Smart Portrait filter, which allows non-destructive editing with filters, is based on work from NVIDIA Research.

The brand-new Generative Shape Fill (beta) in Adobe Illustrator, powered by the latest Adobe Firefly Vector Model, allows users to accelerate design workflows by quickly filling shapes with detail and color in their own styles. With Generative Shape Fill, designers can easily match the style and color of their own artwork to create a wide variety of editable and scalable vector graphic options.

Generative AI. Adobe Illustrator's Generative Recolor feature lets creators type in a text prompt to explore custom color palettes and themes for their vector artwork in seconds.

Color us impressed. NVIDIA will continue working with Adobe to support advanced generative AI models, with a focus on deep integration into the apps the world's leading creators use.

Making Moves on Video Adobe Premiere Pro is one of the most popular and powerful video editing solutions.

Its Enhance Speech tool, accelerated by RTX, uses AI to remove unwanted noise and improve the quality of dialogue clips so they sound professionally recorded. It's up to 4.5x faster on RTX PCs.

Adobe Premiere Pro's AI-powered Enhance Speech tool removes unwanted noise and improves dialogue quality. Auto Reframe, another Adobe Premiere feature, uses GPU acceleration to identify and track the most relevant elements in a video, and intelligently reframes video content for different aspect ratios. Scene Edit Detection automatically finds the original edit points in a video, a necessary step before the video editing stage begins.

Visual Effects Separating a foreground object from a background is a crucial step in many visual effects and compositing workflows.

Adobe After Effects has a new feature that uses a matte to isolate an object, enabling capabilities including background replacement and the selective application of effects to the foreground.

Using the Roto Brush tool, artists can draw strokes on representative areas of the foreground and background elements. After Effects uses that information to create a segmentation boundary between the foreground and background elements, delivering cleaner cutouts with fewer clicks.

Creating 3D Product Shots The Substance 3D Collection is Adobe's solution for 3D material authoring, texturing and rendering, enabling users to rapidly create stunningly photorealistic 3D content, including models, materials and lighting.

Visualizing products and designs in the context of a space is compelling, but it can be time-consuming to find the right environment for the objects to live in. Substance 3D Stager's Generative Background feature, powered by Adobe Firefly, solves this issue by letting artists quickly explore generated backgrounds to composite 3D models.

Once an environment is selected, Stager can automatically match the perspective and lighting to the generated background.

Material Authoring With AI Adobe Substance 3D Sampler, also part of the Substance 3D Collection, is designed to transform images of surfaces and objects into photorealistic physically based rendering (PBR) materials, 3D models and high-dynamic range environment lights. With the recent introduction of new generative workflows powered by Adobe Firefly, Sampler is making it easier than ever for artists to explore variations when creating materials for everything from product visualization projects to the latest AAA games.

Sampler's Text-to-Texture feature allows users to generate tiled images from detailed text prompts. These generated images can then be edited and transformed into photorealistic PBR materials using the machine learning-powered Image-to-Material feature or any Sampler filter.

Image-to-Texture similarly enables the creation of tiled textures from reference images, providing an alternate way to prompt and generate variations from existing visual content.

Adobe 3D Sampler's Image-to-Texture
LINK: https://blogs.nvidia.com/blog/ai-decoded-adobe-firefly-creative-cloud-...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

08/10/2026

Life Safety, Part 2: From Noise to Nice: The Evolution of Speech Intelligibility in Stadium Sound

Modern venues have come a long way since the tinny, echoing audio of the mid 20t...

08/10/2026

ESPN's First Super Bowl Adds Disney+ to U.S. Distribution Mix

ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...

08/10/2026

SVG Students To Watch: Addison McGhee, Auburn University

From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments The future of live sports produ...

08/10/2026

Prime Video to Become Exclusive Global Home of Emmy Awards Beginning in 2027

The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...

08/10/2026

Techex to Demonstrate Hybrid Satellite and IP Delivery Platform at NAB Show New York

Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...

08/10/2026

X Games Appoints Steve Rogers as Chief Operating Officer

X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...

08/10/2026

Fonn Group Appoints Trevor Spielmann as Sales Director, DACH

Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...

08/10/2026

Perfect Game Introduces New Studio Show on the Road With Launch of PG Central

The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms Perfect Game is bringin...

08/10/2026

Uplynk White Paper: The IP Convergence Framework for Distribution

Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...

08/10/2026

Gravity Media Op-Ed: Gravity Media's Next Act - From Service Provider to Strategic Content Partner

For decades, the production and broadcast services business has run on a familia...

08/10/2026

Uplynk, Zixi, BroadView Software, and Grass Valley Publish Satellite-to-IP Distribution Framework

Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...

08/10/2026

NFL Announces Ninth Annual Big Data Bowl Powered by AWS

The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...

08/10/2026

Eutelsat Renews Partnership with Tldiffusion dAlgrie on EUTELSAT 7 West A

Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...

08/10/2026

Disney+ to Stream Super Bowl LXI on February 14, 2027

Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...

08/10/2026

RHStv to Stream Clemson vs. Coastal Carolina Baseball at Myrtle Beach Fall Showdown

RHStv and Red House Streaming have announced an expansion of their partnership w...

08/10/2026

Gray Media to Simulcast 15 Timberwolves Games Free Over-the-Air in Minnesota and Wisconsin

Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...

08/10/2026

SMPTE Media Technology Summit Returns to Pasadena Nov. 16-19; Get 10% Off With SVG Promo Code

SVG readers can save 10% on registration and receive a complimentary Solutions H...

08/10/2026

PROTON Camera Innovations Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...

08/10/2026

Silver Lining: Sharing Tales From the Trenches of Cloud-Based Production with NBC Sports, MLB, NHL, and Warner Bros. Discovery

Industry leaders discuss real-world cloud workflows for live game production, pl...

08/10/2026

Dolby Atmos Coming to Formula 1 on Apple TV Beginning with 2026 U.S. Grand Prix

The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...

08/10/2026

Free Leonard Peltier Proves That the Fight for Justice Is Just Beginning

David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...

08/10/2026

Sound Particles update Energy Panner 2 & Brightness Panner 2

Dynamic panning plug-ins get an upgrade Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...

08/10/2026

The DMNO ON from UDO Audio

New expandable instrument boasts full DMNO engine UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...

08/10/2026

ADAM Audio introduce the Sub8 PRO & Sub10 PRO

Two new subwoofers added to monitoring line-up ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2026

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

08/10/2026

NAB New York 2026 Preview

Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October. Cal...

08/10/2026

ESPN Unveils First Studio W Refresh

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Pay-TV Operators Ask FCC to Pause TV Station Ownership Cap Rules

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Calrec Brings New Consoles, Software to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Mediagenix Bows AI Content-Aware Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Unveil UHK-X700VN Camera at NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ed McGivern Joins USSI Global as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Globecast Brings Media Orchestration and C-Band Transitio...

Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2...

Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...

08/10/2026

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Creative Executives

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...

08/10/2026

NAB Show New York Returns to Javits

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

FCC to Vote on Restrictions for Device Testing, Spectrum for D2D and Drones

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

World First' as DTM Deploys Riedel Private 5G for On-Track Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

LiveU Cranks Up Connectivity Across Tour de France

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Introduce New UHK-X700VN Camera at NAB New Yor...

Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...

08/10/2026

Calrec gives broadcasters freedom of choice at NAB Show...

Calrec will be located at Booth 444. Freedom to choose The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...

08/10/2026

LiveU LU900Q with LIQ Brings Unprecedented Connectivity t...

LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...

08/10/2026

Disney+ to Stream Super Bowl LXI Live

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Formula 1 U.S. Grand Prix to Be Carried in Dolby Atmos, Dolby Vision on Apple TV

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall to Bring Newest PTZ and POV Cameras to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall Electronics to Showcase Award-winning Camera Sol...

Marshall Electronics, a globally recognized provider of high-performance video solutions for broadcast, streaming, AV and professional production, will exhibit ...

08/10/2026

UKTV acquires first two series of new Maigret for U and U&DRAMA in deal with Banijay Rights

14-hour package also includes A Remarkable Place to Die season 2 as well as libr...