Sony Pixel Power calrec Sony

Demystifying AI-Assisted Artistry With Adobe Apps Using NVIDIA RTX

24/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Adobe Creative Cloud applications, which tap NVIDIA RTX GPUs, are designed to enhance the creativity of users, empowering them to work faster and focus on their craft.

These tools seamlessly integrate into existing creator workflows, enabling greater productivity and delivering power and precision.

Look to the Light Generative AI creates new data in forms such as images or text by learning from existing data. It effectively visualizes and generates content to match what a user describes and helps open up fresh avenues for creativity.

Adobe Firefly is Adobe's family of creative generative AI models that offer new ways to ideate and create while assisting creative workflows using generative AI. They're designed to be safe for commercial use and were trained, using NVIDIA GPUs, on licensed content, like Adobe Stock Images, and public domain content where copyright has expired.

Firefly features are integrated in Adobe's most popular creative apps.

Adobe Photoshop features the Generative Fill tool, which uses simple description prompts to easily add content from images. With the latest Reference Image feature currently in beta, users can also upload a sample image to get image results closer to their desired output.

Use Generative Fill to add content and Reference Image to refine it. Generative Expand allows artists to extend the border of their image with the Crop tool, filling in bigger canvases with new content that automatically blends in with the existing image.

Bigger canvas? Not a problem. RTX-accelerated Neural Filters, such as Photo Restoration, enable complex adjustments such as colorizing black-and-white photos and performing style transfers using AI. The Smart Portrait filter, which allows non-destructive editing with filters, is based on work from NVIDIA Research.

The brand-new Generative Shape Fill (beta) in Adobe Illustrator, powered by the latest Adobe Firefly Vector Model, allows users to accelerate design workflows by quickly filling shapes with detail and color in their own styles. With Generative Shape Fill, designers can easily match the style and color of their own artwork to create a wide variety of editable and scalable vector graphic options.

Generative AI. Adobe Illustrator's Generative Recolor feature lets creators type in a text prompt to explore custom color palettes and themes for their vector artwork in seconds.

Color us impressed. NVIDIA will continue working with Adobe to support advanced generative AI models, with a focus on deep integration into the apps the world's leading creators use.

Making Moves on Video Adobe Premiere Pro is one of the most popular and powerful video editing solutions.

Its Enhance Speech tool, accelerated by RTX, uses AI to remove unwanted noise and improve the quality of dialogue clips so they sound professionally recorded. It's up to 4.5x faster on RTX PCs.

Adobe Premiere Pro's AI-powered Enhance Speech tool removes unwanted noise and improves dialogue quality. Auto Reframe, another Adobe Premiere feature, uses GPU acceleration to identify and track the most relevant elements in a video, and intelligently reframes video content for different aspect ratios. Scene Edit Detection automatically finds the original edit points in a video, a necessary step before the video editing stage begins.

Visual Effects Separating a foreground object from a background is a crucial step in many visual effects and compositing workflows.

Adobe After Effects has a new feature that uses a matte to isolate an object, enabling capabilities including background replacement and the selective application of effects to the foreground.

Using the Roto Brush tool, artists can draw strokes on representative areas of the foreground and background elements. After Effects uses that information to create a segmentation boundary between the foreground and background elements, delivering cleaner cutouts with fewer clicks.

Creating 3D Product Shots The Substance 3D Collection is Adobe's solution for 3D material authoring, texturing and rendering, enabling users to rapidly create stunningly photorealistic 3D content, including models, materials and lighting.

Visualizing products and designs in the context of a space is compelling, but it can be time-consuming to find the right environment for the objects to live in. Substance 3D Stager's Generative Background feature, powered by Adobe Firefly, solves this issue by letting artists quickly explore generated backgrounds to composite 3D models.

Once an environment is selected, Stager can automatically match the perspective and lighting to the generated background.

Material Authoring With AI Adobe Substance 3D Sampler, also part of the Substance 3D Collection, is designed to transform images of surfaces and objects into photorealistic physically based rendering (PBR) materials, 3D models and high-dynamic range environment lights. With the recent introduction of new generative workflows powered by Adobe Firefly, Sampler is making it easier than ever for artists to explore variations when creating materials for everything from product visualization projects to the latest AAA games.

Sampler's Text-to-Texture feature allows users to generate tiled images from detailed text prompts. These generated images can then be edited and transformed into photorealistic PBR materials using the machine learning-powered Image-to-Material feature or any Sampler filter.

Image-to-Texture similarly enables the creation of tiled textures from reference images, providing an alternate way to prompt and generate variations from existing visual content.

Adobe 3D Sampler's Image-to-Texture
LINK: https://blogs.nvidia.com/blog/ai-decoded-adobe-firefly-creative-cloud-...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

20/08/2026

MS Now to Launch $7.99 DTC Service

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

Nielsen Details Improvements to Audience Measurement Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

Study: 174 Billion Illegal Streams During FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

Prasad Opens New 8K/4K Film Preservation & Restoration Center

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

IPC Expands Brazilian Presence with New Channel Partner C...

IPC Expands Brazilian Presence with New Channel Partner CCATech Industry veterans Carlos Abrah o and Bruno Lopes strengthen local support and expand IPCs prese...

20/08/2026

Zixi Enters Mauritius Market Through Strategic Deployment...

Zixi Enters Mauritius Market Through Strategic Deployment with MTC Jockey Club Worlds Oldest Horse Racing Club in the Southern Hemisphere Selects Zixis Softwar...

20/08/2026

Scripps Research scientist to receive $2.76 million NIAID New Innovators Award

LA JOLLA, CA-Scripps Research assistant professor Tiantian Liu has received a five-year NIAID DP2 award from the National Institute of Allergy and Infectious Di...

20/08/2026

Audiences reveal appetite for multicultural Australia on-screen

Audiences reveal appetite for multicultural Australia on-screen 20 August 2026 Dr Georgie McClean, Dr Rebecca Huntley (L-R) By Dr Georgie McClean and Dr Rebec...

20/08/2026

How Mavis Studio Is Expanding Live Production Teaching at Sussex

How Mavis Studio Is Expanding Live Production Teaching at Sussex Brie Clayton August 19, 2026 0 Comments Hero image displays a student about to mix be...

20/08/2026

Vertical Unscripted Series Legal Queens Captured with Blackmagic Design

Vertical Unscripted Series Legal Queens Captured with Blackmagic Design Brie Clayton August 19, 2026 0 Comments Reality TV veteran Eric Gardner create...

19/08/2026

Imagine Communications Steve Reynolds on Kaseya Centers Hybrid IP Build and the Growth of ST 2110

As the cost of IP nears price parity with traditional SDI, Reynolds argues that ...

19/08/2026

European Athletics Championships 2026: BBC, Event Organizers Bring Birmingham Action to Viewers in Style

A private 5G bubble was chosen instead of traditional broadcast RF for the race ...

19/08/2026

Filipiana Sets the Class Divide on a Golf Course in the Philippines

(L-R) Rafael Manuel and Isabel Sicat attend the Filipi ana premiere during the 2026 Sundance Film Festival at The Ray Theatre on January 23, 2026, in Park Cit...

19/08/2026

MPG launch Save Our Studios survey

Studio owners invited to have their say on rates cuts The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...

19/08/2026

Harrison unveil the Flex-10

Vintage-inspired desktop interface revealed Harrison's latest hardware offering sees them head into the world of audio interfaces, delivering a 10-in/12...

19/08/2026

Minimal Audio release Lucid

Granular effect remains locked to scale and tempo Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...

19/08/2026

Audio Modeling open PolySWAM pre-orders

First polyphonic SWAM instrument incoming Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...

19/08/2026

FOX and NBCUniversal Score with FIFA World Cup 2026 Success in Nielsen's June Gauge Reports

World Cup Games Generate 84 Billion Minutes Across FOX, Fox Sports 1 and NBCU...

19/08/2026

The Gauge: Poland | July 2026

July brought typical peak-holiday drops in viewership, driven primarily by viewers stepping away from screens and a visible decline in reach across both traditi...

19/08/2026

Carr Calls ABC Suit 'Meritless

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Henry Alexander Joins BCE as Sales Director

Henry joins BCE as the company accelerates its commercial strategy and expands its international presence across the media, broadcast and technology markets. He...

19/08/2026

iWedia Announces Advanced Android DRAM Optimisation Proce...

iWedia, a leading provider of software solutions for connected TV devices, today announced a major milestone in Android platform optimization with the successfu...

19/08/2026

NTP Technology announces ST 2110-30-RAVENNA 128-channel A...

NTP Technology announces that ST 2110-30 audio-over-IP connectivity with AES67 and RAVENNA capabilities is now available for the brand's world-class audio i...

19/08/2026

ORF goes full IP with Net Insight in nationwide network o...

Net Insight has been selected to provide its Nimbra platform by the service provider Big Blue Marble, formerly ORS Group, as the core media transport solution f...

19/08/2026

Coventry City Trophy Parade Extends LiveU LIQ Beyond the...

LiveU has supported Coventry City FC and several other top-flight UK football clubs through one of their most demanding live production challenges of the year, ...

19/08/2026

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF Brie Clayton August 18, 2026 0 Comments Filming endangered turtles required camera...

19/08/2026

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control Basic

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control ...

19/08/2026

ABC Files First Amendment Lawsuit Against FCC

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nielsen: Fox and NBCUniversal Score with FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

ESPN Co-Founder Bill Rasmussen Dies At 93

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Study: NBA Ad Revenue Hit $2.1 Billion Last Season

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nexstar's WNCN Donates ENG Van for Training

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Riedel Brings Professional Live Production Into the Class...

Riedel Communications today announced that Edith Cowan University (ECU) in Perth, Australia, implemented a comprehensive communications infrastructure that brin...

19/08/2026

QuickLink Showcases New 4K Capabilities Across StudioEdge...

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, will spotlight a major leap forward in remote guest con...

19/08/2026

EMAM together with PlayBox Neo and SNEWS launch combined...

Integrated platform melds media asset management, playout automation and newsroom workflows EMAM, PlayBox Neo and SNEWS have officially launched Nuvex, a conne...

19/08/2026

Screen Australia releases the Private Investment Toolkit to strengthen screen industry financing pathways

Screen Australia releases the Private Investment Toolkit to strengthen screen in...

19/08/2026

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdre Brennan

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdr...

19/08/2026

U&alibi re-commissions Bookish for Christmas Special and Series 3

There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...

19/08/2026

Sky gives sports fans the chance to watch multiple live sports events simultaneously on the big screen for the first time

Wednesday 19 August 2026 Sky gives sports fans the chance to watch multiple liv...

19/08/2026

RT TO AIR HISTORIC KATIE TAYLOR FIGHT IN CROKE PARK

On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...

18/08/2026

SportStream 2026 Virtual Event Set for September 15-17

SportStream 2026, a free three-day virtual event, will take place September 15-17. One registration provides access to all three days of live programming and on...

18/08/2026

IBC 2026: BeckTV to Debut BeckFlow Documentation Platform

BeckTV will introduce BeckFlow to the European market at IBC2026, demonstrated on the Providius stand (10.F53). BeckFlow is a web-based schematic documentation...

18/08/2026

IBC 2026: Boland Communications to Introduce ST 2110 Option for 4K Monitors

Boland Communications will introduce a SMPTE ST 2110 input option for its 4K monitors at IBC2026, along with a new 55-inch super-narrow bezel display for video ...

18/08/2026

Seattle Seahawks Integrate Dolby OptiView with Dolby Vision for Fan Streaming

Dolby Laboratories and the Seattle Seahawks have announced a partnership integrating Dolby OptiView into the Seahawks' live streaming coverage, making the S...

18/08/2026

Insights from BMG's Graham Taylor on the Role of a Sports Producer in Live Broadcast Production

For BMG Executive Producer of Sports Production, Graham Taylor, producing live s...

18/08/2026

TMRW Sports Names Rufus Hack as President of Golf

TMRW Sports has appointed Rufus Hack as President of Golf, a newly created role in which he will lead the company's golf businesses including TGL presented ...