Sony Pixel Power calrec Sony

Demystifying AI-Assisted Artistry With Adobe Apps Using NVIDIA RTX

24/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

Adobe Creative Cloud applications, which tap NVIDIA RTX GPUs, are designed to enhance the creativity of users, empowering them to work faster and focus on their craft.

These tools seamlessly integrate into existing creator workflows, enabling greater productivity and delivering power and precision.

Look to the Light Generative AI creates new data in forms such as images or text by learning from existing data. It effectively visualizes and generates content to match what a user describes and helps open up fresh avenues for creativity.

Adobe Firefly is Adobe's family of creative generative AI models that offer new ways to ideate and create while assisting creative workflows using generative AI. They're designed to be safe for commercial use and were trained, using NVIDIA GPUs, on licensed content, like Adobe Stock Images, and public domain content where copyright has expired.

Firefly features are integrated in Adobe's most popular creative apps.

Adobe Photoshop features the Generative Fill tool, which uses simple description prompts to easily add content from images. With the latest Reference Image feature currently in beta, users can also upload a sample image to get image results closer to their desired output.

Use Generative Fill to add content and Reference Image to refine it. Generative Expand allows artists to extend the border of their image with the Crop tool, filling in bigger canvases with new content that automatically blends in with the existing image.

Bigger canvas? Not a problem. RTX-accelerated Neural Filters, such as Photo Restoration, enable complex adjustments such as colorizing black-and-white photos and performing style transfers using AI. The Smart Portrait filter, which allows non-destructive editing with filters, is based on work from NVIDIA Research.

The brand-new Generative Shape Fill (beta) in Adobe Illustrator, powered by the latest Adobe Firefly Vector Model, allows users to accelerate design workflows by quickly filling shapes with detail and color in their own styles. With Generative Shape Fill, designers can easily match the style and color of their own artwork to create a wide variety of editable and scalable vector graphic options.

Generative AI. Adobe Illustrator's Generative Recolor feature lets creators type in a text prompt to explore custom color palettes and themes for their vector artwork in seconds.

Color us impressed. NVIDIA will continue working with Adobe to support advanced generative AI models, with a focus on deep integration into the apps the world's leading creators use.

Making Moves on Video Adobe Premiere Pro is one of the most popular and powerful video editing solutions.

Its Enhance Speech tool, accelerated by RTX, uses AI to remove unwanted noise and improve the quality of dialogue clips so they sound professionally recorded. It's up to 4.5x faster on RTX PCs.

Adobe Premiere Pro's AI-powered Enhance Speech tool removes unwanted noise and improves dialogue quality. Auto Reframe, another Adobe Premiere feature, uses GPU acceleration to identify and track the most relevant elements in a video, and intelligently reframes video content for different aspect ratios. Scene Edit Detection automatically finds the original edit points in a video, a necessary step before the video editing stage begins.

Visual Effects Separating a foreground object from a background is a crucial step in many visual effects and compositing workflows.

Adobe After Effects has a new feature that uses a matte to isolate an object, enabling capabilities including background replacement and the selective application of effects to the foreground.

Using the Roto Brush tool, artists can draw strokes on representative areas of the foreground and background elements. After Effects uses that information to create a segmentation boundary between the foreground and background elements, delivering cleaner cutouts with fewer clicks.

Creating 3D Product Shots The Substance 3D Collection is Adobe's solution for 3D material authoring, texturing and rendering, enabling users to rapidly create stunningly photorealistic 3D content, including models, materials and lighting.

Visualizing products and designs in the context of a space is compelling, but it can be time-consuming to find the right environment for the objects to live in. Substance 3D Stager's Generative Background feature, powered by Adobe Firefly, solves this issue by letting artists quickly explore generated backgrounds to composite 3D models.

Once an environment is selected, Stager can automatically match the perspective and lighting to the generated background.

Material Authoring With AI Adobe Substance 3D Sampler, also part of the Substance 3D Collection, is designed to transform images of surfaces and objects into photorealistic physically based rendering (PBR) materials, 3D models and high-dynamic range environment lights. With the recent introduction of new generative workflows powered by Adobe Firefly, Sampler is making it easier than ever for artists to explore variations when creating materials for everything from product visualization projects to the latest AAA games.

Sampler's Text-to-Texture feature allows users to generate tiled images from detailed text prompts. These generated images can then be edited and transformed into photorealistic PBR materials using the machine learning-powered Image-to-Material feature or any Sampler filter.

Image-to-Texture similarly enables the creation of tiled textures from reference images, providing an alternate way to prompt and generate variations from existing visual content.

Adobe 3D Sampler's Image-to-Texture
LINK: https://blogs.nvidia.com/blog/ai-decoded-adobe-firefly-creative-cloud-...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

18/08/2026

Dot Group to show how cutting carbon cuts cost - live at...

At Stand 14.A57, the data company will demonstrate GreenDot and IBM Aspera together, giving media and entertainment businesses real-time visibility of what thei...

18/08/2026

Blue Lucy launches Connected Value Audit

New tool provides a robust audit of operational workflows, calculating the tangible value each delivers today, and informing business decisions for tomorrow. W...

18/08/2026

Media Utilities transitions to Media Utilities - a DigiNe...

Media Utilities is integrating its activities into DigiNet and will maintain a recognisable presence in the market under the name: Media Utilities, a DigiNet br...

18/08/2026

Appear demonstrates broadcast-grade REMI production over...

Proof of Concept validates reliable multi-camera live production from remote racecourses without fixed network infrastructure Appear ASA (Appear, OSE:APR), a g...

18/08/2026

Stingr brings frictionless second-screen interaction to I...

Stingr, a new venture from the founders of Hornets Tech, is bringing its second-screen interaction platform to IBC2026. The second screen has never really wor...

18/08/2026

Hiltron to Promote its Latest Generation Satellite Commun...

Long-established satellite equipment manufacturer and systems integrator Hiltron Communications will promote its new HACUX-IDU2 antenna control unit touchscreen...

18/08/2026

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System Brie Clayton August 17, 2026 0 Comments Integrated platform melds media asset management, pla...

18/08/2026

The United Stand Scales Live Fan Show with Blackmagic Design Workflow

The United Stand Scales Live Fan Show with Blackmagic Design Workflow Brie Clayton August 17, 2026 0 Comments ATEM Constellation 8K and HyperDeck Stud...

18/08/2026

Twin Cities PBS to Become Minnesota PBS

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

MPA, ByteDance Reach AI Copyright Protection Deal

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

DirecTV to Launch Curated Multiview for Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Sinclair Taps Carol Kellum to Head Nebraska Stations

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Corridor Television Pays $27,000 for Violations of FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Triveni Digital Accelerates TV 3 0 Transition in Brazil W...

Triveni Digital Now Offers a Joint Solution With MediaKind and a Lab System Bundle Supporting ISDB-Tb and TV 3.0 Broadcast Services Triveni Digital, a trusted ...

18/08/2026

BeckTV Debuts BeckFlow at IBC and Showcases Expertise for...

At IBC2026, BeckTV, a premier systems integrator for the broadcast industry, will introduce BeckFlow to the European market. BeckFlow is the first web-based sch...

18/08/2026

PTZOptics Launches Rise 4K Bringing Ultra HD Quality and...

New flagship PTZ camera combines cinematic 4K imaging, professional broadcast connectivity and the complete Horizon intelligent video experience for productions...

18/08/2026

VisualOn IBC Show Preview - AI-Powered CAE Advanced Playb...

At IBC2026, VisualOn will demonstrate how video service providers can slash bandwidth costs, maximize ad revenue, and deploy premium interactive features withou...

18/08/2026

Paying It Forward: Greg Tabor on Giving Back to the Next Generation

The relationships built during graduate school often continue to shape careers long after a degree is earned, creating a community of scientists who learn from ...

18/08/2026

Stunning Irish performances at European Athletics and Swimming Championships reach almost 1.7 million viewers

Stunning Irish performances at European Athletics and Swimming Championships rea...

18/08/2026

An Irish Atlantic Rainforest: The Story of a West Cork Rainforest on the edges of the Beara Peninsula

The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player ...

17/08/2026

Thank You Mr. Brown: Documentary on Steadicam, Skycam Inventor Garrett Brown Is in the Works

Producer William Forbes and director Andrew Schwartz detail the decade-long effo...

17/08/2026

SHIK open S32 pre-orders

New MIDI processor & macro controller revealed SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...

17/08/2026

Melbourne Instruments introduce 10-year motor warranty

Cover extended on innovative motorised pot system Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...

17/08/2026

1010music update the Bluebox

Latest firmware version now available 1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...

17/08/2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry Days 2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform

Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...

17/08/2026

PTZOptics To Unveil Rise 4K Broadcast PTZ Camera At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV With NEP Platform

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform Advancing Sc...

Continuing its virtualisation strategy, Calrec has integrated its ImPulseV virtualised DSP software with NEP Platform, bringing its scalable audio processing ca...

17/08/2026

Mediaproxy debuts AI-powered monitoring - browser based m...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will highlight major innovations in compliance monitorin...

17/08/2026

FilmLight Showcases Workflow Automation, Advanced Media Collaboration, and Baselight v8 Preview at IBC 2026

Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...

17/08/2026

Arqiva x IBC 2026 - Simplify Complexity and Unlock Greater Value

Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification. ...

16/08/2026

Gospel Musicians release Gospel Drums

Virtual drummer joins line-up The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...

15/08/2026

JH Audio expand Universal-Fit range

In-ear monitoring line-up gains new universal models In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...

15/08/2026

Press Release: NFVF Releases PESP6 Project 1, Stream1: Group 2, Stream 2 and Stream 3 Funding Approvals

14 August 2026 | Johannesburg - The National Film and Video Foundation (NFVF), a...

15/08/2026

FCC Broadband Report Shows Rapid Expansion of High-Speed Internet

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Adte and Haystack News Partner on CTV Ads in Runup to Midterms

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

IBC 2026: Dalet to Demo AI-Orchestrated Live Sports Workflows

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Add rounded corners to mask in After Effects

Add rounded corners to mask in After Effects Graham Quince August 14, 2026 0 Comments Ever wished you could smoothly round the corners of a Mask Path ...

15/08/2026

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K Brie Clayton August 14, 2026 0 Comments Anamorphic cinematography and color gradi...

14/08/2026

AT&T Returns as Sponsor of Fifth-Annual DirtFish Women in Motorsport Summit

AT&T returns as a sponsor of the DirtFish Women in Motorsport (WiM) Summit, which marks its fifth year Aug. 21-22 in Snoqualmie, WA. This year's event will ...

14/08/2026

Perfect Game Blends Broadcast Polish with Social Swagger as All-American Classic Makes Move to Citizens Bank Park

A six-camera flypack production will anchor Sunday's game while Perfect Game...

14/08/2026

UJAM introduce Virtual Drummer Neon

Latest instalment delivers disco-inspired grooves The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...

14/08/2026

Yorkville launch the EL24S

Elite range gains giant 24-inch powered sub The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...

14/08/2026

Call for the 20th South African Film & Television Awards (SAFTAs20) Overall Judging Chairpersons Nominations

The National Film and Video Foundation (NFVF), an agency of the Department of Ar...

14/08/2026

LiveU, Panasonic LUMIX Launch 'Live Anywhere' Production Workflow

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

PBS Station Takes Iron Mountain to Court Over Archives

Share Copy link Facebook X Linkedin Bluesky Email...