Foundry's Nuke adds Machine Learning

The ML toolsets applications include upres, removing motion blur, tracker marker removal, beauty work, and garbage matting

By Jenny Priestley

Published: March 18, 2021

The ML toolset's applications include upres, removing motion blur, tracker marker removal, beauty work, and garbage matting

target=_blank title=Share on LinkedIn class=share-linkedin> The ML toolset's applications include upres, removing motion blur, tracker marker removal, beauty work, and garbage matting

https://www.tvbeurope.com/production-post/foundrys-nuke-adds-machine-learning title=Share via Email class=share-email>

Creative software developer Foundry has added a machine learning (ML) toolset to the latest iteration of its node-based compositor, Nuke.

Developed by Foundry's Artificial Intelligence research team, the ML toolset's applications include upres, removing motion blur, tracker marker removal, beauty work, garbage matting, and more.

The toolset's key components include:

CopyCat creates an effect on a small number of frames in a sequence and trains a network to replicate the effect. The shot-specific approach enables the creation of high-quality, bespoke models relatively quickly within Nuke without custom training environments, complex network permissions, or sending data to the cloud.

Inference runs the neural networks produced by CopyCat, applying the model to the image sequence or another sequence.

Upscale and Deblur two new tools for common compositing tasks developed using the ML methodology behind CopyCat and open-source MLServer. The ML networks for these nodes can be refined using CopyCat to create high-quality shots or studio-specific versions in addition to their primary use for resizing footage and removing motion blur.

Nuke 13.0 also includes the introduction of Hydra support within Nuke's 3D viewport, offering a higher quality image much closer to Scanline Renderer's output, enabling users to work closer to their final image.

Speaking about the latest release, Christy Anzelmo, senior director of Product, Foundry, said: Nuke 13.0 combines what we've learned from studios over the last year by introducing new technologies that expand what's possible within Nuke while maintaining the creative workflows and technical control that artists love. With the new machine learning toolset, we are putting the power of machine learning directly into the hands of artists as they can now create bespoke tools to enable them to stay creative, while also addressing the most common VFX challenges for creating high-quality shots.

SubscribeFor more stories like this, and to keep up to date with all our market leading news, features and analysis, sign up to our newsletter here.

LINK:	https://www.tvbeurope.com/production-post/foundrys-nuke-adds-machine-l...
	See more stories from tvb

Most recent headlines