Sony Pixel Power calrec Sony

9 Tips for Rendering in the Google Cloud

14/06/2016

Over the last year, Google has approached the VFX community in a big way. Emboldened by the Zync purchase , the Google Cloud Platform has grown past the hurdles that made us apprehensive at first to become, in our opinion, the best solution for cloud rendering.

At PipelineFX, Qube users across the world are starting to move in this direction, which means we have been getting more questions about it - namely, how do I get started and how can I make this easier on myself?

Here are 9 tips that will help blend render farm management with GCP today.

1. Pick Your Zone

Knowing your zone can help you control how fast your data is transferred to and from the cloud, how much you pay for transfers, which equipment may be available to you, and even your environment's stability.

Your data transfers more quickly when it's closer to you just like driving your car from one spot to another. Since all cloud providers offer their resources by geographic region, you should start by looking at the region you are in or that is closest to you. Within Google regions, they offer zones, and you can select zones within a region that may be physically closer to you. The closer you can get, the faster your data will transfer and the less it will cost to complete those transfers.

And if you have to transfer data from one cloud resource to another, know that transferring between zones in a region is cheaper than going across regions.

Learn about the zones available to you as it can affect the hardware and services available to you. Certain zones have Ivy Bridge or Haswell processors where others don't. In addition, zones may have different quotas on the available services like firewalls, IPs, image storage, etc.. Last but not least, for maximum uptime, Google highly recommends having instances spread out to several zones in the same region because zone maintenance and outages should be expected.

2. Pick Your Machine Type

Different machine types can offer a varying amount of processors or RAM which may render different applications more or less efficiently. It's best to do a set of test renders of your typical work on several different types to find the sweet spot in terms of price and performance.

For scale, look at Instance Groups. You can define a template for your instance image, so adding more processors to your standard render farm image is as simple as increasing the number of instances for that template. You can even set the instances to scale up automatically as you need additional resources. Instance Groups automatically load balance between the resources in the group, and if an instance crashes, it will automatically reboot and pick up where it left off.

3. Leverage Pre-emptable Instances

If you are scheduling render jobs that can afford the possibility of being paused or stopped for a period of time then Preemptible VM instances are a great bargain, running at a much lower price. By using these instances, you can save, on average, between 3050% of the hourly cost for rendering instances. You can save quite a bit of money across one or more projects, but with some added risk since there is no guarantee that the instance will be not be preempted.

4. Preview Jobs First

Optimize your use of cloud nodes. If you are going to be paying to use off site resources, then make sure the jobs are correct before you start the meter.

If you are using our render management solution, Qube!, you can leverage our Preview Frames feature to automatically split a job into two parts: the first test renders a sample set of frames immediately and the second is the remaining frames are dispatched already blocked, waiting on user approval to continue. The Preview Frames are normally rendered locally with the remaining frames destined for the Cloud.

This way, you don't start the meter on throw away work, and as you get information about the completed preview frames (render times, memory footprint, etc ), you can better determine how many cloud instances will be required to finish the project on time.

5. Don't Keep the Meter Running

A best practice in minimizing cloud costs is to pause or stop the instances when they are not in use. It can mean the difference between a large monthly bill versus the kind of cost you were expecting.

When rendering, it's best to automate. For example, Qube! offers the use of pre- and post-flight scripts that can be run at the start and end of every job. Write a script that starts your instance to run every single time a new job is dispatched to a cloud resource, and do the same to shut them down or pause them when your job completes. Your instances will only be up for rendering, and you will not be paying for cloud resources that are sitting idle.

6. Let the Network Expert Get You Connected

Connecting your network to the Cloud requires some technical expertise that's best handled by network engineers or system administrators. It's not that it's especially difficult, it's just that it takes some time and testing. It's getting better now that Google has added a more out of the

box VPN product and there is a growing online knowledge base where users are sharing their experiences.

7. Cache is King

In any network environment, whether it's on-premise or remote or a mixture of the two, the quality of experience and overall throughput depends on the strength and speed of your available cache. It makes an even bigger difference when you are using cloud nodes.

Avere's vXFT is an extremely easy way to initiate the transfer of data in and out of the Google Cloud.

Mount the Avere cluster along your file path, and your files will start transferring without changes to your pipeline. A standard three-node cluster can serve well over 100 cloud nodes, and the proprietary algorithms insure the most used files are available as the priori
LINK: http://www.cgw.com/Press-Center/Web-Exclusives/2016/9-Tips-for-Renderi...
See more stories from cwg

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

16/06/2025

Give Me the Backstory: Get to Know Carmen Emmi, the Writer-Director of Plainclothes

By Bailey Pennick One of the most exciting things about the Sundance Film Festi...

16/06/2025

Spotify's Brian Berner on Creativity, Connection, and What's Next for Advertisers at Cannes Lions

The Cannes Lions International Festival of Creativity is officially underway for...

16/06/2025

Francophone Content on Spotify Continues to Thrive Around the World

On Spotify, francophone content continues to cross borders at an unprecedented rate. In 2024 alone, more than 123 million listeners worldwide streamed audio con...

16/06/2025

Tegna Announces Major Expansion of Local News Programming

TYSONS, Va. Tegna Inc. is embarking on a notable expansion of their already substantial local news programming by launching live and on-demand, local newscasts ...

16/06/2025

Netflix Expands Programmatic Ad Sales with Yahoo DSP

Netflix has announced that it is expanding its global programmatic ad offerings by partnering with Yahoo DSP. This will enable brands to buy Netflix advertising...

16/06/2025

Sub51 & Soundtrax announce Drop Pad 3

Instrument now boasts full NKS support Sub51 and Soundtrax have just announced the launch of an updated and improved version of their innovative sample-base...

16/06/2025

Roku, Amazon Team Up to Dominate CTV Ad Market

NEW YORK In a landmark agreement to overtake the burgeoning connected TV (CTV) advertising market, Amazon Ads and Roku today announced a new integration that gi...

16/06/2025

EdgeBeam Wireless Names Conrad Clemson CEO

ATLANTA, BALTIMORE, CINCINNATI and IRVING, Texas The four major broadcast groups behind the ATSC 3.0-based EdgeBeam Wireless datacasting joint venture today nam...

16/06/2025

Amazon MGM Studios to Deploy Avid Tools on AWS

BURLINGTON, Mass. Avid today announced an extended agreement with Amazon MGM Studios to integrate Avid's Media Composer and Avid NEXIS on Amazon Web Service...

16/06/2025

Maxon Epic Sale Drops June 16

Maxon, maker of powerful, approachable software for creators working in 2D and 3D design, motion graphics, visual effects, gaming and more, today announced the ...

16/06/2025

Alfalite launches Skypix a new ceiling-mounted Led panel...

Alfalite, the only European manufacturer of LED displays, announces the launch of SKYPIX RGBW & IM, a new series of ceiling-mounted LED panels designed specifi...

16/06/2025

ALM/Busy Circuits launch Pip Filter & LFO

Two new compact 4HP modules introduced ALM/Busy Circuits have just announced the launch of two new Eurorack modules, the Pip Filter and Pip LFO, both of whi...

16/06/2025

VEON Announces USD 35 Million Share Buyback

16 Jun 2025 VEON Announces USD 35 Million Share Buyback Announcement marks the third phase of USD 100 million share buyback program Dubai, June 16, 2025: VEON...

16/06/2025

Summer Sale: Big Discounts on Ivory II Pianos - Now Through June 30th!

Save 40% or More on All Ivory II Collections!From now through June 30th, enjoy huge savings on all Ivory II Piano Collections. Our biggest discounts ever are be...

16/06/2025

Behind The Broadcast Booth, Ep. 3: Golf. My Future. My Game. Founder and CEO Craig Kirby Talks Advocacy in Sports and More

Behind The Broadcast Booth, Ep. 3: Golf. My Future. My Game. Founder and CEO Cra...

16/06/2025

The REMI Revolution Is Here: How Remote Production Technology in Esports Pioneers a New Age of Broadcast

The REMI Revolution Is Here: How Remote Production Technology in Esports Pioneer...

16/06/2025

From Super Bowl to Indy 500, New Orleans Artist Frenchy' Captures Energy of Sports Production on Canvas

From Super Bowl to Indy 500, New Orleans Artist Frenchy' Captures Energy of...

16/06/2025

NFL Films Enhances Post Studio With Dolby Atmos Audio

NFL Films Enhances Post Studio With Dolby Atmos Audio Forty-three channels of audio enable the facility to migrate to immersive By Dan Daley, Audio Editor Mo...

16/06/2025

SVG New Sponsor Spotlight: Storj's David Colantuoni on Expanding Cloud-Based Storage to Live Sports Production

SVG New Sponsor Spotlight: Storj's David Colantuoni on Expanding Cloud-Based...

16/06/2025

Grass Valley 4K Cameras Head to Greece for View Master Events' New OB Truck

Grass Valley 4K Cameras Head to Greece for View Master Events' New OB Truck By Ken Kerschbaumer, Editorial Director Monday, June 16, 2025 - 2:33 pm Pri...

16/06/2025

WWF and Sky Kids launch Wear it Wild with Ready Eddie Go!

Monday 16 June 2025 Families and children are invited to dress up, have fun and raise money to protect nature WWF UK and Sky Kids are teaming up to launch Wea...

16/06/2025

The Rohde & Schwarz R&S M3AR radio family reaches 10,000 unit milestone, demonstrating commitment to innovation and quality

The Rohde & Schwarz R&S M3AR radio family reaches 10,000 unit milestone, demonst...

16/06/2025

FOX Advertising Launches Enhanced Brand Storytelling Program with Strategic Investment in The Lighthouse

FOX Advertising Launches Enhanced Brand Storytelling Program with Strategic Inve...

16/06/2025

Run With Ray in Cork, Waterford, Kilkenny, Drogheda and Dublin as The Ray D'Arcy Show hits the road

Run with Ray is back! RT Radio 1's The Ray D'Arcy Show hits the road th...

15/06/2025

Music Production for Women free in-person workshops

July 2025 in Dublin, Berlin, Amsterdam & London Photo: Thea Martre Music Production for Women (MPW) have announced that they will be running a series of fo...

15/06/2025

Jason's Piano & API Drums instruments from Sulcata Sound

Composer/producer launches free virtual instruments Sulcata Sound is the latest venture of Jason Graves, a two-time British Academy Award-winnning composer,...

14/06/2025

Pluto TV Adds All Womens Sports Network's FAST Channel

NEW YORK Pluto TV and the All Womens Sports Network have launched a free ad-supported streaming TV (FAST) AWSN channel in the U.S., Canada, the U.K. and the Nor...

14/06/2025

Scripps Inks Multiyear Agreement for WNBA Games on Ion

NEW YORK and CINCINNATI E.W. Scripps has announced a new, multiyear agreement with the WNBA that will continue Ions regular-season coverage of the league on Fri...

14/06/2025

NAB Highlights Hidden Importance of Spectrum in Major Sports Broadcasting

WASHINGTON The National Association of Broadcasters highlighted the hidden importance of spectrum in the production of major sporting events and described wha...

14/06/2025

1.0 Sunset, BPS and NextGen Broadcast's Potential Dominate ATSC Meeting

WASHINGTON Sunsetting ATSC 1.0, expanding business opportunities for NextGen Broadcast and increasing international adoption of the ATSC 3.0 standard were top o...

14/06/2025

Samba TV and Acxiom Announce Massive 40-market Global Expansion

SAN FRANCISCO Samba TV and Acxiom have announced that they will dramatically expand their longstanding relationship....

14/06/2025

MPW announce free in-person workshops

July 2025 in Dublin, Berlin, Amsterdam & London Photo: Thea Martre Music Production for Women (MPW) have announced that they will be running a series of fo...

14/06/2025

San Francisco State University's School of Cinema Uses Blackmagic Design

San Francisco State University's School of Cinema Uses Blackmagic Design Brie Clayton June 13, 2025 0 Comments More than 40 Blackmagic Design came...

14/06/2025

Boris FX Mocha Pro Adds New AI Tools To Tackle VFX Tasks Fast

Boris FX Mocha Pro Adds New AI Tools To Tackle VFX Tasks Fast Jessie Electa Petrov June 13, 2025 0 Comments The 2025.5 release helps artists work more...

14/06/2025

AJA Debuts DRM2-Plus Mini-Converter Frame at InfoComm 2025

AJA Debuts DRM2-Plus Mini-Converter Frame at InfoComm 2025 Brie Clayton June 13, 2025 0 Comments Next-gen frame addresses diverse rackmount needs wit...

13/06/2025

Prime Minister: A Behind-the-Scenes Look at a Leader Who Champions Kindness

(L-R) Lindsay Utz, Michelle Walshe, and The Right Honourable Dame Jacinda Ardern attend the 2025 Sundance Film Festival premiere of Prime Minister at Eccles T...

13/06/2025

Materialists' Director Celine Song Reveals the Inspirations Behind the Film's Soundtrack

Photo credit: Atsushi Nishijima If you're a true lover of rom-coms, chances...

13/06/2025

Pure Drama and Fierce Rivalries set to dominate the world's most iconic sporting event

Pure Drama and Fierce Rivalries set to dominate the world's most iconic spor...

13/06/2025

Press Release: NFVF Opens Call for Public Film Screenings on GBV Awareness as South Africa Confronts Ongoing Femicide Crisis

Johannesburg, 12 June 2025 - The National Film and Video Foundation (NFVF), an a...

13/06/2025

Central Texas Storm Knocks out KTXS Tower, Severely Damages Building

ABILENE. Texas A severe storm knocked down the tower and severely damaged the news studio and main facility of Sinclair-owned KTXS here on Sunday, June 8....

13/06/2025

Berklee's Music Business/Management Department Recognized by the Music Biz Association

Berklee's Music Business/Management Department Recognized by the Music Biz A...

13/06/2025

ATSC Honors Aldo Cugnini, Clarence Hau

WASHINGTON The ATSC, the Broadcast Standards Association, honored veteran technologist Aldo Cugnini and Clarence Hau, Senior Vice President of Standards, Policy...

13/06/2025

ESPN Doubles Down on Immersive Fan Experience for UFL Championship

(Editor's note: The 2025 UFL Championship Game between the D.C. Defenders and Michigan Panthers kicks off Saturday, June 14, at 8 p.m. Eastern. The game wil...

13/06/2025

Soulyft Audio release Chime

New iPad/iPhone synth App announced Following on from last year's release of Gradient Synth - which reached #6 on the App Store's Paid Music charts ...

13/06/2025

HBO Max Plans July Launches in 12 New Markets

LONDON Warner Bros. Discovery has announced that HBO Max will launch direct-to-consumer in multiple new countries this July as the streamer becomes available in...

13/06/2025

Verbit Launches Speaker Identification for Live ASR Broadcast Captions

AI voice transcription and captioning platform Verbit has added a new feature to its Captivate ASR solution the ability to identify specific features in automat...

13/06/2025

FCC's Anna Gomez Meets with TV Networks, Studio Execs and Unions

WASHINGTON Federal Communications Commission member Anna Gomez has wrapped up two weeks in California visiting broadcasters, television studio executives, enter...