
Everything we do on the internet - which is just about everything we do these days - depends on the work of clusters, which are also called pods.
When we stream a hot new TV show, order a pair of jeans or Zoom with grandma, we use clusters. You're reading this story thanks to pods.
So, What Is a Cluster? What Is a Pod? A cluster or a pod is simply a set of computers linked by high-speed networks into a single unit.
Computer architects must have reached, at least unconsciously, for terms rooted in nature. Pea pods and dolphin superpods, like today's computer clusters, show the power of many individuals working as a team.
The Roots of Pods and Superpods The links go deeper. Botanists say pods not only protect and nourish individual peas, they can reallocate resources from damaged seeds to thriving ones. Similarly, a load balancer moves jobs off a failed compute node to a functioning one.
The dynamics aren't much different for dolphins.
Working off the coast of the Bahamas, veteran marine biologist Denise Herzing often sees every day the same pods, family groups of perhaps 20 dolphins. And once she encountered a vastly larger group.
Years ago, off the Baja peninsula, I saw a superpod. It was very exciting and a little overwhelming because as a researcher I want to observe a small group closely, not a thousand animals spread over a large area, said the founder of the Wild Dolphin Project.
For dolphins, superpods are vital. They protect the travelers by creating a huge sensory system, a thousand sets of ears that listen for predators like one super-sensor, she said, noting the parallels with the clusters used in cloud computing today.
A data center with multiple clusters or pods can span multiple buildings, and run as a single system. Pods Sprout in Early Data Centers As companies began computerizing their accounting systems in the early 1960s, they instinctively ganged multiple computers together so they would have backups in case one failed, according to Greg Pfister, a former IBM technologist and an expert on clusters.
I'm pretty sure NCR, MetLife and a lot of people did that kind of thing, said Pfister, author of In Search of Clusters, considered by some the bible of the field.
In May 1983, Digital Equipment Corp. packed several of its popular 32-bit VAX minicomputers into what it called a VAXcluster. Each computer ran its own operating system, but they shared other resources, providing IT users with a single system image.
Diagram of an early PC-based cluster. By the late 1990s, the advent of low-cost PC processors, Ethernet networks and Linux inspired at least eight major research projects that built clusters. NASA designed one with 16 PC motherboards on two 10 Mbit/second networks and dubbed it Beowulf, imagining it slaying the giant mainframes and massively parallel systems of the day.
Cluster Networks Need Speed Researchers found clusters could be assembled quickly and offered high performance at low cost, as long as they used high-speed networks to eliminate bottlenecks.
Another late 90's project, Berkeley's Network of Workstations (NoW), linked dozens of Sparc workstations on the fastest interconnects of the day. They created an image of a pod of small fish eating a larger fish to illustrate their work.
Researchers behind Berkeley's NoW project envisioned clusters of many small systems out-performing a single larger computer. One researcher, Eric Brewer, saw clusters were ideal for emerging internet apps, so he used the 100-server NoW system as a search engine.
For a while we had the best search engine in the world running on the Berkeley campus, said David Patterson, a veteran of NoW and many computer research projects at Berkeley.
The work was so successful, Brewer co-founded Inktomi, an early search engine built on a NoW-inspired cluster of 1,000 systems. It had many rivals, including a startup called Google with roots at Stanford.
They built their network clusters out of PCs and defined a business model that let them grow and really improve search quality - the rest was history, said Patterson, co-author of a popular textbook on computing.
Today, clusters or pods are the basis of most of the world's TOP500 supercomputers as well as virtually all cloud computing services. And most use NVIDIA GPUs, but we're getting ahead of the story.
Pods vs. Clusters: A War of Words While computer architects called these systems clusters, some networking specialists preferred the term pod. Turning the biological term into a tech acronym, they said POD stood for a point of delivery of computing services.
The term pod gained traction in the early days of cloud computing. Service providers raced to build ever larger, warehouse-sized systems often ordering entire shipping containers, aka pods, of pre-configured systems they could plug together like Lego blocks.
An early prototype container delivered to a cloud service provider. More recently, the Kubernetes group adopted the term pod. They define a software pod as a single container or a small number of containers that are tightly coupled and that share resources.
Industries like aerospace and consumer electronics adopted the term pod, too, perhaps to give their concepts an organic warmth. Among the most iconic examples are the iPod, the forerunner of the iPhone, and the single-astronaut vehicle from the movie 2001: A Space Odyssey.
When AI Met Clusters In 2012, cloud computing services heard the Big Bang of AI, the genesis of a powerful new form of computing. They raced to build giant clusters of GPUs that, thanks to their internal clusters of accelerator cores, could process huge datasets to train and run neural networks.
To help spread AI to any enterprise data center, NVIDIA packs GPU clusters on InfiniBand networks into NVIDIA DGX Systems. A reference architecture lets u
Most recent headlines
21/04/2021
Our first meeting with Daniel at Fish House in Bucharest. Try the Salt-Crusted Sea Bass!
By Eric Liaw, Alex Lim, Jules Maltz, and Jason Kong
Today, we are exc...
21/04/2021
ITV named a Top 10 Inclusive Employer by the British LGBT Awards
ITV has been named as one of the top 10 most inclusive employers by the prestigious British LG...
21/04/2021
First look image of Marsha Thomason as DS Jenn Townsend
Guest cast announced The Bay Series 3
The Bay adds over one million viewers as an average of 8 milli...
21/04/2021
Fox Corporation Executives to Discuss Third Quarter Fiscal 2021 Financial Result...
21/04/2021
Press release | April 20 2021
TechnipFMC Awarded a Significant Subsea Contract...
21/04/2021
Let's celebrate the recent nominees and winners of this year's awards season.
Register now
FilmLight is hosting a discussion with the talents who have...
21/04/2021
Delphine Ernotte Cunci, EBU President, launches the TV Assembly 2021...
21/04/2021
News Summary:
The Cisco Foundation is committing $100 million over ten years to help reverse the impact of climate change.
Cisco will move the needle on cli...
21/04/2021
Gestmusic, a Banijay Iberia company, confirms it will produce Onliners and Old Timers (Canvi de Xip) in collaboration with Catalan Ministry of Culture for TV3. ...
21/04/2021
Avid and Dolby Deliver Industry First Pro Tools Dolby Atmos Production Course ...
21/04/2021
Fall back dates for December are still in place, and an announcement on that is expected to be made in June
By Jenny Priestley
Published: April 21, 2021
Fa...
21/04/2021
Chamber music with a Baltic twist
Berlin-based sampling experts Orchestral Tools have just announced the release of Tallinn, a 43GB (92GB uncompressed) soft...
21/04/2021
YouTube said that it will be making seasonal sponsorships available as part of its Select premium advertising product, allowing marketers to own the top mom'...
21/04/2021
Fox won the Monday ratings race with the return of 9-1-1 and 9-1-1: Lone Star. Fox rated a 0.9 in viewers 18-49, per the Nielsen overnights, and a 6 share. In s...
21/04/2021
In its first report under its rebrand as the Parents Television & Media Counsel, PTC said there are upsides and downsides to streaming media that families need ...
21/04/2021
Aaron Rodgers, playing guest host for two weeks, gave CBS Media Ventures' Jeopardy! a big boost in the session ending April 11. Rodgers, the star quarterbac...
21/04/2021
A new season of Deadliest Catch: Bloodline is on Discovery Plus April 20. Captain Josh Harris and business partner Casey McManus venture to Hawaii after discove...
21/04/2021
Netflix added just 3.98 million streaming subscribers worldwide in the first quarter after adding 15.77 million a year ago as the COVID-19 pandemic set in....
21/04/2021
Derek Chauvin was found guilty Tuesday of murdering George Floyd on three separa...
21/04/2021
Kelly Abcarian, the long-time Nielsen executive, is joining NBCUniversal's advertising and partnerships division as executive, measurement & impact....
21/04/2021
B&C has partnered with always-on TV ad measurement and attribution company iSpot.tv to bring you a weekly chart we call Promo Mojo: exclusive data showing the t...
21/04/2021
Roku said that it will launch a Roku Originals brand starting with the content it acquired from Quibi, the short-lived short-form mobile-first subscription serv...
21/04/2021
Maximo Ibarra is due to leave the broadcaster this summer
By Jenny Priestley
Published: April 21, 2021
Maximo Ibarra is due to leave the broadcaster this s...
21/04/2021
Based on its recent analysis of theNorth American 5G network applications market...
21/04/2021
TVU Networks, a market and technology leader in cloud and IP-based live video so...
21/04/2021
All-in-one computer features a Dolby Atmos array
Apple have just announced a new iMac design - the first in their long line of all-in-one computers to be ba...
21/04/2021
Subsidiary of Kazakhstan's Ministry of Digital Development, Innovation and Aerospace Industry and SES will collaborate to deliver high-speed data services v...
21/04/2021
NASHVILLE, Tennessee - April 2021 - Although TobyMac's Hits Deep Tour has been an annual late-winter tradition for a number of years now, this year's tr...
21/04/2021
The full report can be downloaded here or from www.waterwise.org.uk
21 April 2021, UK, London: Fitting one million smart water meters in the UK each year for t...
21/04/2021
TRADING UPDATE 1Q21 Regulated information - Inside information Strong orderbook offers encouraging signs of recovery
Kortrijk, Belgium, 21 April 2021, 7:3...
21/04/2021
Mo-Sys takes virtual production to a truer focus
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=ht...
21/04/2021
Durable Goods Signs Director Katharina Baron
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=https:...
21/04/2021
NewTek 3Play 3P2 Delivers The Best Plays, Played Better: Replay in Affordable, S...
21/04/2021
Cooke Optics appoints Andy Buckland as Director of Product Management
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthu...
21/04/2021
SXSW Feature Film I'm Fine (Thank You For Asking) Shoots and Finishes with B...
21/04/2021
Rights-Cleared Pool Feed of First U.S. Presidential Address to Joint Session of ...
21/04/2021
Creative House Studios Debuts ARRI Lighting Upgrades & More
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg......
21/04/2021
VFX Graduates at Rising Sun Pictures Follow Different Paths to Success
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpth...
21/04/2021
Dream Chip Awarded Best Production Technology' by Tech Leadership
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpth...
21/04/2021
Autodesk to Explore the Future of VFX and Animation at FMX 2021
data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg...
21/04/2021
The Holly Springs Salamanders have announced the teams promotional schedule for the 2021 season. The 30-game home schedule features a promotion for every home g...
21/04/2021
Xilinx Introduces Kria Portfolio of Adaptive System-on-Modules for Accelerating ...
21/04/2021
As the demand for video and content production grows worldwide, companies of all sizes and industries gradually increase their library of content or media archi...
20/04/2021
Rights Cleared Pool Feed of First U.S. Presidential Address Offered on TVU Media...
20/04/2021
WASHINGTON-The FCC is poised to unfairly burden local over-the-air broadcasters with an additional regulation that would require them to take steps to determine...
20/04/2021
WASHINGTON-The FCC Media Bureau is ready to take a look and its rules regarding the Commercial Advertisement Loudness Mitigation (CALM) Act, officially asking f...
20/04/2021
SAN FRANCISCO-Bitmovin has closed a Series C financing round in which it raised $25 million. This new funding will be used to drive Bitmovin's expansion of ...
20/04/2021
MONTREAL-Grass Valley got in the game with Electronic Arts Competitive Gaming Entertainment (CGE), the esports division of EA, by supplying its GV AMPP cloud-ba...
20/04/2021
NEW YORK-An 18-month long CTV fraud scheme that connected seven different cases as part of one coordinated effort has been identified and stopped by DoubleVerif...
20/04/2021
WASHINGTON-NAB, E.W. Scripps, IT consultancy Fincons Group and the News Literacy Project will demonstrate how local TV newsrooms can use NextGen TV's dynami...