Everything we do on the internet - which is just about everything we do these days - depends on the work of clusters, which are also called pods.
When we stream a hot new TV show, order a pair of jeans or Zoom with grandma, we use clusters. You're reading this story thanks to pods.
So, What Is a Cluster? What Is a Pod? A cluster or a pod is simply a set of computers linked by high-speed networks into a single unit.
Computer architects must have reached, at least unconsciously, for terms rooted in nature. Pea pods and dolphin superpods, like today's computer clusters, show the power of many individuals working as a team.
The Roots of Pods and Superpods The links go deeper. Botanists say pods not only protect and nourish individual peas, they can reallocate resources from damaged seeds to thriving ones. Similarly, a load balancer moves jobs off a failed compute node to a functioning one.
The dynamics aren't much different for dolphins.
Working off the coast of the Bahamas, veteran marine biologist Denise Herzing often sees every day the same pods, family groups of perhaps 20 dolphins. And once she encountered a vastly larger group.
Years ago, off the Baja peninsula, I saw a superpod. It was very exciting and a little overwhelming because as a researcher I want to observe a small group closely, not a thousand animals spread over a large area, said the founder of the Wild Dolphin Project.
For dolphins, superpods are vital. They protect the travelers by creating a huge sensory system, a thousand sets of ears that listen for predators like one super-sensor, she said, noting the parallels with the clusters used in cloud computing today.
A data center with multiple clusters or pods can span multiple buildings, and run as a single system. Pods Sprout in Early Data Centers As companies began computerizing their accounting systems in the early 1960s, they instinctively ganged multiple computers together so they would have backups in case one failed, according to Greg Pfister, a former IBM technologist and an expert on clusters.
I'm pretty sure NCR, MetLife and a lot of people did that kind of thing, said Pfister, author of In Search of Clusters, considered by some the bible of the field.
In May 1983, Digital Equipment Corp. packed several of its popular 32-bit VAX minicomputers into what it called a VAXcluster. Each computer ran its own operating system, but they shared other resources, providing IT users with a single system image.
Diagram of an early PC-based cluster. By the late 1990s, the advent of low-cost PC processors, Ethernet networks and Linux inspired at least eight major research projects that built clusters. NASA designed one with 16 PC motherboards on two 10 Mbit/second networks and dubbed it Beowulf, imagining it slaying the giant mainframes and massively parallel systems of the day.
Cluster Networks Need Speed Researchers found clusters could be assembled quickly and offered high performance at low cost, as long as they used high-speed networks to eliminate bottlenecks.
Another late 90's project, Berkeley's Network of Workstations (NoW), linked dozens of Sparc workstations on the fastest interconnects of the day. They created an image of a pod of small fish eating a larger fish to illustrate their work.
Researchers behind Berkeley's NoW project envisioned clusters of many small systems out-performing a single larger computer. One researcher, Eric Brewer, saw clusters were ideal for emerging internet apps, so he used the 100-server NoW system as a search engine.
For a while we had the best search engine in the world running on the Berkeley campus, said David Patterson, a veteran of NoW and many computer research projects at Berkeley.
The work was so successful, Brewer co-founded Inktomi, an early search engine built on a NoW-inspired cluster of 1,000 systems. It had many rivals, including a startup called Google with roots at Stanford.
They built their network clusters out of PCs and defined a business model that let them grow and really improve search quality - the rest was history, said Patterson, co-author of a popular textbook on computing.
Today, clusters or pods are the basis of most of the world's TOP500 supercomputers as well as virtually all cloud computing services. And most use NVIDIA GPUs, but we're getting ahead of the story.
Pods vs. Clusters: A War of Words While computer architects called these systems clusters, some networking specialists preferred the term pod. Turning the biological term into a tech acronym, they said POD stood for a point of delivery of computing services.
The term pod gained traction in the early days of cloud computing. Service providers raced to build ever larger, warehouse-sized systems often ordering entire shipping containers, aka pods, of pre-configured systems they could plug together like Lego blocks.
An early prototype container delivered to a cloud service provider. More recently, the Kubernetes group adopted the term pod. They define a software pod as a single container or a small number of containers that are tightly coupled and that share resources.
Industries like aerospace and consumer electronics adopted the term pod, too, perhaps to give their concepts an organic warmth. Among the most iconic examples are the iPod, the forerunner of the iPhone, and the single-astronaut vehicle from the movie 2001: A Space Odyssey.
When AI Met Clusters In 2012, cloud computing services heard the Big Bang of AI, the genesis of a powerful new form of computing. They raced to build giant clusters of GPUs that, thanks to their internal clusters of accelerator cores, could process huge datasets to train and run neural networks.
To help spread AI to any enterprise data center, NVIDIA packs GPU clusters on InfiniBand networks into NVIDIA DGX Systems. A reference architecture lets u
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
16/04/2024
Following a difficult 2023 market for OTT solutions and technologies that saw considerable economic uncertainty, Quickplay chief business officer Paul Pastor sa...
16/04/2024
NEW YORK TV usage dropped by 3% in March compared to February and March Madness helped cable to gain a larger share of TV viewing but overall changes in TV usag...
16/04/2024
Brompton Technology unveils world's most powerful 8K LED video processor, Te...
16/04/2024
Motion Picture Connectivity Company Bit Part Debuts bitbox Remote Camera Control...
16/04/2024
Capitol Broadcasting Company holds supporting the community as a high priority a...
16/04/2024
New generative AI tools will enable users of Adobe Premiere Pro to streamline editing all videos, including adding or removing objects in a scene or extending a...
16/04/2024
Moore has led the development effort for over 20 products in the AV space
By Matthew Corrigan
Published: April 16, 2024
Moore has led the development effo...
16/04/2024
TV 2, a television broadcaster in Norway, has chosen Magnifi, an AI-powered highlight generation platform, to enhance its coverage of football for fans across t...
16/04/2024
FilmLight, best known for its grading system Baselight, has chosen Jigsaw24 Media as the first global and exclusive UK partner for their new product, Nara. The ...
16/04/2024
DPA Microphones introduces its new AIR1 Universal Miniature Fur Windscreen at NAB 2024 (Booth C7307). Intended for quick mounting on round, omnidirectional head...
16/04/2024
If there remains any doubt that the cloud and artificial intelligence are transforming the workflows that drive the Media & Entertainment (M&E) industry, Amazon...
16/04/2024
Evan Jacobs, VP Finishing & Stereo at Marvel Studios, cautioned not to downplay the home entertainment environment too much, noting that it's now hard to bu...
16/04/2024
The age of streaming the opportunity for different viewing habits for many. Entire seasons could be binged whenever you had the time to spare and didn't m...
16/04/2024
LAS VEGAS During a press conference at the NAB Show, ARRI unveiled its ALEXA 35 Live - Multicam System, which is designed to bring the cinematic image quality o...
16/04/2024
ROXi announced that it has partnered with Pearl TV and major U.S. broadcasters to deploy ROXi's FastStream-powered interactive TV channels on the broadcaste...
16/04/2024
U.S. Internet households now consume an average 43.5 hours of video per week across all viewing devices. That's an increase of more than six hours in 2020, ...
16/04/2024
Lawo and Waves Audio have announced that the Waves SuperRack LiveBox hardware server being displayed at the 2024 NAB Show is fully compatible with Lawo's mc...
16/04/2024
At the 2024 NAB Show, Riedel Communications has unveiled its expanded RiCapture ingest solutions line with the addition of RiCapture i8, i44, and i84. Complemen...
16/04/2024
Coles enhanced colour separation, adding shape and depth to the characters through the use of a soft highlight and shadow roll off, and embracing the natural te...
16/04/2024
The Prismatic Company Debuts Strategy for New LightWeave Platform for the Creato...
16/04/2024
Avid to Demonstrate Latest Stream of Innovation at NAB Show 2024 to Drive the Op...
16/04/2024
Paramount Plus has ordered a fourth season of Star Trek: Strange New Worlds, and said the fifth season of Star Trek: Lower Decks will be the final one. Season f...
16/04/2024
Sinclair said that it launched Broadspan, a datacasting platform based on the new ATSC 3.0 broadcast technology....
16/04/2024
LAS VEGAS Byron Allen, founder, chairman and CEO of Allen Media Group, spoke about his bid to acquire Paramount Global at NAB Show April 14. Allen called Para...
16/04/2024
Major station owners are bringing interactivity to broadcast, hoping that will convince consumers particularly younger ones obsessed with TikTok to buy new ...
16/04/2024
Smoke and Mirrors: Monday's episode, 15 April 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Afric...
16/04/2024
Skeem Saam: Monday's episode, 15 April 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
16/04/2024
Historic: House of Zwide' is the most-watched TV show on e.tvE.tv's fashion telenovela House of Zwide' beat Scandal!' for the first time sinc...
16/04/2024
Tonight on Scandal: Jojo's doing his best to make amends, but Phakamile worr...
16/04/2024
Editor's note: This post is part of our In the NVIDIA Studio series, which c...
16/04/2024
Facebook
Twitter
LinkedIn
Automated and malicious traffic rises for a fifth consecutive year
Bad bots account for 32% of all internet traffic
44% of all...
15/04/2024
(Robin Marshall/Shutterstock for Sundance Film Festival)...
15/04/2024
LONDONDERRY, N.H., April 15, 2024 - L3Harris Technologies (NYSE:LHX) received a $256 million order from the U.S. Army for continued production of the Enhanced N...
15/04/2024
Montreal, Canada - April 15, 2024 - Grass Valley, a pioneer in live production s...
15/04/2024
NEW YORK In a major step forward in the broadcast industry's move to ATSC 3.0, NBCUniversal announced that it is launching personalized broadcast experience...
15/04/2024
LAS VEGAS Ross Video has announced an agreement to acquire Bannister Lake Software (BL Soft), a 31-year old Cambridge, Ontario-based provider of data-driven bro...
15/04/2024
Panasonic has revealed some of its technology that will be used for the broadcast of this summer's Olympic Games and Paralympics in Paris....
15/04/2024
Adobe Previews Breakthrough AI Innovations to Advance Professional Video Workflo...
15/04/2024
Zaxcom NAB Preview - Zaxcom's ZaxConvert Software is Now More Versatile & 10...
15/04/2024
Blackmagic Design Announces New Blackmagic PYXIS 6K
Brie Clayton April 15, 2024
0 Comments
Advanced digital film camera in an incredibly versatile des...
15/04/2024
SmallHD's Free PageOS 6 Update Adds Powerful New Capabilities to All Current...
15/04/2024
SiliconCores patented Common Cathode driver chip delivers frame rates of 240 Hz and a refresh rate of 7680Hz, enabling slow motion, multi-camera view and multip...
15/04/2024
The UK-based virtual studio, sports and events graphics company has appointed Naphtali Cave into a newly created role to drive technical innovation and creativi...
15/04/2024
CBS's daytime panel talk show The Talk will end its run with a shortened 15th season, concluding the show in December, CBS confirmed Friday....
15/04/2024
Season four of Cesar Millan: Better Human Better Dog starts on Nat Geo Friday, A...
15/04/2024
In a notable leap forward for broadcasters planning to monetize their NextGen TV broadcasts, Sinclair has announced the launch of its Broadspan datacasting pl...
Everything we do on the internet - which is just about everything we do these days - depends on the work of clusters, which are also called pods.
