Software Ate the World - That Means Hardware Matters Again
23/08/2021
Ten years ago venture capitalist Marc Andreessen proclaimed that software is eating the world.
His once-radical concept - now a truism - is that innovation and corporate value creation lie in software. That led some to believe that hardware matters less.
Just the opposite. It's now clear that the software-defined revolution relies on new chip architectures - GPUs and DPUs - to continue.
One GPU can already replace a dozen or even 100 CPUs for AI and machine learning.
And one DPU can do the work of 20, 50 or even 120 CPU cores in a single chip. Future DPUs will offload the work of up to 300 CPU cores.
Hardware matters more than ever.
Hardware Matters Because AI Matters To be sure, software remains important.
Everyone - whether in stores, factories, offices or schools - relies on software. We even use software to socialize and date.
But the next decade will be a story of every business becoming not just a software company, but an AI company.
Businesses that don't embrace AI - the automation of automation - will fall behind.
This rush to AI has big implications.
Commodity CPUs were enough for the software transformation of the previous decade.
The GPU and DPU will be the engines that drive the AI transformation of the next.
Software-defined, hardware-accelerated infrastructure will displace the original software-defined infrastructure. Innovators Will Dual-Wield GPUs and DPUs That's because today's workloads are very different.
Data is growing exponentially.
Networking speeds in the data center have accelerated 20x - to 200 Gigabits per second, up from 10 Gbps.
AI has become widespread in enterprises and the cloud.
Applications run on many different servers at once and are always communicating with each other.
Moore's law has ended - CPU performance now increases only linearly and can't keep up with the growth in everything else.
With all these trends accelerating, the standard CPU is already overwhelmed. AI training workloads and machine learning models can consume CPUs on servers for hours or days.
It's now common for a third of each server's CPU cores to run infrastructure tasks such as networking, storage management and security.
Specialized silicon is the solution.
CPUs can then do what they do best: general, single-threaded applications.
WorkloadCharacteristicsAcceleration NeededBest Processor
General applications Single threaded None CPU
AI, ML, HPC Massively parallel Integer or FP math GPU
Graphics & video Parallel, codecs Matrix math, transforms, ray tracing, probability GPU with ray tracing
Networking Multithreaded, pipelined Packet processing, routing, encapsulation DPU
Security Single- or multithreaded Encryption, inspection, domain isolation DPU
Hardware Innovation Fuels Software-Defined Innovation
The software-defined revolution has brought the hardware-software balance full circle. Hardware design is important again.
But it's no longer in the design of custom ASICs for each appliance or general-purpose CPUs that matters most. Instead, it's continuous innovation in specialized processors such as GPUs and DPUs.
The rapid pace of innovation in these processors poses challenges for the chip world. Taking advantage of ever-smaller semiconductor process nodes demands more complicated design efforts.
Every time the process shrinks, new design rules come into play. New, more efficient chips need larger design and verification teams.
The result is that chip companies must invest huge sums. Not only in the logical design of their chips. But also in the physical aspects. They need to follow the rules and limits of physics down to the quantum realm.
Over time, only larger chip companies can design at scale. That means creating multiple new chips at each new process node. Other companies that make their own chips can't afford to design on the newest nodes. They'll have to settle for older, larger, less efficient processes.
We saw this in CPUs, where only three companies have been able to sustain innovation. They've done that by amortizing their CPU design efforts over large numbers of chips and customers.
The same seems likely for GPU and DPUs. Big silicon players will support sustained innovation in software.
Innovators Can Eat Hearty Armed with innovative GPUs and DPUs, data centers will deploy processors optimized for different tasks. As a result, software, driven by AI, will continue eating the world.
The modern datacenter is software-defined and hardware-accelerated. They go hand in hand.
LINK: | https://blogs.nvidia.com/blog/2021/08/23/software-ate-world-hardware/... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
30/04/2024
SES Announces Acqusition of Intelsat for $3.1B
European telecom satellite company SES announced today that it is acquiring rival Intelsat for $3.1 billion. The deal, unanimously approved by both companies...
30/04/2024
Bakish Out at Paramount
Bob Bakish, chief executive of Paramount stepped down on Monday, effective immediately. Bakish, who was a staunch ally of Shari Redstone, controlling shareholde...
30/04/2024
Hotspring unveils Slapshot ML-driven rotoscoping solution
Hotspring said the breakthrough had been achieved through the acceleration of machine learning technology By Matthew Corrigan Published: April 30, 2024 Ho...
30/04/2024
SES to acquire Intelsat in $3.1 billion deal
Speaking about the deal, Adel Al-Saleh, CEO of SES, said: it will bring value-added, efficient, and reliable offerings for both companies media customers By Je...
30/04/2024
Bob Bakish officially out at Paramount, new Office of the CEO finalising long-term plan'
Paramount said the Office of the CEO is working with its board to develop a comp...
30/04/2024
Gray Television Using NextGen TV to Roll Out Advanced Features Like HDR
LOUISVILLE, Ky. In another sign that broadcasters are finally using NextGen TV broadcasts to offer viewers new features instead of simply simulcasting existing ...
30/04/2024
Oklahoma Journalism Hall of Fame To Honor Blaise Labbe
OKLAHOMA CITY The Oklahoma Journalism Hall of Fame will induct Blaise Labbe, a group news director for Sinclair Broadcast Group, May 2 at the 54th Anniversary I...
30/04/2024
Cox Media Group, Dish Ink New Multi-Year Agreement
ATLANTA and ENGLEWOOD, Colo. Cox Media Group and Dish have ended a dispute over retransmission fees that lasted nearly a year and a half with a new multi-year ...
30/04/2024
TelevisaUnivision Taps LTN for IP-Based Distribution
Video transport solution provider LTN has announced that it is working with TelevisaUnivision to help the Spanish-language media giant migrate to IP-based video...
30/04/2024
NBC KXAS and Telemundo KXTX Used Clear-Com Solutions for Eclipse Coverage
ALAMEDA, Calif. Clear-Com has released details about how it played a pivotal role in the seamless coverage of the recent solar eclipse on April 8, 2024 by NBC K...
30/04/2024
Scripps Appoints Seth Walters To Steer CTV Sales Strategy
CINCINNATI The E.W. Scripps Company is adding Seth Walters to its sales leadership team as head of CTV sales, effective April 29....
30/04/2024
Durham Bulls Saturday Game, First Sellout of 2024 Season
The force was strong at the Durham Bulls Athletic Park on Saturday night, April 27, 2024, as the night netted the ballpark's first official sellout crowd of...
30/04/2024
NewFront Life Is a Cabaret for LGBTQ+ Network Revry
Revry, a network celebrating queer culture. said its second annual NewFront presentation will be a cabaret-type spectacle showcasing the spirit of the LGBTQ+ co...
30/04/2024
FETV Viewers Say Howdy' as Wyatt Earp' Joins Lineup
Family Entertainment Television (FETV) said that the Western series The Life and Legend of Wyatt Earp will be joining the network's afternoon lineup startin...
30/04/2024
Bob Bakish Departing Paramount, According to Reports
Bob Bakish, president and CEO of Paramount Global, will depart the company as Paramount explores a merger, according to numerous published reports. The reports ...
30/04/2024
SES to acquire Intelsat in compelling transaction focused on the future
Value accretive transaction underpinned by 2.4 billion (NPV) of readily executable synergies. Creating a stronger multi-orbit operator with 60% of revenue in...
30/04/2024
Thales reports its order intake and sales for the first quarter of 2024
Facebook Twitter LinkedIn Order intake: 5.0 billion, up 47% ( 46% on an organic basis1 ) Sales: 4.4 billion, up 9.8% ( 7.9% on an organic basis) All f...
29/04/2024
Filming begins and further cast confirmed in Mark Gatiss drama Bookish for Alibi
(L-R) Mark Gatiss and Polly Walker on set Monday 29 April 2024 Further casting is now confirmed for Bookish (6x70), a brand-new drama created by Emmy Award-wi...
29/04/2024
She Speaks Sudan': Thomson launches programme to empower women journalists and civil society actors in exile
A groundbreaking initiative offering training and mentoring to 30 women journali...
29/04/2024
Meet the 2024 Sundance Institute Directors, Screenwriters, and Native Lab Fellows
Even though we've been doing this for over 40 years, a spark of excitement r...
29/04/2024
The AN/PRC-158: A Resilient Communications Bridge Between Air and Ground
L3Harris is delivering manpack radios to U.S. Army CH-47 Chinooks as part of the Air-to-Ground Networking Radio program, providing seamless, resilient communica...
29/04/2024
CS President Sam Mehta: Resilient Communications are Critical to Realizing JADC2
He writes in Defense One: Despite the near-universal acknowledgement throughout the U.S. government and defense industrial base of the criticality of resilient ...
29/04/2024
Clear-Com Enhances The Kennedy Center with Seamless Communication Solutions
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/04/2024
Optimising audio loudness & normalisation across the Media Supply Chain
Codemill aims to revolutionize media workflow efficiency at this years NAB Show by introducing Just-In-Time (JIT) playback technology in Accurate.Video Validate...
29/04/2024
TF1 Chooses Broadpeak to Power Targeted Advertising for New Video Streaming Service
April 29, 2024 -- TF1 Chooses Broadpeak to Power Targeted Advertising for New...
29/04/2024
LG Adds Allen Media Group's Local Now FAST Channel in 223 Markets
LOS ANGELES Allen Media Group (AMG) has partnered with LG Electronics to bring 223 Local Now FAST channels to LG's free streaming service, LG Channels, avai...
29/04/2024
Ross Video Unveils Raiden Weather Graphics System
OTTAWA Ross Video has announced the introduction of Raiden, a data-driven weather graphics software that combines data gathering, processing, and visualization ...
29/04/2024
Melanie Georgieva Joins Panalux as Long Form Sales Direct...
Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision's end-to-end service offerings for...
29/04/2024
Cobalt Iron Earns Patent on Analytics-Based Dynamic Autho...
Cobalt Iron Inc., a leading provider of SaaS-based enterprise data protection, today announced that it has received a patent on its technology for dynamic autho...
29/04/2024
SDVI Rally Access Workstation Earns Two Top Awards at 202...
SDVI, the leading platform provider for cloud-native media supply chains, today announced that Rally Access Workstation, a fully managed solution for editing in...
29/04/2024
Premier Sports selects QuickLink Remote Commentary soluti...
Premier Sports, a premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality remote commenta...
29/04/2024
Glookast picks Jigsaw24 Media as exclusive UK channel par...
Glookast has chosen Jigsaw24 Media as the only UK channel partner to represent their portfolio of ingest and workflow optimisation products. The agreement, sign...
29/04/2024
Clear-Coms Eclipse HX and Agent-IC Technology Illuminate...
Clear-Com played a pivotal role in the seamless coverage of the recent solar eclipse on April 8, 2024. Leveraging its cutting-edge Eclipse HX Digital Matrix i...
29/04/2024
PlayBox Neo to Promote Latest Smart Media Playout Innovat...
PlayBox Neo will promote its complete range of television channel management, graphic branding and playout solutions to EMEA region media content owners and bro...
29/04/2024
RuPaul Game Show Lingo' Returns to CBS May 24
Lingo, RuPaul's word-twisting game show, returns for season two on CBS Friday, May 24. Two episodes air that night, and stream on Paramount Plus, too....
29/04/2024
ESPN, Amazon Prime Video Reportedly Close To New Deals With the NBA
ESPN and Amazon Prime Video are reportedly close to scoring television rights to the National Basketball Association, according to published reports....
29/04/2024
Judge Judy,' Hot Bench' Renewed for 2 More Years
Judge Judy and Hot Bench, CBS Media Ventures' genre-leading court shows, have been renewed through the 2025-26 TV season in more than 95% of the country, Gr...
29/04/2024
Irish Sports Broadcaster Premier Sports Taps QuickLink for Remote Commentary
Premier Sports, an Irish-based premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality re...
29/04/2024
BAFTA Television Craft Awards winners announced
The awards celebrate the craft of behind-the-scenes TV talent and the best programmes of 2023 By Matthew Corrigan Published: April 29, 2024 The awards cel...
29/04/2024
Watch: How Milk VFX helped create 259 shots for Netflix's Scoop
The team at Milk had to create and deliver the VFX and environment work for the royal residences featured in the drama from scratch By Jenny Priestley Publis...
29/04/2024
What's going on at Paramount Global?
CEO Bob Bakish is expected to leave the company as early as today, with a new leadership committee likely to run the company on an interim basis By Jenny Pries...
29/04/2024
Meet the director of media and entertainment and strategic products
Albena Ivanova, director, media and entertainment and strategic products at CHAOS talks to TVBEurope about her route into the industry By TVBEurope Staff Pub...
29/04/2024
Anna Valley brand name acquired by AV company Grand Technix
The acquisition gives Grand Technix the opportunity to expand its footprint in the audio visual and broadcast technology sectors By Jenny Priestley Published...
29/04/2024
Screen Australia announces James J. Robinson's debut feature First Light
29 04 2024 - Media release Screen Australia announces James J. Robinson's debut feature First Light First Light Principal Photography is underway on Firs...
29/04/2024
Capitol Broadcasting Becomes First Company Inducted into NC Media and Journalism Hall of Fame
Capitol Broadcasting recently became the inaugural company honored with inductio...
29/04/2024
Tonight on House of Zwide: Zanele tells a surprised Zola that Faith fully supports her dropping charges against him
Tonight on House of Zwide: Zanele tells a surprised Zola that Faith fully suppor...
29/04/2024
Tonight on Scandal: Nhlamulo's request has Mdala reeling
Tonight on Scandal: A line is crossed and a mother starts to lose focusDon't miss Friday, 26 April's riveting episode of South African soapie Scandal! o...