Scaling into infinity Part I
10/05/2023
Whether you're a multimillionaire or working to make ends meet, this standard design is always prevalent - Amazon doesn't look any different and Google doesn't run any faster.
This is especially true for public services that are designed for all different types of people and users, and when you design something for everyone, that service must be robust and perform.
In this blog series, I look to explore and outline how modern delivery teams can build environments that scale to extreme public demand and continue to scale and perform far into the future.
Performance
Let's quickly establish the objective of performance within a digital context:
The objective of web performance is to increase the rate at which information and services are consumed across the web
This is done by reducing latency, process time and variance across all interactions in a user's session to return the system to an interactive or information state in a more consistent manner
To accomplish this, we work to improve the trail of the distribution since that is how we make systems accessible, reliable, and equitable, i.e., make the 99th percentile just as performant as the 50th.
Less is more with performance. The more we can reduce, the more we can provide. It sounds ironic but it isn't. It's surprisingly quite logical.
Performance is about quality just as much as it is about speed. Quality of outcome, quality of experience and, for many companies, quality of conversion i.e., sales.
So how do we scale for large volumes of users, those in the multi-millions, doing ever more complex workloads? Not forgetting some other important questions that we must also ask ourselves:
When is a user, not only a user?
What are the prime examples of why we might need to scale for these kinds of load profiles, is it more than just an ego session on whose cloud is bigger?
What really is the critical path to having a performant environment, and should we really care about how we get there?
First, it's important to understand the idea of when is a user, not only a user'. What exactly do I mean by this? A user that's going to the front page of a website and looking or accessing data from a CDN (Content Delivery Network) has a nominal impact on any service.
A CDN, for those not in the know, is essentially a cache that stores the resource that a user has requested on the closest possible server to them which significantly reduces latency and processing times. Pretty handy when you're dealing with a lot of users making the same request for the same service. Government information services or landing pages are great examples of services that benefit from this type of component.
A user that is streaming video content or entering long-form data content, such as a survey, will have a much larger profile than a user accessing a cached web page, this much is obvious. What's less obvious is what a user leaves behind, especially in an event-driven solution - something swiftly becoming the norm. Some examples of user baggage:
A chain of synchronous and asynchronous calls and processing events - common in event-driven architecture. These can, in many instances, take hours, days or even weeks to process long after a user has completed their web front-end action. Due to process times of data ingress services.
Network Address Translation (NATs) processing NATs are awesome, they allow provisioning of IP addresses from private networks out into the public internet or permit fancy things such as IP masquerading. However, when dealing with high volumes they can quickly become backed up . This doesn't mean the NAT stops working but the data that NAT is consuming does start to take longer to process.
Data and ETL Pipelines have ingestion rates. Especially true when they are scanning or transforming that data. The rate at which data is generated by inputs and processed by data pipelines frequently creates bottlenecks in production environments that can take measurable time to clear down.
Why do we care so much about User Baggage?
Good question. We care because if we plan to support a large volume of users continuously, and those users are going to create backlogs in our solution, we need to be certain those backlogs are going to get processed at a rate proportionate to how quickly they are being produced. We also need to make sure our event chains and data in transit are backed up, secure and robust.
Example projects that feature high volumes and have large user footprints include:
Population Censuses. Most countries carry out population-wide counts and data-gathering exercises every 10 years. These exercises put enormous write loads on a digital service and are also region-locked due to data legislation which (in turn) prevents global distribution on infrastructure. China has over 494.16 million households for example, to build a platform that could - in a relatively short amount of time - consume such a vast amount of personal data would be a huge task and well exceed the capacity of any cloud provider. Because of this, China decided to carry out a mostly physical census. The UK, however, carried out a digital-first census, with remarkable effectiveness, efficiently scaling for the whole population.
Major political change. Think of the UK exiting the EU, this required the resettlement and processing of over 3.5 million EU migrants and the updating of an import and export economy of $610B, all of which needed to be managed by a brand new digital infrastruc
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
12/05/2024
Berklee Honors Ledisi, Q-Tip, and Gilberto Santa Rosa at Commencement
Berklee Honors Ledisi, Q-Tip, and Gilberto Santa Rosa at Commencement This years honorary doctorate recipients were recognized for their profound influence as...
11/05/2024
Survey: Fubo Boasts High Levels of Audience Attention
NEW YORK FuboTV has released a new study from TVision, which studies TV and CTV viewer engagement, that found ads on Fubo get higher viewer attention levels tha...
11/05/2024
The Weekly TV Tech Product News Roundup
Missed any of our product news this week? Here is our new weekly wrap-up with all the product news we published in our newsletter between May 6 and May 10. The ...
11/05/2024
Enghouse Completes Acquisition of SeaChange
MARKHAM, Ontario Enghouse Systems Limited has announced it has successfully completed its acquisition of substantially all of the assets of SeaChange Internatio...
11/05/2024
Unreal for video Rendering for After Effects
Unreal for video Rendering for After Effects Graham Quince May 10, 2024 0 Comments Welcome to my series on learning Unreal Engine for video producti...
11/05/2024
CEO David Zaslav On How Warner Bros. Discovery Is Using AI
Warner Bros. Discovery is using artificial intelligence to improve ad targeting and help viewers find content, but not to create programming, CEO David Zaslav s...
11/05/2024
Allen Media Group Reaches Expanded Carriage Deal With Hawaiian Telcom
Byron Allen's Allen Media Group said it reached an expanded carriage agreement with Hawaiian Telcom....
11/05/2024
Good Morning Football' To Air on Fox Television Stations
Good Morning Football, an NFL-focused panel talk show that has aired on NFL Network since 2016, is coming to broadcast syndication with the Fox Television Stati...
11/05/2024
Andrea Robinson Joins WCMH Columbus as Weekend Anchor
Andrea Robinson starts on the weekend newscasts at WCMH Columbus, Ohio, Saturday, May 11, anchoring alongside Matthew Herchik and meteorologist Bryan Still. NBC...
11/05/2024
Streaming? No Thanks, Says Nexstar CEO Perry Sook
Perry Sook, founder and CEO of broadcast giant Nexstar Media Group, isn't a fan of streaming....
11/05/2024
Law & Order: Organized Crime' Moves to Peacock
Law & Order: Organized Crime is moving from NBC to Peacock for season five. The Dick Wolf drama follows the detectives of the Organized Crime Control Bureau as ...
11/05/2024
Harry Pappas, Station Group Founder, Has Died
Harry Pappas, Pappas Telecasting Companies founder/president/CEO, died April 24 at age 78. He was surrounded by his family when he passed. He had battled illnes...
11/05/2024
KXAS Dallas-Fort Worth, WTVF Nashville Pick Up Peabody Awards
KXAS Dallas-Fort Worth and WTVF Nashville have won 2024 Peabody Awards. Given out by the University of Georgia's Grady College of Journalism and Mass Commun...
11/05/2024
AMC Networks Earnings Drop To $48.5 Million in Q1
AMC Networks reported that its first-quarter earnings fell by half, with advertising revenue dropping 13%....
10/05/2024
The Greatest Night in Pop Proves That We're Most Powerful as a Collective
Lionel Richie (Photo by George Pimentel/Shutterstock for Sundance)...
10/05/2024
Give Me the Backstory: Get to Know Arun Bhattarai and Dorottya Zurb, the Filmmakers Behind Agent of Happiness
By Lucy Spicer One of the most exciting things about the Sundance Film Festival...
10/05/2024
SBS announces Voyager lead singer Danny Estrin as Australia's spokesperson for the 2024 Eurovision Song Contest jury
SBS announces Voyager lead singer Danny Estrin as Australia's spokesperson f...
10/05/2024
UK Ministry of Defence Selects L3Harris T4 Robots to Assist with Explosive Ordnance Disposal Missions
The T4's best-in-class manipulator arm reach and lift strength, patented sta...
10/05/2024
A True Industry Partner for the Western Australian Police Force
L3Harris, together with partner Radlink Communications, is delivering communications terminals for the Western Australian Police Force (WA Police Force) leverag...
10/05/2024
Survey: TV Declines as Preferred Source of Local News
A major new survey and study of local news reveals a number of unsettling trends for broadcasters. Key findings from the Pew Research Center survey include a de...
10/05/2024
LOBO Launches Standalone Live-Action Division With Impressive Roster of Directors
LOBO Launches Standalone Live-Action Division With Impressive Roster of Director...
10/05/2024
Limecraft Announces New Platform Update and Preview of MI at MPTS 2024
Limecraft Announces New Platform Update and Preview of MI at MPTS 2024 Brie Clayton May 10, 2024 0 Comments Accompanying image shows the Limecraft Act...
10/05/2024
Berklee Announces 2024 Songs for Social Change Contest Winners
Berklee Announces 2024 Songs for Social Change Contest Winners Student songwriters shine in the annual contest that recognizes music with a socially conscious...
10/05/2024
Meet Graduates from Berklees Class of 2024
Meet Graduates from Berklees Class of 2024 Members of this years graduating class reflect on their proudest moments at Berklee and look ahead to whats next. ...
10/05/2024
Zille Media aims to enhance media accessibility with Audio Description Editor
The company has worked with Motion Picture Solutions (MPS) on the development of the solution, which sits in the cloud-native Zille Platform By Jenny Priestley...
10/05/2024
Meet the head of entertainment
From The Tube and Top of the Pops to head of entertainment at 1185 Films, Chris Cowey tells TVBEurope about his journey through the ranks during a time of chang...
10/05/2024
Dimension bolsters senior team with four new appointments
Dimension said its new hires signal its investment in creative new production techniques for feature films, episodic series, music videos and more By Matthew C...
10/05/2024
Allen Media Group, Hawaiian Telcom Sign Multi-Year Distribution Deal
LOS ANGELES Byron Allen's Allen Media Group (AMG) has announced a multi-year comprehensive portfolio agreement with Hawaiian Telcom for continued carriage o...
10/05/2024
LG Ad Solutions to Adopt Unified ID 2.0
MOUNTAIN VIEW, Calif. LG Ad Solutions has announced that it has started to integrate the Unified ID 2.0 solution (UID2) into its platform....
10/05/2024
CBS Sports Expands Streaming Coverage of National Women's Soccer League
CBS Sports has expanded its partnership with the National Women's Soccer League by adding multiplatform coverage of 22 additional regular season matches. Th...
10/05/2024
Sinclair Prebooks $77M in Political Ads
Sinclair's Q1 2024 financial report once again highlighted the growing importance of political advertising for broadcasters at a time when core TV advertisi...
10/05/2024
Nexstar Reports Record Q1 Revenue
IRVING, TEXAS Nexstar reported record first quarter net revenue of $1.28 billion, up 2.1%, thanks to higher distribution revenue. But advertising revenue at the...
10/05/2024
Tegna Names David Loving President & GM of KHOU and KTBU in Houston
TYSONS, Va. Tegna Inc. has named David Loving president and general manager at KHOU, the CBS affiliate, and KTBU, Tegna's stations serving Houston, Texas, e...
10/05/2024
New FILM LOOK CREATOR in DaVinci Resolve 19 will put LUT creators out of business!
New FILM LOOK CREATOR in DaVinci Resolve 19 will put LUT creators out of busines...
10/05/2024
Spotted at CBC
Capitol Broadcasting employees frequently walk past photo shoots in progress when leaving work in the evenings. The WRAL Gardens and the striking architecture o...
10/05/2024
Berklee and Audio Engineering Society to Host Symposium on AI in Music
Berklee and Audio Engineering Society to Host Symposium on AI in Music The inaugural AES International Symposium on AI and the Musician will highlight excitin...
10/05/2024
LG Ad Solutions Integrating Trade Desk's Unified ID 2.0
LG Ad Solutions, the advertising arm of smart-TV maker LG Electronics, said it has begun to integrate the Unified ID 2.0 identity system developed by The Trade ...
10/05/2024
NBC Affiliates To Get Cut-Ins During Olympic Coverage To Promote Local News
NBC and its affiliates have worked out an arrangement that will give affiliates 90-second cut-ins during daytime network coverage of the Paris Olympic games....
10/05/2024
NBC Sends Leslie Jones to Paris for Offbeat Olympics Coverage
Comedian Leslie Jones is joining NBCUniversal's Olympics coverage this summer as what NBCU calls chief super fan commentator. She had a similar role at NB...
10/05/2024
Brooke Shields Stars in Netflix Film Mother of the Bride'
Brooke Shields stars in the rom-com Mother of the Bride, which premieres on Netflix May 9. Mark Waters directs the film, about a destination wedding in Thailand...
10/05/2024
Owen Sejake portrays General Moeti in Showmax's Empini'
Owen Sejake portrays General Moeti in Showmax's Empini'Veteran actor Owen Sejake portrays General Moeti in Showmax's upcoming series, Empini' ...
10/05/2024
Nomzamo Mbatha discusses working with Bruce Willis in Assassin'
Nomzamo Mbatha discusses working with Bruce Willis in Assassin'Actress Nomzamo Mbatha opens up about her role as Alexa in sci-fi thriller Assassin' al...
10/05/2024
Tonight on Scandal: Dintle stumbles upon a dangerous gift
Tonight on Scandal: Dintle stumbles upon a dangerous giftDon't miss Friday, 10 May's riveting episode of South African soapie Scandal! on e.tv on DStv c...
10/05/2024
Tonight on Skeem Saam: Mr Kgomo considers rehiring a former employer despite their rocky history
Tonight on Skeem Saam: Mr. Kgomo considers rehiring a former employer despite th...
10/05/2024
Skeem Saam: Friday's episode, 10 May 2024 [video]
Skeem Saam: Friday's episode, 10 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soapi...
10/05/2024
Thuraya network coverage restored in the Indo-China region as recovery measures underway
Abu Dhabi, 10 May 2024: Further to our previous communications about the unexpec...
10/05/2024
Thuraya network coverage restored in the Indo-China region as recovery measures underway
Abu Dhabi, 10 May, 2024 : Abu Dhabi, 10 May 2024: Further to our previous commu...
10/05/2024
Tonight on House of Zwide: Mampho is hurt after catching Ona and Soka chilling in his car together
Tonight on House of Zwide: Mampho is hurt after catching Ona and Soka chilling i...