IBM Expands Acce and Value of z Systems Mainframe Data with Apache Spark
07/04/2016
IBM z/OS Platform for Apache Spark enables Spark, an open-source analytics framework, to run natively on the z/OS mainframe operating system. The new offering, available now, enables data scientists to analyze data in place on the system origin, without the need to extract, transform and load (ETL), by breaking the tie between the analytics library and underlying file system.
In the cognitive era, where data is the new natural resource and computer systems are able to understand, reason and learn, businesses must be able to develop and capitalize on insights before they are no longer relevant. With this offering, which includes accelerators from z Systems business partners, organizations can more easily take advantage of z Systems data and capabilities to understand market changes and individualized client needs and make business adjustments in real-time, speeding time to value.
z Systems handles critical data and transactions for many of the world's major banks, insurers, retailers and transport companies. It features the industry's fastest commercial microprocessor and the ability to perform in-transaction analytics, scoring predictive models within a transaction in 2 milliseconds or less. Organizations can now leverage these capabilities, applying advanced in-memory analytics through Spark without moving data off the mainframe, saving time and money and limiting risk.
"As businesses of all sizes transform into real-time digital organizations, they must be able to get a clear picture of all their enterprise data without the excessive time and risk of ETL, said Rod Smith, IBM Fellow, Emerging Internet Technologies. With Apache Spark enabled natively on IBM platforms now including z Systems customers can perform analytics alongside the transactional systems that house key data, while drawing contextual insights from other data sources, enabling them to engage with customers and generate revenue in real time.
IBM z/OS Platform for Apache Spark includes Spark open source capabilities consisting of the Apache Spark core, Spark SQL, Spark Streaming, Machine Learning Library (MLlib) and Graphx, combined with the industry's only mainframe-resident Spark data abstraction solution. The new platform helps enterprises derive insights more efficiently and securely through:
Streamlined development Developers and data scientists can use their existing expertise with programming languages such as Scala, Python, R and SQL to reduce time to value for actionable insights.
Simplified data access Optimized data abstraction services remove complexity, providing seamless access to enterprise data in traditional formats such as IMS, VSAM, DB2 z/OS, PDSE or SMF with familiar tools via Apache Spark APIs.
In-place data analytics Apache Spark uses an in-memory approach for processing data to deliver results quickly. The platform includes data abstraction and integration services that enable z/OS analytics applications to leverage standard Spark APIs. This allows the organization to analyze data in-place, avoiding costly processing and security considerations associated with ETL.
Open source capabilities The platform offers an Apache Spark distribution of the open source, in-memory processing engine that is designed for big data.
IBM is also working with three partners, DataFactZ, Rocket Software and Zementis, to create customized solutions using IBM z/OS Platform for Apache Spark:
DataFactZ is a new partner that is working with IBM to develop Spark analytics based on Spark SQL and MLlib for data and transactions processed on the mainframe.
Rocket Software has been a long-standing IBM partner and this collaboration extends to z/OS Apache Spark. For example, the new Rocket Launchpad solution will allow clients to try the platform using data on z/OS.
Zementis is complementing its in-transaction predictive analytics offering for z/OS with a standards-based execution engine for Apache Spark. The solution allows users to deploy and execute advanced predictive models that can help them anticipate end users' needs, compute risk or detect fraud in real-time at the point of greatest impact, while processing a transaction.
The new z/OS Platform for Apache Spark and partner solutions will allow data scientists and data wranglers, who are charged with gathering data from different sources, to use the formats and tools they prefer to collect and analyze data.
IBM announced last year a commitment to Spark that included putting more than 3,500 IBM researchers and developers to work on projects related to the framework. As part of the commitment to advancing open source technologies for analytics on the mainframe, z Systems has also established a new GitHub organization for developers to collaborate and build tools around z/OS on Spark. For example, a combination of Project Jupyter and any NoSQL database can provide a flexible and extendible data processing and analytics solution.
This approach can help make modern open source tools more accessible by enabling developers to choose their tools and languages, providing new visual aids that monitor analytics results across disparate data environments and enabling modern data processing techniques and skills.
The IBM z/OS Platform for Apache Spark is now available for developers working with z/OS to download. To learn more about the IBM z Systems portfolio, visit http://www.ibm.com/systems/z/ or the IBM Systems blog.
QUOTES
DataFactZ:
With the proliferation of and access to data
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....
17/05/2024
Netflix Plots TV Takeover at Upfront Presentation
Netflix shared some programming projects at an upfront presentation in New York. Those include the basketball-themed comedy series Running Point, a Mindy Kaling...
17/05/2024
Plex Geek Week Sale Offers 20% Off Plex Lifetime Pass
Plex is offering movie and music collectors a 20% discount off its Lifetime Plex Pass as part of its Geek Week sale....
17/05/2024
GroupM Names Toby Jenner as President, GroupM Clients
Giant media buyer GroupM said it named Toby Jenner as global president, Group M Clients, a new position at the company....
17/05/2024
Clients of Independent Agencies Boost Programmatic Buying
Smaller advertisers are increasingly buying connected TV programmatically, according to a new report from FreeWheel, Comcast's ad-tech unit....
17/05/2024
TCLtvPlus Adds Streaming Music Channels From Vevo
TCLtvPlus, the streaming app on smart TVs made by TCL, has added live linear channel from music-video programmer Vevo....
17/05/2024
StackAdapt Adopts Data From Samba TV for Programmatic Campaigns
StackAdapt said it made a deal to integrate data from Samba TV into its programmatic advertising platform....
17/05/2024
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her wedding dress
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her w...
17/05/2024
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsettled
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsett...
17/05/2024
Save Time and Money with WO Traffic v24.0
WO Traffic provides a solid foundation from which stations can manage, execute, and scale end-to-end ad trafficking and sales, both today and into the future. W...
17/05/2024
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Sports Grow
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Spo...
17/05/2024
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, Ecosystem
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, E...
17/05/2024
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNBA Friday Night Spotlight on ION
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNB...
17/05/2024
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They Produce Live Gymnastics Broadcasts
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They...
17/05/2024
Netflix & Shondaland Announce the Song List and Soundtrack for 'Bridgerton' Season 3: Part 1
Back to All News Netflix & Shondaland Announce the Song List and Soundtrack for...
17/05/2024
Skeem Saam: Thursday's episode, 16 May 2024 [video]
Skeem Saam: Thursday's episode, 16 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
17/05/2024
Prison Journalism: Letter to my mothers
Prison Journalism: Letter to my mothersThabo Mthembu was incarcerated in Pollsmoor Prison from 2014 to 2019. Read Thabo's story by Thabo Mthembu 17-05-20...
17/05/2024
Paul McCartney becomes UK's first billionaire musician
Paul McCartney becomes UK's first billionaire musicianMusic icon Paul McCartney has become the UK's first billionaire musician, according to the Sunday ...
17/05/2024
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging Petunia
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging PetuniaDon't miss Friday, 17 May's riveting episode of South African soapie Smoke ...
17/05/2024
RT'S Operation Transformation comes to a close after 17 seasons
RT has today announced that Operation Transformation (OT) is to end after 17 seasons. As series come to an end each year, RT undertakes an editorial review to...
17/05/2024
Studio One: Your Binaural Beats Lab
By Craig Anderton When I heard about binaural beats, I was interested-I like beats, and I'm into binaural audio. But this has nothing to do with either o...
17/05/2024
May 16, 2024
Scripps Research chemist Donna Blackmond elected to the Royal Society of the U.K. Blackmond's wide-ranging work has shaped origin of life theories, our unde...
16/05/2024
Power Provokes Vital Questions About the Role of Police
PARK CITY, UTAH - JANUARY 18: Director Yance Ford introduces the Power premiere at Library Center Theatre. (Photo by Chad Salvador/Shutterstock for Sundance F...
16/05/2024
Mental Health Matters: Embrace Self-Care With These Audiobook and Podcast Listens
May is Mental Health Awareness month, a time to recognize those living with ment...
16/05/2024
ABC and SBS bring digital radio (DAB+) services to the Gold Coast
ABC and SBS bring digital radio (DAB ) services to the Gold Coast 15 May, 2024 Media releases ABC and SBS today announced that audiences on the Gold Coast ...
16/05/2024
Clear-Com Communication Solutions Enhance Oregon State University's PRAx Building
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...