Sony Pixel Power calrec Sony

IBM Announces Major Commitment to Advance ApacheSpark, Calling it Potentially the Most Significant Open Source Project of the Next Decade

15/06/2015

ARMONK, N.Y. - 15 Jun 2015: IBM (NYSE:IBM) today announced a major commitment to Apache Spark , potentially the most important new open source project in a decade that is being defined by data. At the core of this commitment, IBM plans to embed Spark into its industry-leading Analytics and Commerce platforms, and to offer Spark as a service on IBM Cloud. IBM will also put more than 3,500 IBM researchers and developers to work on Spark-related projects at more than a dozen labs worldwide; donate its breakthrough IBM SystemML machine learning technology to the Spark open source ecosystem; and educate more than one million data scientists and data engineers on Spark.

Shiva Gopalan, a computer engineering masters student at Texas A&M University(far right), confers with IBM developers Henrique Copelli Zambon (center) and Luiz Aoqui, during an IBM hosted Spark Hackathon at Galvanize, a tech hub in San Francisco on Sunday, June 14, 2015. (Credit:George Nikitin/Feature Photo Service for IBM)

As data and analytics are embedded into the fabric of business and society from popular apps to the Internet of Things (IoT) Spark brings essential advances to large-scale data processing. First, it dramatically improves the performance of data dependent apps. Second, it radically simplifies the process of developing intelligent apps, which are fueled by data.

To further accelerate open source innovation for the Spark ecosystem, IBM is taking the following actions:

IBM will build Spark into the core of the company's analytics and commerce platforms.

IBM s Watson Health Cloud will leverage Spark as a key underpinning for its insight platform, helping to deliver faster time to value for medical providers and researchers as they access new analytics around population health data.

IBM will open source its breakthrough IBM SystemML machine learning technology and collaborate with Databricks to advance Spark's machine learning capabilities.

IBM will offer Spark as a Cloud service on IBM Bluemix to make it possible for app developers to quickly load data, model it, and derive the predictive artifact to use in their app.

IBM will commit more than 3,500 researchers and developers to work on Spark-related projects at more than a dozen labs worldwide, and open a Spark Technology Center in San Francisco for the Data Science and Developer community to foster design-led innovation in intelligent applications.

IBM will educate more than 1 million data scientists and data engineers on Spark through extensive partnerships with AMPLab, DataCamp, MetiStream, Galvanize and Big Data University MOOC.

IBM has been a decades long leader in open source innovation. We believe strongly in the power of open source as the basis to build value for clients, and are fully committed to Spark as a foundational technology platform for accelerating innovation and driving analytics across every business in a fundamental way, said Beth Smith, General Manager, Analytics Platform, IBM Analytics. Our clients will benefit as we help them embrace Spark to advance their own data strategies to drive business transformation and competitive differentiation.

Spark Drives Business Transformation for IBM Clients

Spark has grown quickly in popularity among developers and data scientists as an essential platform for helping organizations more easily integrate Big Data into applications, and is quickly gaining momentum with IBM clients looking to transform business decision-making:

Real-time transportation planning software from Optibus is changing the way public transport is organized. Spark, together with IBM, provides a highly scalable platform for Optibus, making it easy for us to expand our software as a service offering into new markets, and helps us simplify deployment, maintenance and application development for transportation companies worldwide," said Amos Haggiag, Optibus CTO and Co-Founder.

Findability Sciences, a global consulting and contextual data technology solutions company, is using IBM Analytics and Spark to help clients tap into the power of Big Data. Apache Spark with IBM BigInsights has given us tremendous capacity for our implementations for small and medium businesses, where MapReduce was not efficient. With Spark, the performance has improved multi fold. We're now able to process streaming data from IoT devices and offer analytics for data in motion for things like traffic, commuters and parking, said Anand Mahurkar, CEO of Findability Sciences.

Independence Blue Cross (IBC) is the largest health insurer in the Philadelphia area, serving more than two million people in the region and seven million nationwide. It's using Spark to help drive product innovation and develop new services. "Apache Spark is quickly maturing into a power tool for development of machine-learning analytic applications. It allows our IBC researchers and academic partners to work together more seamlessly, which means we can get new claims and benefits apps up and out to customers much faster," said Darwin Leung, Director of Informatics at Independence Blue Cross.

IBM, NASA, and the SETI Institute are collaborating to analyze terabytes of complex deep space radio signals using Spark's machine learning capabilities in a hunt for patterns that might betray the presence of intelligent extraterrestrial life. With Spark as a Service on Bluemix, we'll be able to work with IBM to develop promising new ways to analyze signal data as we hunt for evidence of intelligence elsewhere in the cosmos. This is an exciting example of synergy in the service of science, said Dr. Seth Shostak, Senior Astronomer and Director of the Center for SETI Research.

IBM is one of four founding members of the UC Berkeley AMPLab, where Spark was first invented in 2009, and as a result participates in multi-day research retreats, provides advice and
LINK: http://www-03.ibm.com/press/uk/en/pressrelease/47121.wss...
See more stories from ibm

Most recent headlines

04/08/2024

Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

08/05/2024

zweiB updates to latest version of R&SCLIPSTER

zweiB updates to latest version of R&S CLIPSTER Specialist in deliverables for cinema, events and trade shows Rohde & Schwarz, a global leader in broadcast...

07/05/2024

NAB Show 2024

NAB Show 2024 Utah Scientific rocked the 2024 NAB Show in Las Vegas, unveiling two new game-changers in video signal management. Our primary focus this yea...

07/05/2024

Paul Whitehouse takes viewers through The Sketch Show Years in new 4-part series on Gold

7th May 2024 The nations favourite comedy channel Gold has teamed up with the ma...

07/05/2024

Your Guide to Having a Jam-Packed Sundance Institute Summer

There's something special about summer. We're not sure whether it's the warmer weather, the longer days, or something else a bit more magical, but s...

07/05/2024

NITV appoints Michael Rennie as Presenter and Senior Producer for NITV News

NITV appoints Michael Rennie as Presenter and Senior Producer for NITV News Media releases NITV has announced the appointment of Michael Rennie as Presenter...

07/05/2024

Network flexibility: A Vital Consideration for SATCOM Resiliency

The ability for line-of-site tactical voice and data networks to seamlessly traverse over Satellite Communications is an emerging requirement to assure warfight...

07/05/2024

L3Harris Avionics Repair Station Becomes the First in U.S. to Be Awarded European Military Airworthiness Certification

On April 5, 2024, the L3Harris Avionics Products Repair Station (NN2R037L) in Gr...

07/05/2024

Clear-Com Celebrates Theatre Triumphs in Light of 2024 Tony Award Nominations

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

07/05/2024

macOS Ventura Compatible

Share this article width=32 height=32 loading=lazy data-lazy-src=https://apogeedigital.com/app/themes/juniper-theme/src/img/icons/facebook-purple.svg /> wid...

07/05/2024

Disney Streaming DTC Operations Produce Their First Profits

BURBANK, Calif. The Walt Disney Company has finally delivered some from profits from its hefty streaming investments, with the second quarter of its fiscal year...

07/05/2024

Bonnie Hammer, Jen Psaki Share Books and Workplace Lessons at 92nd Street Y

Bonnie Hammer, vice chair of NBCUniversal, and Jen Psaki, MSNBC host, read from their new books at the 92nd Street Y in Manhattan Wednesday, May 8. Hammer's...

07/05/2024

Paramount Plus Orders Tracy Morgan Comedy Set in World of The Neighborhood'

Paramount Plus has ordered the series Crutch, a comedy that is a spinoff of CBS comedy The Neighborhood. Tracy Morgan stars....

07/05/2024

Daytime Emmys Announce Lifetime Achievement Recipients

Edward J. and Melody Thomas Scott and Lidia Bastianich will receive Lifetime Achievement honors at the 51st annual Daytime Emmy Awards in June, the National Aca...

07/05/2024

Al Roker, Wendy McMahon, Stephen A. Smith Set for Giants of Broadcasting Honors

The 2024 Giants of Broadcasting & Electronic Arts luncheon and awards ceremony happens in New York November 12, and the honorees are Al Roker, weather and featu...

07/05/2024

Dabl Debuts New Weekday Schedule

Dabl Network has added The Wayans Bros., The Jamie Foxx Show, Living Single and Everybody Hates Chris to its weekday and weekend lineups. Those shows join the l...

07/05/2024

Disney Entertainment DTC Business Gets Out of the Red in Q2

After winning a proxy fight, The Walt Disney Co. said its entertainment business turned a profit and added subscribers in its fiscal second quarter....

07/05/2024

Victor Wembanyama, Top NBA Rookie, Featured On Pass The Rock'

NBA Entertainment is closing out the second season of its series Pass the Rock with a look at Victor Wembanyama of the San Antonio Spurs, the league's rooki...

07/05/2024

Syncbak Rebrands as Zeam Media After Streaming Platform Rollout

Syncbak, which provides stations with streaming capabilities, said it is rebranding as Zeam Media....

07/05/2024

Magnolia Pictures Licenses Content To Stream on Samsung TV Plus

Samsung has made a deal with Magnolia Pictures that will bring titles from Magnolia to the Samsung TV Plus free streaming platform....

07/05/2024

Amazon Rolling Out Interactive Commercial Formats for Prime Video (Upfronts)

Amazon, which has added commercials to Amazon Prime Video, is rolling out new interactive ad formats that will enable advertisers to engage streamers and sell s...

07/05/2024

Syncbak Now Zeam Media

Syncbak, a 15 year-old provider of streaming tech for local broadcast stations has rebranded itself, adopting the name of its streaming service launched in Febr...

07/05/2024

Maximising resources: Keys to POST Luxembourg's success in the evolving media landscape

POST Luxembourgs journey with TAG Video underscores how finding a vendor who und...

07/05/2024

Survey: Amazon's Push into Ad-Supported Streaming Is Working

PORTSMOUTH, N.H. New findings from Hub Entertainment Research provides extensive data showing that the majority of consumers will opt for lower cost ad-supporte...

07/05/2024

The Library of American Broadcasting Foundation Unveils the 2024 Award Recipients

NEW YORK The Library of American Broadcasting Foundation (LABF) has announced th...

07/05/2024

Lindsey Reiser Joins CBS News 24/7 as Anchor and Correspondent

CBS News has named Lindsey Reiser an anchor and correspondent for CBS News 24/7, the network's live, streaming news service. Reiser, who was most recently a...

07/05/2024

Tablet Shipments Show Signs of Recovery in Q1

NEEDHAM, Mass. After more than two years of decline, worldwide tablet shipments posted modest year-over-year growth of 0.5% in the first quarter of 2024 (1Q24),...

07/05/2024

ESPN Pulls in Highest April Prime Time Audiences on Record

ESPN is reporting that April was a record-setting month as the network delivered its best April prime time audience on record, dating back more than 30 years....

07/05/2024

Kirsten Donaldson Joins NAB as VP of Public Policy

WASHINGTON, D.C. The National Association of Broadcasters (NAB) has announced that Kirsten Donaldson has joined NAB as vice president of public policy. Donaldso...

07/05/2024

Don't miss Bark in the Park, Margaritaville Night & Bull Sharks Night this week at the DBAP

The Bulls are back home again this week from May 7-12! Don't miss out on any...

07/05/2024

SVG Sit-Down: AWS's Julie Souza on the Cloud and AI in Broadcast-Content Creation, Distribution

SVG Sit-Down: AWS's Julie Souza on the Cloud and AI in Broadcast-Content Cre...

07/05/2024

Deloitte Analysts Peter Giorgio and Michael Vovk: Sports Properties Need To Rethink Fan Engagement

Deloitte Analysts Peter Giorgio and Michael Vovk: Sports Properties Need To Reth...

07/05/2024

University of Texas' Jeff Hanel to Keynote 16th-Annual SVG College Summit

University of Texas' Jeff Hanel to Keynote 16th-Annual SVG College Summit Industry vet to discuss uniting live and creative in athletic department media arm...

07/05/2024

Premier League Trials RefCam During Crystal Palace v Manchester United Fixture

Premier League trials RefCam during Crystal Palace v Manchester United fixture By George Bevir Tuesday, May 7, 2024 - 09:34 Print This Story In a Premier ...

07/05/2024

CBS Sports Previews PGA Championship Plans; 125+ Cameras Include FlyCams, Bunker Cams, Live Drones, and Shallow-depth-of-field

CBS Sports Previews PGA Championship Plans; 125+ Cameras Include FlyCams, Bunker...

07/05/2024

Rohde & Schwarz brings cutting-edge solutions to TECNOSEC and DRONExpo 2024

Rohde & Schwarz brings cutting-edge solutions to TECNOSEC and DRONExpo 2024 Rohde & Schwarz will showcase its innovative portfolio at TECNOSEC and DRONExpo 20...

07/05/2024

Five New Games Join Netflix in May

Back to All News Five New Games Join Netflix in May Netflix Staff Entertainment 07 May 2024 Global Link copied to clipboard Five new games are launching ...

07/05/2024

Blancco Wins 2024 SEAL Business Sustainability Award

Home News & Press Blancco Wins 2024 SEAL Business Sustainability Award Blancco Wins 2024 SEAL Business Sustainability Award May 07, 2024 Blancco's v...

07/05/2024

2024-05-07

CUPERTINO, CALIFORNIA Apple today unveiled the all-new Logic Pro for iPad 2 and Logic Pro for Mac 11, delivering breakthrough professional experiences for songw...

07/05/2024

Changes in Apple's privacy requirements

Apple's new Privacy Manifest requirement mandates that apps explicitly disclose the privacy-related data they collect, the purposes for this collection, and...

07/05/2024

Taylor Swift's Eras Tour arrives to shake up Europe

Taylor Swift's Eras Tour arrives to shake up EuropeHaving shaken four continents, Taylor Swift's Eras Tour finally brings the biggest pop culture icon o...

07/05/2024

Isiphetho: Destiny' beats Scandal!'

Isiphetho: Destiny' beats Scandal!'E.tv's latest telenovela Isiphetho: Destiny' beat the channel's longest running soapie, Scandal!' ...

07/05/2024

Now there's HELP for ex-prisoners to find work in South Africa

Now there's HELP for ex-prisoners to find work in South AfricaNew initiative for ex-prisoners to find work in South Africa proves it's never too late fo...

07/05/2024

Tonight on Scandal: Cohen is pulled into keeping a secret

Tonight on Scandal: Cohen is pulled into keeping a secretDon't miss Tuesday, 7 May's riveting episode of South African soapie Scandal! on e.tv on DStv c...

07/05/2024

Skeem Saam: Monday's episode, 6 May 2024 [video]

Skeem Saam: Monday's episode, 6 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soapie...

06/05/2024

Gathering Is a Call to Action: A Letter From Ilyse McKimmie

By Ilyse McKimmie Now, more than ever That's a phrase so often used in the last few years that I've come to dread seeing it in notes like this one. A...

06/05/2024

From Petabytes To Exabytes: The Future Of Shared Storage

alt= class=wp-image-12099 data-lazy-src=/wp-content/uploads/2024/05/Blog-Exabyte-Storage-Demand-960x540-1.jpg/> Demand for storage solutions has reached unprece...