Amazon Web Services Makes AWS Glue Available To All Customers

Amazon Web Services Makes AWS Glue Available To All Customers

New ETL service automates the preparation of data for analytics, reducing the time it takes customers to start analyzing their data from months to minutes

SEATTLE--(BUSINESS WIRE)--Aug. 14, 2017-- Today, Amazon Web Services, Inc. (AWS), an Amazon.com company (NASDAQ: AMZN), launched AWS Glue, a fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data into Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Relational Database Service (Amazon RDS), and databases running on Amazon Elastic Compute Cloud (Amazon EC2) for query and analysis. Customers can create and run an ETL job with a few clicks in the AWS Management Console. Customers simply point AWS Glue at their data stored on AWS, and AWS Glue discovers the associated metadata (e.g. table definitions) and classifies it, generates ETL scripts for data transformation, and loads the transformed data into a destination data store, provisioning the infrastructure needed to complete the job. With AWS Glue, data can be available for analysis in minutes, and because AWS Glue is serverless, customers only pay for the compute resources they consume while executing data preparation and loading jobs. To learn more about AWS Glue, visit https://aws.amazon.com/glue.

Data integration - extracting data from various sources, normalizing it, and loading it into data stores - often represents as much as 75 percent of the time required to implement an analytics project. Customers can spend months hand coding and editing ETL scripts, which frequently become more complex and error prone as data volumes grow, and new data sources are added. And, running ETL jobs requires dedicated hardware that often sits idle between jobs. AWS Glue significantly speeds the ETL phase of analytics projects by eliminating all of the undifferentiated heavy lifting involved in creating, managing, and modifying ETL jobs.

After crawling a customer's selected data sources, AWS Glue identifies data formats and schemas to build a unified Data Catalog that provides a central view of customers' selected data. This makes it easy for customers to search and manage all of their data across various data stores without having to manually move it. When a customer identifies a data source (e.g., a database table) and target (e.g., a data warehouse) from the Data Catalog, AWS Glue matches the schemas and generates data transformation code that is customizable, reusable, portable, and sharable. Developers can schedule any number of ETL jobs, and AWS Glue manages the rest - automatically spinning compute resources up or down depending on customer ETL workloads. By streamlining the process of creating ETL jobs, AWS Glue allows customers to build scalable and reliable data preparation platforms spanning thousands of jobs, with built-in dependency resolution, scheduling, resource management, and monitoring.

AWS's scalable, reliable cloud storage, combined with our broad range of analytics services make it easier than ever for customers to collect, store, analyze, and share data, said Raju Gulabani, Vice President, Databases, Analytics, and AI, Amazon Web Services. While it's amazing to see how much analytics are being run on AWS today, many have told us that there is one piece of the equation that is still way too hard - cleaning and preparing huge volumes of data for analysis. We developed AWS Glue to eliminate much of the undifferentiated heavy lifting involved with ETL. By cataloging all of a customer's data and automating the ETL process, AWS Glue not only takes a lot of the hassle out of analytics. It also makes it possible for customers to store their data in as many sources as they want, and very quickly start analyzing all of it with whatever AWS service they choose.

NewsCorp is a global provider of news and business information, delivering content to a few hundred million consumers every day in over 50 countries. At NewsCorp, we are building a world-class digital platform on AWS to distribute content to our external customers and to facilitate data-driven decision making across all our businesses. We merge data from a variety of sources and load it to our Amazon S3-based data lake on a continuous basis, said Simon Smith, Chief Data Officer at NewsCorp. AWS Glue is unparalleled in its ability to infer, classify, and transform data. With AWS Glue our data scientists and analysts can always have access to the latest data available in our data lake. AWS Glue Data Catalog automatically detects the availability of new data, infers its metadata and makes it readily available in Amazon Athena so we can start querying that data. Our AWS Glue ETL jobs seamlessly convert raw data in a variety of data formats to an Amazon Athena optimized Parquet data format. And the best part is that AWS Glue is serverless. We do not have to provision or manage any resources to prepare data for analytics.

21st Century Fox is home to a global portfolio of media companies that reach more than 1.8 billion homes in 50 languages every day. As part of our overall data strategy, we are building a petabyte-scale data lake on Amazon S3 so that our executives can have access to any data asset through a unified data platform. We bring in data from a variety of sources, ranging from our ERP systems to clickstream and mobile analytics, process it, and make it available in a queryable form, says John Herbert, Global CIO, 21st Century Fox. We are always interested in trying out new products that will reduce the administrative overhead of managing our data lake. We are impressed by AWS Glues ability to automatically discover new data, extract the associated metadata and make it available through a central Data Catalog so we can instantly start queryin

LINK:	http://phx.corporate-ir.net/phoenix.zhtml?c=176060&p=irol-newsArticle&...
	See more stories from phx

Most recent headlines