data ingestion

Get started with data ingestion

You have several different options for how can access your data from SageMaker. The most commonly used data source in the examples uses S3 buckets. You can also use Athena, EMR, Redshift, and Amazon Keyspaces DB as data sources.

Basic S3 examples by data type

The following notebooks demonstrate how to load the most popular data types: images, tabular, and text. Note that you don’t have to have an S3 bucket to get started. SageMaker uses a default bucket that it creates for you as an easy way to get started without having to create one yourself.

Athena

You can use Amazon Athena as a data source for SageMaker. Athena is a serverless interactive query service that makes it easy to analyze your S3 data with standard SQL. This example runs the California housing dataset and uses PyAthena, a Python client for Athena, and awswrangler, a Pandas-like interface to many AWS data platforms.

EMR

You can use Amazon EMR as a data source for SageMaker. While EMR supports is used for processing large amounts of data from a variety of sources, SageMaker-EMR examples focus on Apache Spark. This example runs the California housing dataset.

Redshift

You can use Amazon Redshift as a data source for SageMaker. Redshift is a fully managed data warehouse that allows you to run complex analytic queries against petabytes of structured data. This example runs the California housing dataset and uses awswrangler, a Pandas-like interface to many AWS data platforms.

Amazon Keyspaces (for Apache Cassandra)

In this notebook we will provide step-by-step instruction to use SageMaker to ingest customer data from Amazon Keyspaces and train a ML Model

Amazon Keyspaces (for Apache Cassandra) is a scalable, highly available, and managed Apache Cassandra–compatible database service. With Amazon Keyspaces, you can run your Cassandra workloads on AWS using the same Cassandra application code and developer tools that you use today. You don’t have to provision, patch, or manage servers, and you don’t have to install, maintain, or operate software. Amazon Keyspaces is serverless, so you pay for only the resources you use and the service can automatically scale tables up and down in response to application traffic.