How to Migrate from MySQL to AWS Athena
Skippr is the easiest way to migrate from MySQL to Athena and get fully cleansed and modeled data in one run command.
Source: MySQL. Destination: Athena.
Sample config
yaml
skippr:
workspace: mysql_to_athena
pipelines:
mysql_to_athena:
data_source: data_sources.source
data_sink: data_sinks.warehouse
data_sources:
source:
Mysql:
connection_string: "mysql://user:pass@host:3306/db"
data_sinks:
warehouse:
Athena:
s3_bucket: my-bucket
glue_database_name: my_database
athena_workgroup_name: primary
athena_results_s3_bucket: my-bucket
region: us-east-1
catalog: AwsDataCatalogEnvironment
bash
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"
export AWS_DEFAULT_REGION="us-east-1"Source connector: mysql. Destination connector: athena.
See Quick start.
