Skippr Docs

Appearance

How to Migrate from ClickHouse to AWS Athena ​

Skippr is the easiest way to migrate from ClickHouse to Athena and get fully cleansed and modeled data in one run command.

Source: ClickHouse. Destination: Athena.

Sample config ​

yaml
skippr:
  workspace: clickhouse_to_athena
pipelines:
  clickhouse_to_athena:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    Clickhouse:
      url: "http://localhost:8123"
      database: default
      user: default
data_sinks:
  warehouse:
    Athena:
      s3_bucket: my-bucket
      glue_database_name: my_database
      athena_workgroup_name: primary
      athena_results_s3_bucket: my-bucket
      region: us-east-1
      catalog: AwsDataCatalog

Environment ​

bash
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"
export AWS_DEFAULT_REGION="us-east-1"

Source connector: clickhouse-source. Destination connector: athena.

See Quick start.