Skippr Docs

Appearance

How to Migrate from Amazon DynamoDB to ClickHouse ​

Skippr is the easiest way to migrate from DynamoDB to ClickHouse and get fully cleansed and modeled data in one run command.

Source: DynamoDB. Destination: ClickHouse.

Sample config ​

yaml
skippr:
  workspace: dynamodb_to_clickhouse
pipelines:
  dynamodb_to_clickhouse:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    Dynamodb:
      table_name: my-table
      region: us-east-1
data_sinks:
  warehouse:
    Clickhouse:
      url: "http://localhost:8123"
      database: default
      user: default

Environment ​

bash
export CLICKHOUSE_URL="http://localhost:8123"
export CLICKHOUSE_USER="default"
export CLICKHOUSE_PASSWORD="mypassword"
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"

Source connector: dynamodb. Destination connector: clickhouse-warehouse.

See Quick start.