Skippr Docs

Appearance

How to Migrate from Amazon S3 to Snowflake ​

Skippr is the easiest way to migrate from S3 to Snowflake and get fully cleansed and modeled data in one run command.

Source: S3. Destination: Snowflake.

Sample config ​

yaml
skippr:
  workspace: s3_to_snowflake
pipelines:
  s3_to_snowflake:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    S3:
      s3_bucket: my-data-bucket
      s3_prefix: "raw/"
data_sinks:
  warehouse:
    Snowflake:
      database: ANALYTICS
      schema: RAW
      warehouse: COMPUTE_WH
      role: ACCOUNTADMIN

Environment ​

bash
export SNOWFLAKE_ACCOUNT="MYORG-MYACCOUNT"
export SNOWFLAKE_USER="myuser"
export SNOWFLAKE_PRIVATE_KEY_PATH="/path/to/snowflake_key.p8"
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"

Source connector: s3. Destination connector: snowflake.

See Quick start.