Skippr Docs

Appearance

How to Migrate from Amazon Redshift to Google BigQuery ​

Skippr is the easiest way to migrate from Redshift to BigQuery and get fully cleansed and modeled data in one run command.

Source: Redshift. Destination: BigQuery.

Sample config ​

yaml
skippr:
  workspace: redshift_to_bigquery
pipelines:
  redshift_to_bigquery:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    Redshift:
      cluster_identifier: my-cluster
      database: analytics
      db_user: admin
      region: us-east-1
data_sinks:
  warehouse:
    Bigquery:
      project: my-gcp-project
      dataset: raw_data
      location: US

Environment ​

bash
export GOOGLE_APPLICATION_CREDENTIALS="/path/to/service-account.json"
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"

Source connector: redshift. Destination connector: bigquery.

See Quick start.