Skippr Docs

Appearance

CDC: MongoDB to Redshift | Real-Time Replication Guide ​

Real-time Change Data Capture from MongoDB to Redshift with exactly-once delivery, order-token guards, and tombstone anti-resurrect protection.

Source: MongoDB. Destination: Redshift.

CDC apply: Staging table + MERGE.

Sample config ​

yaml
skippr:
  workspace: cdc_mongodb_to_redshift
pipelines:
  cdc_mongodb_to_redshift:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
    cdc:
      default:
        business_key_columns:
          - id
data_sources:
  source:
    Mongodb:
      connection_string: "mongodb://user:${MONGO_PASSWORD}@host:27017/mydb"
      database: mydb
      collection: events
      cdc_mode: snapshot_then_cdc
data_sinks:
  warehouse:
    Redshift:
      database: analytics
      cluster_identifier: my-cluster
      db_user: admin
      schema: public
      region: us-east-1

Environment ​

bash
export AWS_ACCESS_KEY_ID="your-key"
export AWS_SECRET_ACCESS_KEY="your-secret"

Source connector: mongodb. Destination connector: redshift-warehouse.

See CDC overview.