Skippr Docs

Appearance

CDC: Kafka to Snowflake | Real-Time Replication Guide ​

Real-time Change Data Capture from Kafka to Snowflake with exactly-once delivery, order-token guards, and tombstone anti-resurrect protection.

Source: Kafka. Destination: Snowflake.

CDC apply: MERGE DML.

Sample config ​

yaml
skippr:
  workspace: cdc_kafka_to_snowflake
pipelines:
  cdc_kafka_to_snowflake:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
    cdc:
      default:
        business_key_columns:
          - id
data_sources:
  source:
    Kafka:
      brokers: "localhost:9092"
      topic: dbserver1.public.customers
      cdc_mode: snapshot_then_cdc
data_sinks:
  warehouse:
    Snowflake:
      database: ANALYTICS
      schema: RAW
      warehouse: COMPUTE_WH

Environment ​

bash
export SNOWFLAKE_ACCOUNT="MYORG-MYACCOUNT"
export SNOWFLAKE_USER="skippr_svc"
export SNOWFLAKE_PRIVATE_KEY_PATH="/path/to/snowflake_key.p8"

Source connector: kafka. Destination connector: snowflake.

See CDC overview.