Skippr Docs

Appearance

CDC: MySQL to Databricks | Real-Time Replication Guide ​

Real-time Change Data Capture from MySQL to Databricks with exactly-once delivery, order-token guards, and tombstone anti-resurrect protection.

Source: MySQL. Destination: Databricks.

CDC apply: Unity Catalog MERGE.

Sample config ​

yaml
skippr:
  workspace: cdc_mysql_to_databricks
pipelines:
  cdc_mysql_to_databricks:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
    cdc:
      default:
        business_key_columns:
          - id
data_sources:
  source:
    Mysql:
      connection_string: "mysql://replicator:${MYSQL_PASSWORD}@host:3306/mydb"
      cdc_mode: snapshot_then_cdc
data_sinks:
  warehouse:
    Databricks:
      workspace_url: "https://dbc-xxx.cloud.databricks.com"
      token: "${DATABRICKS_TOKEN}"
      catalog: main
      schema: default

Environment ​

bash
export DATABRICKS_TOKEN="dapi..."

Source connector: mysql. Destination connector: databricks.

See CDC overview.