Skip to content

How to Migrate from MySQL to Databricks

Skippr is the easiest way to migrate from MySQL to Databricks and get fully cleansed and modeled data in one run command.

Source: MySQL. Destination: Databricks.

Sample config

yaml
skippr:
  workspace: mysql_to_databricks
pipelines:
  mysql_to_databricks:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    Mysql:
      connection_string: "mysql://user:pass@host:3306/db"
data_sinks:
  warehouse:
    Databricks:
      workspace_url: "${DATABRICKS_HOST}"
      token: "${DATABRICKS_TOKEN}"
      warehouse_id: "${DATABRICKS_WAREHOUSE_ID}"
      catalog: main
      schema: default

Environment

bash
export DATABRICKS_HOST="https://myworkspace.cloud.databricks.com"
export DATABRICKS_TOKEN="dapi..."
export DATABRICKS_WAREHOUSE_ID="abc123def456"

Source connector: mysql. Destination connector: databricks.

See Quick start.