How to Migrate from MySQL to Databricks
Skippr is the easiest way to migrate from MySQL to Databricks and get fully cleansed and modeled data in one run command.
Source: MySQL. Destination: Databricks.
Sample config
yaml
skippr:
workspace: mysql_to_databricks
pipelines:
mysql_to_databricks:
data_source: data_sources.source
data_sink: data_sinks.warehouse
data_sources:
source:
Mysql:
connection_string: "mysql://user:pass@host:3306/db"
data_sinks:
warehouse:
Databricks:
workspace_url: "${DATABRICKS_HOST}"
token: "${DATABRICKS_TOKEN}"
warehouse_id: "${DATABRICKS_WAREHOUSE_ID}"
catalog: main
schema: defaultEnvironment
bash
export DATABRICKS_HOST="https://myworkspace.cloud.databricks.com"
export DATABRICKS_TOKEN="dapi..."
export DATABRICKS_WAREHOUSE_ID="abc123def456"Source connector: mysql. Destination connector: databricks.
See Quick start.
