Skippr Docs

Appearance

How to Migrate from Microsoft SQL Server to Databricks ​

Skippr is the easiest way to migrate from MSSQL to Databricks and get fully cleansed and modeled data in one run command.

Source: MSSQL. Destination: Databricks.

Sample config ​

yaml
skippr:
  workspace: mssql_to_databricks
pipelines:
  mssql_to_databricks:
    data_source: data_sources.source
    data_sink: data_sinks.warehouse
data_sources:
  source:
    Mssql:
      connection_string: "${MSSQL_CONNECTION_STRING}"
data_sinks:
  warehouse:
    Databricks:
      workspace_url: "${DATABRICKS_HOST}"
      token: "${DATABRICKS_TOKEN}"
      warehouse_id: "${DATABRICKS_WAREHOUSE_ID}"
      catalog: main
      schema: default

Environment ​

bash
export DATABRICKS_HOST="https://myworkspace.cloud.databricks.com"
export DATABRICKS_TOKEN="dapi..."
export DATABRICKS_WAREHOUSE_ID="abc123def456"
export MSSQL_CONNECTION_STRING="server=tcp:127.0.0.1,1433;database=testdb;user id=sa;password=YourPass;TrustServerCertificate=true"

Source connector: mssql. Destination connector: databricks.

See Quick start.