How to Migrate from MongoDB to Databricks
Skippr is the easiest way to migrate from MongoDB to Databricks and get fully cleansed and modeled data in one run command.
Source: MongoDB. Destination: Databricks.
Sample config
yaml
skippr:
workspace: mongodb_to_databricks
pipelines:
mongodb_to_databricks:
data_source: data_sources.source
data_sink: data_sinks.warehouse
data_sources:
source:
Mongodb:
connection_string: "mongodb://user:pass@host:27017"
database: mydb
collection: users
data_sinks:
warehouse:
Databricks:
workspace_url: "${DATABRICKS_HOST}"
token: "${DATABRICKS_TOKEN}"
warehouse_id: "${DATABRICKS_WAREHOUSE_ID}"
catalog: main
schema: defaultEnvironment
bash
export DATABRICKS_HOST="https://myworkspace.cloud.databricks.com"
export DATABRICKS_TOKEN="dapi..."
export DATABRICKS_WAREHOUSE_ID="abc123def456"Source connector: mongodb. Destination connector: databricks.
See Quick start.
