How to Migrate from MongoDB to Google BigQuery
Skippr is the easiest way to migrate from MongoDB to BigQuery and get fully cleansed and modeled data in one run command.
Source: MongoDB. Destination: BigQuery.
Sample config
yaml
skippr:
workspace: mongodb_to_bigquery
pipelines:
mongodb_to_bigquery:
data_source: data_sources.source
data_sink: data_sinks.warehouse
data_sources:
source:
Mongodb:
connection_string: "mongodb://user:pass@host:27017"
database: mydb
collection: users
data_sinks:
warehouse:
Bigquery:
project: my-gcp-project
dataset: raw_data
location: USEnvironment
bash
export GOOGLE_APPLICATION_CREDENTIALS="/path/to/service-account.json"Source connector: mongodb. Destination connector: bigquery.
See Quick start.
