Connectors
A pipeline reads from one source and writes to one destination. Some destinations also need a schema sink so the warehouse catalog stays in step with the tables Skipprd creates.
Configure them in skippr.yml, Python, or skipprd connect. Pin a release with version: on that entry when you do not want “latest”.
Data sources
Databases
| Connector | Guide |
|---|---|
Clickhouse | ClickHouse |
Dynamodb | DynamoDB |
Mongodb | MongoDB |
Motherduck | MotherDuck |
Mssql | SQL Server |
Mysql | MySQL |
Postgres | PostgreSQL |
Redshift | Redshift |
DeltaLake | Delta Lake |
Files and object stores
| Connector | Guide |
|---|---|
File | Local file |
S3 | S3 |
Sftp | SFTP |
Streaming
| Connector | Guide |
|---|---|
Kafka | Kafka |
Sqs | SQS |
Kinesis | Kinesis |
Amqp | AMQP |
Sns | SNS |
Eventbridge | EventBridge |
Mqtt | MQTT |
Websocket | WebSocket |
HTTP and network
| Connector | Guide |
|---|---|
HttpClient | HTTP client |
HttpServer | HTTP server |
Socket | Socket |
Statsd | StatsD |
Pcap | PCAP |
Otlp | OTLP |
Stdin | Stdin |
Marketing, commerce, and CRM
| Connector | Guide |
|---|---|
GoogleAnalytics | Google Analytics (GA4) |
GoogleAds | Google Ads |
GoogleSearchConsole | Google Search Console |
BingWebmasterTools | Bing Webmaster Tools |
AppleSearchAds | Apple Search Ads |
MetaAds | Meta Ads |
MetaInstagramAds | Meta Instagram Ads |
LinkedInAds | LinkedIn Ads |
XAds | X Ads |
AdrollAds | AdRoll Ads |
Stripe | Stripe |
ShopifyAdmin | Shopify Admin |
HubspotCrm | HubSpot CRM |
XeroAccounting | Xero Accounting |
RevolutBusiness | Revolut Business |
SumUp | SumUp |
Destinations
| Connector | Guide |
|---|---|
Athena | Athena |
AthenaIceberg | Athena Iceberg |
Bigquery | BigQuery |
Clickhouse | ClickHouse |
Databricks | Databricks |
Duckdb | DuckDB |
Motherduck | MotherDuck |
Postgres | PostgreSQL |
Redshift | Redshift |
Snowflake | Snowflake |
Synapse | Synapse |
SkipprLake | SkipprLake |
S3 | S3 |
Gcs | GCS |
AzureBlob | Azure Blob |
Sftp | SFTP |
File | Local file |
Amqp | AMQP |
Stdout | Stdout |
Schema sinks
Pair these with the matching destination so tables and columns appear in the catalog.
| Connector | Guide | Pair with |
|---|---|---|
Glue | Glue | Athena |
AthenaIceberg | Athena Iceberg schema | Athena Iceberg |
Duckdb | DuckDB schema | DuckDB |
SkipprLake | SkipprLake schema | SkipprLake |