S3 to Data Warehouse - Load S3 Data with Skippr
Treat S3 as a first-class source: configure a bucket and prefix, and Skippr ingests files into your warehouse with schema discovery and validation. Ideal for data lakes and vendor drops.
Capabilities
- Object-prefix ingestion for Parquet, JSON, and delimited files in S3
- Deterministic schema discovery from semi-structured files in S3
- Incremental and full-refresh sync modes
- Automatic data cleansing and dead letter handling
- Load into 9 supported data warehouses
CLI
bash
skippr connect source s3 \
--s3-bucket my-data-bucket \
--s3-prefix raw/Sample config
yaml
data_sources:
source:
S3:
s3_bucket: my-data-bucket
s3_prefix: "raw/"Full connector reference: s3.
