Skippr Docs

Appearance

Kafka to Data Warehouse Pipeline with Skippr ​

Skippr consumes Kafka topics and materializes events for SQL analytics. Configure brokers, topics, and consumer groups—then land batches in your warehouse with cleansing and validation.

Capabilities ​

  • Topic consumption with consumer groups and configurable parallelism
  • Deterministic schema discovery from Kafka message payloads
  • Incremental and full-refresh sync modes
  • Automatic data cleansing and dead letter handling
  • Load into 9 supported data warehouses

CLI ​

bash
skippr connect source kafka \
  --brokers localhost:9092 \
  --topic events \
  --group-id skippr-consumer

Sample config ​

yaml
data_sources:
  source:
    Kafka:
      brokers: "localhost:9092"
      topic: events
      group_id: skippr-consumer

Full connector reference: kafka.