Unlock this content
Enter your email to unlock this content for free
Ingestion Integrations
What you'll learn
- HTTP Streaming: The most developer-friendly ingestion method with the Events API for OpenTelemetry, webhooks, and client libraries
- Kafka Streaming: How to ingest from Kafka topics and handle ClickHouse challenges with managed connectors
- Cloud Storage: Ingesting from S3 and GCS with initial loads and event-driven updates
- Backfilling: The hardest ingestion operation requiring compute separation, parallelization, and atomicity
- Snapshots: Capturing point-in-time data states using Copy Pipes
- APPEND vs REPLACE: Understanding when to use each mode for data updates
Learn More
- Get Data In - Complete ingestion guide
- Events API - HTTP streaming ingestion
- Connectors - Kafka, GCS, and other connectors