Unlock this content
Enter your email to unlock this content for free
Ingestion
Prerequisites
- Completed Foundation module (ClickHouse architecture and schema design)
- Understanding of ClickHouse parts, merges, and storage engines
- Basic knowledge of distributed systems and data pipelines
- Familiarity with SQL and database concepts
This learning module covers how to ingest data into ClickHouse, from understanding the mental model to handling common scaling problems, using the ingestion proxy pattern, and integrating with various data sources.
What you'll learn
- Ingestion Patterns: Understanding streaming vs batch ingestion and when to use each
- Scaling Challenges: Common problems when scaling ingestion and how to solve them
- Proxy Pattern: How the ingestion proxy pattern handles write scaling and reliability
- Integrations: Practical methods for ingesting data from HTTP, Kafka, cloud storage, and more