Unlock this content

Enter your email to unlock this content for free

By continuing, you agree to our Terms of Service and Privacy Notice, and to receive occasional marketing emails.

Copy Pipes

TL;DR

Snapshots capture the result of a SELECT query into a table (like INSERT INTO SELECT). They can be one-shot or scheduled. OSS ClickHouse provides refreshable materialized views, but they have limitations. Tinybird Copy Pipes provide the same infrastructure benefits as backfilling: parallelization by partitions, atomicity, compute-compute separation, and queue management.

A snapshot captures the result of a SELECT query and writes it into a target table. It's essentially an INSERT INTO target SELECT * FROM source operation that can run once (one-shot) or repeatedly on a schedule. Snapshots are useful for creating point-in-time states, deduplicating data, generating periodic rollups, and managing data transformations that require full table rewrites.


OSS ClickHouse: Refreshable Materialized Views

OSS ClickHouse provides refreshable materialized views that can be refreshed automatically on a schedule or manually:

CREATE MATERIALIZED VIEW orders_snapshot_mv REFRESH EVERY 1 MINUTE TO orders_snapshot AS SELECT * FROM orders

Tinybird is not affiliated with, associated with, or sponsored by ClickHouse, Inc. ClickHouse® is a registered trademark of ClickHouse, Inc.

Copy Pipes | ClickHouse for Developers