@tinybird

Tinybird is a managed ClickHouse® service for AI-native software teams. Get ClickHouse performance without ClickHouse complexity.

tbrd.co/go
Joined April 2019
  • Tweets4.7K
  • Following313
  • Followers8.5K
1.6KMedia
Classic was Tinybird’s original experience. Forward is the next big iteration, built for teams operating data products: deployments, schema migrations, local dev, CI/CD, SDKs and Agent Skills. Free and Developer Classic workspaces must migrate by Sep 15: tinybird.co/blog/tinybird-cl…

We're sunsetting Tinybird Classic for Free and Developer workspaces | Tinybird

Free and Developer plan workspaces must migrate from Tinybird Classic to Tinybird Forward by September 15, 2026. Here's what changes, what you gain, and how to migrate.

tinybird.co
6
10,163
Changing SQL transformations or parameter filters shouldn't rely on clicking around a staging UI to check for regressions. With Tinybird Forward, you check API Endpoints against YAML fixtures in CI using tb test run.
Tinybird YAML test file defining regression test cases for an API endpoint with parameters and expected response

ALT Tinybird YAML test file defining regression test cases for an API endpoint with parameters and expected response

1
1
2
281
Define test cases in tests/<pipe>.yaml with parameters and expected JSON. Tinybird spins up a clean local environment and asserts status codes and payloads before you merge: tinybird.co/docs/forward/dev…

tb test | Tinybird

Run and update tests for your Tinybird project

tinybird.co
2
123
Tinybird retweeted
RawTree
@rawtreedbOct 20
No schema upfront doesn't mean typeless. Our LLM app's SDK v2 started sending latency_ms as "1920" instead of 1920. RawTree kept each value's type. avg() and > comparisons skip the strings and return a hint saying so. Nothing silently becomes a wrong number. rawtree.com/docs/guides/inge…
SQL on an llm_calls table where SDK v1 sends latency_ms as 1840 and SDK v2 as the string "1920". avg(latency_ms) returns 2455 with a hint that String rows were skipped. A latency_ms > 2500 filter returns 2 with a similar hint.

ALT SQL on an llm_calls table where SDK v1 sends latency_ms as 1840 and SDK v2 as the string "1920". avg(latency_ms) returns 2455 with a hint that String rows were skipped. A latency_ms > 2500 filter returns 2 with a similar hint.

1
3
248
Sending Bird webhooks to Tinybird takes one Data Source and one URL. The full webhook body lands in a JSON column, so you can query nested fields like event.data.metadata.order_id directly.
Tinybird bird_events_raw.datasource storing each Bird webhook body in a JSON column, with an append-only token

ALT Tinybird bird_events_raw.datasource storing each Bird webhook body in a JSON column, with an append-only token

1
2
238
Then create a Bird webhook that points at the Events API: /v0/events?name=bird_events_raw&format=json&wait=true&token=<token> The token can only append to this Data Source. Prefix it with your region's API host. tinybird.co/docs/forward/gui…

Send Bird webhooks to Tinybird | Tinybird

Send Bird email and messaging events to Tinybird.

tinybird.co
149
Exporting rollups from ClickHouse® to S3 usually involves custom cron jobs, export lambdas, and opaque errors when IAM policies reject writes. In Tinybird, define an S3 Sink pipe in SQL, set a schedule, and let Tinybird handle batch writes.
Tinybird Sink Pipe exporting completed orders to S3 in Parquet format on a scheduled interval

ALT Tinybird Sink Pipe exporting completed orders to S3 in Parquet format on a scheduled interval

1
1
5
513
Partition outputs with templates like orders_{order_date} in Parquet, CSV, or NDJSON. Failed and cancelled runs now surface in tinybird.sinks_ops_log with exact IAM permission errors: tinybird.co/docs/forward/cop…

S3 Sink | Tinybird

Offload data to S3 on a batch-based schedule using Tinybird's fully managed S3 Sink Connector.

tinybird.co
1
232
New guide in the Tinybird docs: send @messagebird webhooks to Tinybird. Point a Bird webhook at the Events API and query email, SMS, WhatsApp, and Apple Messages events with SQL. No server needed. tinybird.co/docs/forward/gui…

Send Bird webhooks to Tinybird | Tinybird

Send Bird email and messaging events to Tinybird.

tinybird.co
2
2
508
ClickHouse® table partitions and TTLs need to align. If you partition by month but set a 30-day TTL, ClickHouse has to rewrite entire part files during merges just to delete expired rows. That burns CPU and disk I/O on background cleanup.
Tinybird .datasource file with aligned partition key, TTL expression, and ttl_only_drop_parts engine setting

ALT Tinybird .datasource file with aligned partition key, TTL expression, and ttl_only_drop_parts engine setting

1
3
461
Match ENGINE_PARTITION_KEY to your TTL and set ttl_only_drop_parts=1 in ENGINE_SETTINGS. ClickHouse drops whole expired partition folders via metadata deletion with zero row rewrites: tinybird.co/docs/forward/dev…

Datasource files | Tinybird

Datasource files describe your data sources. Define the schema, engine, and other settings.

tinybird.co
273
ClickHouse® primary keys are sparse. When your sorting key starts with tenant_id and timestamp, filtering on another column means scanning every index granule across that range. In Tinybird, you add secondary data skipping indexes directly to your .datasource file.
Tinybird .datasource file with secondary data skipping indexes using set and bloom_filter on MergeTree table

ALT Tinybird .datasource file with secondary data skipping indexes using set and bloom_filter on MergeTree table

2
2
416
Use set for status codes and bloom_filter for user IDs. ClickHouse checks the index per granule group and skips unmatching blocks before disk reads. Define them in your datafile: tinybird.co/docs/forward/dev…

Datasource files | Tinybird

Datasource files describe your data sources. Define the schema, engine, and other settings.

tinybird.co
1
212
Tinybird retweeted
RawTree
@rawtreedbOct 16
A web analytics dashboard is a few SQL queries over one events table. Here are three: daily traffic, channels and bots 🧵 xitter.cf/rawtreedb/status/21099…
RawTree
@rawtreedbOct 13
We have the events. What about session replays? They're JSON too. @rrweb_io records the page as a stream of events, so replays can live in RawTree next to your analytics and play back from a SQL query 🧵 xitter.cf/rawtreedb/status/21095…
1
1
3
264
Today the Classic grace period ends. Free Classic Workspaces left after today get deleted, and Developer plans lose UI access. After migrating, data, Tokens, and Endpoint URLs stay the same. tinybird.co/docs/forward/gui…

After migrating from Classic | Tinybird

What changed in your Workspace after migrating to Forward.

tinybird.co
1
2
747
What Forward adds: - Tinybird Local for offline dev - A Cloud Branch per Git branch, with production data - tb test for endpoint regressions - tb deploy --check in CI - Forward queries and staging for schema changes - TypeScript and Python SDKs
437
Your Kafka ingestion config belongs in Git, next to the table it feeds. In Tinybird Forward, a Kafka Data Source is a .datasource file with the schema, topic, and consumer group. Credentials come from tb_secret, not from the file.
Tinybird Kafka Data Source file with schema, MergeTree engine, Kafka connection name, topic, and a consumer group ID read from tb_secret

ALT Tinybird Kafka Data Source file with schema, MergeTree engine, Kafka connection name, topic, and a consumer group ID read from tb_secret

2
1
4
426
Run Tinybird Local and Kafka in one Docker Compose network to consume real messages locally. When producers add a field, edit the schema and run tb deploy --check. tinybird.co/docs/forward/ing…

Kafka connector local development setup | Tinybird

Set up Kafka connector for local development with Docker Compose. Learn environment management, testing strategies, and how to use default values for local Kafka connections.

tinybird.co
1
2
349
Tinybird retweeted
Animesh
@theanimeshsOct 14
When analytics is a crucial part of your product, it is risky to solely depend on external analytics platforms I knew I needed to have my own from day one. So, here's the one I built: custom, real-time analytics powered by @tinybird
Animesh
@theanimeshsOct 14
Listener and Traffic Analytics on FoundrRadio 📻 Channel owners can now see the detailed analytics related to their listeners and traffic coming to their radio channels
2
1
4
608
Customer-facing dashboards often send every chart through a backend proxy, just so nobody can change ?org_id= in the URL. With Tinybird JWTs, the browser calls your API endpoints directly. Your backend signs one token per user session.
JWT payload with a PIPES:READ scope for the tenant_activity endpoint, fixed_params org_id set to acme, and a 10 requests per second limit

ALT JWT payload with a PIPES:READ scope for the tenant_activity endpoint, fixed_params org_id set to acme, and a 10 requests per second limit

1
6
498
fixed_params always win. Pass another org_id in the URL and Tinybird still uses the token's value. As of Oct 2, these Pipes return 403 from the SQL API or other Pipes. Their endpoint is the only way in. tinybird.co/docs/forward/cor…

JSON Web tokens (JWTs) | Tinybird

JWTs are signed tokens that allow you to securely authorize and share data between your application and Tinybird.

tinybird.co
1
170
Load more