Prototyping is cheaper than ever, so I tried to imagine the simplest possible ClickHouse service.
The result is a side project called ClickHamlet. You run:
clickhouse client --host cloud.clickhamlet.com --secure --user <name> --password
And that's it. No sign-up form, real ClickHouse in the cloud.
Your servers start on the first query and stop when you're done, so an idle database runs nothing.
Reads and writes go to separate servers sharing the same storage, so heavy dashboards don't slow down ingestion.
Your first login creates your service, and you have 2 days to claim it from the dashboard link.
It's in early preview. Try it, break it, and tell me what's missing.
clickhamlet.com
spent the weekend making my side project's query path faster, measuring every step and re-running all of it on one machine:
443 → 2,209 queries/s through the router (5×)
2.39 → 0.31 ms of controller CPU per query (7.7× less)
no single big fix, just small changes that add up
spent the weekend making my side project's query path faster, measuring every step and re-running all of it on one machine:
443 → 2,209 queries/s through the router (5×)
2.39 → 0.31 ms of controller CPU per query (7.7× less)
no single big fix, just small changes that add up
update: it's always the connection pool.
the router was opening a new connection to clickhouse for every query. pooling them took it from 2,200 to 2,713 queries/s, 6× the baseline now
Ukraine hits another Yandex data center in Russia and Cloudflare data shows Russian bot traffic dropping dramatically. Might have an impact right before the November elections.
After being away from LinkedIn (well, everywhere) for several years, I’m catching up. What makes me happiest is seeing people I met at Tinybird building their own startups or doing incredible things at top companies.
It’s such a joy to come across these stories.
Been running a beta version of Campfire rewritten in Rust today! The code itself is still ugly as sin, and 6x as verbose, but the conversion was free*, and I never had to look at the Rust directly, so this is awesome 🤩 github.com/basecamp/once-cam…
what if you create a newsletter explaining any concept you want to learn about?
you describe what you want to learn about, subscribe to it and each morning you receive a new piece:
fascicle.jordivillar.com
today I have been testing @rawtreedb in more detail while working on a new project and it's amazing.
seeing the sorting keys each part gets is the magic I was missing in previous versions. terrific job!
i've written a huge wall of text about all the optimizations i've done in a ClickHouse cluster to bring queries from 85s to 400ms
because we all are here to talk about how good we are in our jobs, don't we?