building systems • low performance athlete at @strava

Prototyping is cheaper than ever, so I tried to imagine the simplest possible ClickHouse service. The result is a side project called ClickHamlet. You run: clickhouse client --host cloud.clickhamlet.com --secure --user <name> --password And that's it. No sign-up form, real ClickHouse in the cloud.
4
3
6
799
Your servers start on the first query and stop when you're done, so an idle database runs nothing. Reads and writes go to separate servers sharing the same storage, so heavy dashboards don't slow down ingestion.
1
152
Your first login creates your service, and you have 2 days to claim it from the dashboard link. It's in early preview. Try it, break it, and tell me what's missing. clickhamlet.com
119
Jordi Villar retweeted
spent the weekend making my side project's query path faster, measuring every step and re-running all of it on one machine: 443 → 2,209 queries/s through the router (5×) 2.39 → 0.31 ms of controller CPU per query (7.7× less) no single big fix, just small changes that add up
2
3
13
1,794
spent the weekend making my side project's query path faster, measuring every step and re-running all of it on one machine: 443 → 2,209 queries/s through the router (5×) 2.39 → 0.31 ms of controller CPU per query (7.7× less) no single big fix, just small changes that add up
2
3
13
1,794
update: it's always the connection pool. the router was opening a new connection to clickhouse for every query. pooling them took it from 2,200 to 2,713 queries/s, 6× the baseline now
1
115
imagine running your own dedicated ClickHouse cluster like this:
3
1
10
1,437
next time the pager goes off at 4:17am for a disk at 95% i'll remember someone's on call for a data center that got hit by a drone. could be worse
Ukraine hits another Yandex data center in Russia and Cloudflare data shows Russian bot traffic dropping dramatically. Might have an impact right before the November elections.
1
4
610
cómo pasar de usar bases de datos a construirlas: deja de configurarlas y empieza a leer por qué van lentas. lo demás viene solo 🧵
4
4
24
4,242
y para rellenar los huecos, la teoría. con contexto de producción, los papers y las clases de bases de datos se leen de otra forma
1
328
resumen: la mayoría de las ofertas de "infra" van de yaml. si quieres trabajar en el motor, el camino pasa por su código, no por su configuración
2
321
Jordi Villar retweeted
After being away from LinkedIn (well, everywhere) for several years, I’m catching up. What makes me happiest is seeing people I met at Tinybird building their own startups or doing incredible things at top companies. It’s such a joy to come across these stories.
3
17
966
wen rusty rails?
Been running a beta version of Campfire rewritten in Rust today! The code itself is still ugly as sin, and 6x as verbose, but the conversion was free*, and I never had to look at the Rust directly, so this is awesome 🤩 github.com/basecamp/once-cam…
1
1
481
what if you create a newsletter explaining any concept you want to learn about? you describe what you want to learn about, subscribe to it and each morning you receive a new piece: fascicle.jordivillar.com
4
2
10
993
today I have been testing @rawtreedb in more detail while working on a new project and it's amazing. seeing the sorting keys each part gets is the magic I was missing in previous versions. terrific job!
3
15
2,881
Jordi Villar retweeted
i've written a huge wall of text about all the optimizations i've done in a ClickHouse cluster to bring queries from 85s to 400ms because we all are here to talk about how good we are in our jobs, don't we?
14
4
35
5,162