Ganesh@ganxesh

Building a streaming database in Rust | Apache Beam Contributor

 Bengaluru, India
github.com/flare-db/flare-db
Joined October 2014
48 Photos and videos
Pinned Tweet
Ganesh@ganxesh
Jun 30
Finally V0.1.0 is here. FlareDB: An Apache Beam native Streaming Database built in Rust 🔥 open.substack.com/pub/ganesh… #rust #database #datastreaming #streamprocessing
1
939
giving data analytics skills to Agents - ganeshsivakumar.substack.com…
18
I feel like some hooks, tools providers are manipulating my agents to use their service a lot 😭
38
my coading can spawn a flaredb instance and run data pipelines on it without my intervention.
1
51
Zed + agent is addictive
65
A stream processing engine is just huge ass state machine.
52
My rust projects are squeezing every last drop of juice in my laptop.
59
extended/remote disk storagepossible?🥲
39
My goal is to make stream processing as simple as what @vercel did for web apps.
45
Momentum is really important, there is huge friction to get back to doing something you were decently good at and stopped for a while. Once you restart, spend some time and overcome the friction, you get back to the level again.
49
GTM and sales are harder than building a database from scratch in Rust.
55
Anthropic has a Apache Beam fork, they their their own release versioned branch, it's a strong single that they use Beam. - github.com/anthropics/beam X can you take me to beam user at anthropic, I'd love to chat

GitHub - anthropics/beam: Apache Beam is a unified programming model for Batch and Streaming data...

Apache Beam is a unified programming model for Batch and Streaming data processing. - anthropics/beam

github.com
68
Thoughts on stream processing: ganeshsivakumar.substack.com…
55
Distribution is fucking hard
49
Coming from java and rust, i fucking hate python and it's annoying that I need to work python for some stuff it's good at.
61
FlareDbIO is out 🚀 read and write to FlareDB using a Beam pipelines and query it with SQL or read the table back into another Beam pipeline try it out - docs.flare-db.com/io

FlareDB I/O - FlareDB

Read from and write to FlareDB tables from an Apache Beam pipeline using FlareDbIO.

docs.flare-db.com
60
You can write data pipelines, run it, store results in same place and query the results in SQL. Next release of FlareDB is super exciting. Star on GitHub - github.com/flare-db/flare-db

GitHub - flare-db/flare-db: Apache Beam native streaming database built in Rust

Apache Beam native streaming database built in Rust - flare-db/flare-db

github.com
91
Met a Rustacean 🦀 at Alappuzha Beach, Kerala, India. #rust
125
Don't appear clueless in a new city
98
Apache Datafusion is having its moment
90
Biggest mistake I did during my first solo trip to Kerala is buying wrong underwear size, it was fucking annoying.
127
Load more