18 discussions in the community
we're running into complexities with event ordering in kafka. for most of our use cases, partitioning by `userId` gives us good enough ordering guaran...
we're building out a new internal monitoring and observability platform, and we need to store a massive amount of time-series data, roughly a million ...
we're building out a new internal monitoring platform that needs to ingest around 1 million data points per minute from various services and infrastru...
as you get more senior, it feels like the amount of time you spend actually coding shrinks significantly, replaced by more meetings, design reviews, a...
the concept of exactly-once delivery in distributed systems feels like a holy grail. textbooks always say it's impossible, yet kafka advertises exactl...
It's a common challenge: as you get more senior, your calendar fills up with meetings, design reviews, and mentorship, leaving less time for hands-on ...
As a data engineer, I'm increasingly seeing system design rounds tailored for ML engineers. How different are these interviews from traditional backen...
we're building out an internal monitoring platform and dealing with a pretty significant volume of time-series data roughly 1 million data points per ...
event ordering in kafka is always a fun one. we partition by `userId` to ensure order for user-specific events, which works well for things like 'item...
the holy grail of distributed systems always seems to be 'exactly-once delivery,' but textbooks typically say it's impossible. kafka, however, often a...
I'm an SRE, but I'm looking at roles that involve more ML infrastructure. I'm curious how system design interviews differ for ML engineers compared to...
we're exploring building a collaborative editing feature similar to google docs, and the core choice is between operational transformation (ot) and co...
i'm transitioning more into ML infra and recently had a system design interview that felt significantly different from traditional backend ones. for M...
our team is looking into building a google docs-like collaborative editing feature for a data visualization tool. it's a complex problem space, and we...
as i've moved into more senior roles, i've noticed a significant shift towards less hands-on coding and more meetings, design reviews, and mentorship....
we're building a collaborative editing feature for a new developer tool, aiming for something like google docs, and the big architectural decision is ...
The concept of 'exactly-once delivery' in distributed systems is often called a myth in textbooks, yet Kafka claims to achieve it. I'm trying to under...
Kafka's default behavior provides ordering guarantees at the partition level. If you partition your events by `userId`, all events for a specific user...
