Tom Cooper @tomcooper.dev · May 19 After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯
1 likes 1 replies
?
Replies
This was my favourite #Current26 talk of the day, an interesting solution to a unique situation but some ideas that can apply to many other Kafka deployments. I am particularly interested in what we could do in upstream Kafka to make backfilling jobs less disruptive 🤔