GopherCon 2023: Akshay Shah - Leveraging Protobuf Schemas in Kafka with Go

Kafka is arguably the most popular data streaming platform valued for its performance, scalability, and flexibility. This adaptability, however, comes at a price: no built-in contracts between producers and consumers often lead to data loss when breaking changes are made to the shape of the data. We’re going to demonstrate how to use Protocol Buffers to efficiently provide structure to our data and utilize registries to share these schemas between producers and consumers in Go.