A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
The Apache Kafka distributed streaming platform features an architecture that – ironically, given the name – provides application messaging that is markedly clearer and less Kafkaesque when compared ...
A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
Streaming is hot. The demand for real-time data processing is rising, and streaming vendors are proliferating and competing. Apache Kafka is a key component in many data pipeline architectures, mostly ...
In the previous article, we gained an understanding of the main Kafka components and how Kafka consumers work. Now, we’ll see how these contribute to the ability of Kafka to provide extreme ...
Ensuring that distributed systems like Apache Kafka are resilient is crucial to withstanding disruptions, adapting to changing conditions and maintaining essential functions. Those who implement these ...
Life happens as a continuous flow of events (a stream). Ted Dunning and Ellen Friedman describe new designs for streaming data architecture that help you get real-time insights and greatly improve the ...
When the big data movement started it was mostly focused on batch processing. Distributed data storage and querying tools like MapReduce, Hive, and Pig were all designed to process data in batches ...
Event-driven architectures are wonderful. But Kafka was never intended to be a database, and using it as a database won’t solve your problem. It’s a tale as old as time. An enterprise is struggling ...