Kafka

Kafka is a distributed event storming platform, it is more than a messaging system. It is central hub of the integration architecture.

Kafka is an

• event ledger, keeping track of all the messages that come in
• distributed in nature
• redundant

Use cases

Kafka can be employed for some of the use cases given below

• Asynchronous processing (where synchronization is hard)
• Scaling ETL Jobs
• Processing is error-prone (ex: parsing logic might throw exceptions due to invalid payload data)
• Event Store (to go back to retry and perform certain operations)
• Distributed Processing

Why Kafka?

Ordering

It is important that the delivery of the messages to be in sequential order, ex: Creating Order, Updating order to be in sequential, not in other way.

Horizontal Scaling

Push Vs Pub/Sub