Support pub-sup. Pipeline streaming, many connectors Review collected by and hosted on G2.com.

Difficult to achieve atomic principles like transaction. Review collected by and hosted on G2.com.

Apache Kafka provides out-of-the-box integration with any programming language, preferably java, and multiple subsequent versions of Kafka solve multiple old problems, making it easy to integrate for data streaming. Review collected by and hosted on G2.com.

The kafka docs needs to be improve such that any new developer can use this easily and any enhancement in version should be clearly mention in docs to avoid here and there searching. Review collected by and hosted on G2.com.

Scalable, accountable, easy to upgrade the security, and easy to maintain the product by own, one message - multiple consumers and UI for checking the message commit Review collected by and hosted on G2.com.

Need configuration for a different version and easy-to-understand document for new users and events to be organized in major cities like Bangalore. Share the knowledge to users Review collected by and hosted on G2.com.

Latency is very low and it's good to use. Kafka is a very good tool if someone is looking for message broker to use please go for it then you will come to know why I'm posting it. Review collected by and hosted on G2.com.

Sometimes Kafka throws some errors in the Kafka portal gui and even if they throw error it's easy to find the room cause of the issue and we can fix it as quickly as possible. Review collected by and hosted on G2.com.

The overall community around Kafka is pretty well established. There are tons of existing open source project that enhance the use cases that just Kafka alone does not provide. Things like celery or flower have integrations for most queues but most projects often start off with Kafka as their primary queue.

It's easy to manage at scale. Review collected by and hosted on G2.com.

One of the use cases where Kafka fails is Exactly once transmission of messages. AWS SQS provides this and is highly competent at that. This is not a very big issue but having two different queues in the same service becomes confusing at times. Review collected by and hosted on G2.com.

Durable and robust. Easy to use with support of many languages Review collected by and hosted on G2.com.

Sometimes it become hard to implement in python Review collected by and hosted on G2.com.

It's good for keeping queue messages always or for some period.

You can use Apache Kafka for big projects where you want to store your messages (actions) and want to come to it later and analyze your data.

I recommend it to use in Event Sourcing architecture where your source of truth is Kafka messages. Review collected by and hosted on G2.com.

It's hard to manage,

The price of Apache. Kafka service is not cheap, if your application needs to have some messaging to transfer some data you need to think about some cloud simple queue messages if it works for you then I recommend using RabidMQ, Amazon Sqs, or Google PubSub Review collected by and hosted on G2.com.

Speed at which it transmits and ability to handle a large number of messages seamlessly. I have used it in scenarios where millions of data were to be communicated between microservices and kafka is able to handle it very well. Review collected by and hosted on G2.com.

No inbuilt retry mechanisms, like after consuming if the server isn't able to process the request and throughs exception, we manually do the retries by putting the same message in the queue again and again. Review collected by and hosted on G2.com.

Low latency - milliseconds & throughtput

Decoupling layer

Unlimited retention

Asynchronous

Kafka's different semantics & latest exactly once guarantee

Fault tolerance HA through replication

Kafka connect connectors integrations

Kstreams topic-topic transforms

KSQL streaming SQL real-time analytics Review collected by and hosted on G2.com.

Ordering issues on late arrival

Data Compression & decompression slows performance in AVRO

Full-fledged Kafka monitoring tool - we need confluent Kafka for this

Setting up the cluster & management, even though coordinating & maintenance done by the zookeeper

Provisioned throughput error, retires,& exception issues if not properly taken care Review collected by and hosted on G2.com.

It is swift and its easy to use, The analytics is very dynamic to get information in real-time.Lightning Fast In-Memory Cluster Computing Framework

Cluster to distribute large data of calculation. Review collected by and hosted on G2.com.

Optimization could be difficult to do as its not happening automatically, not best when we have multiple users.

There could be issues with the File management and with the small files. Review collected by and hosted on G2.com.