No more typing reviews! Try our Samantha, our new voice AI agent.

Apache Kafka vs Apache Spark Streaming comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Kafka
Ranking in Streaming Analytics
6th
Average Rating
8.2
Reviews Sentiment
6.9
Number of Reviews
92
Ranking in other categories
No ranking in other categories
Apache Spark Streaming
Ranking in Streaming Analytics
5th
Average Rating
7.8
Reviews Sentiment
6.4
Number of Reviews
17
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2026, in the Streaming Analytics category, the mindshare of Apache Kafka is 3.5%, down from 3.8% compared to the previous year. The mindshare of Apache Spark Streaming is 4.7%, up from 3.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics Mindshare Distribution
ProductMindshare (%)
Apache Spark Streaming4.7%
Apache Kafka3.5%
Other91.8%
Streaming Analytics
 

Featured Reviews

Amandeep Pawar - PeerSpot reviewer
Engineer Technology at Iris Software Technologies Private Limited
Event-driven architecture has improved asynchronous communication and supports high throughput
We can improve the high throughput because there are some limitations. We could add something to improve Apache Kafka. Based on my daily usage and analysis, there is a complex setup and management, which is one area requiring improvement. Apache Kafka does not have built-in message delay or scheduling capabilities. Apache Kafka cannot natively schedule messages. Limited message prioritization is also an area requiring improvement. Ordering is limited to a single partition. Large messages affect performance. Apache Kafka is optimized for many small to medium-sized messages, but large payloads increase network usage, increase disk usage, and slow down producers and consumers. I rate Apache Kafka eight out of ten instead of ten out of ten because operating an Apache Kafka cluster requires expertise in partitioning, application monitoring, and capacity planning. Self-managed deployment can become complex as the cluster grows. Pro-managed Apache Kafka services significantly reduce the operational overhead.
Himansu Jena - PeerSpot reviewer
Sr Project Manager at Raj Subhatech
Efficient real-time data management and analysis with advanced features
There are various ways we can improve Apache Spark Streaming through best practices. The initial part requires attention to batch interval tuning, which helps small intervals in micro batches based on latency requirements and helps prevent back pressure. We can use data formats such as Parquet or ORC for storage that needs faster reads and leveraging feature predicate push-down optimizations. We can implement serialization which helps with any Kyro in terms of .NET or Java. We have boxing and unboxing serialization for XML and JSON for converting key-pair values stored in browser. We can also implement caching mechanisms for storing and recomputing multiple operations. We can use specified joins which help with smaller databases, and distributed joins can minimize users. We can implement project optimization memory for CPU efficiency, known as Tungsten. Additionally, load balancing, checkpointing, and schema evaluation are areas to consider based on performance and bottlenecks. We can use Bugzilla tools for tracking and Splunk to monitor the performance of process systems, utilization, and performance based on data frames or data sets.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache Kafka has improved our organization because it's more reliable than Rabbit."
"The solution is stable, and the most fantastic thing about it is its throughput."
"It's a high-performance distributed system."
"The great thing about Apache Kafka is that we can seamlessly scale the application and, based on demand, we can add nodes without shutting down the environment."
"The connectors provided by the solution are valuable."
"The processing power of Apache Kafka is good when you have requirements for high throughput and a large number of consumers."
"The use of Kafka's logging mechanism has been extremely beneficial for us, as it allows us to sequence messages, track pointers, and manage memory without having to create multiple copies."
"Kafka can process messages in real-time, making it useful for applications that require near-instantaneous processing."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"The main benefits of Apache Spark Streaming include cost savings, time savings, and efficiency improvements about data storage."
"Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple."
"The solution is better than average and some of the valuable features include efficiency and stability."
"It's the fastest solution on the market with low latency data on data transformations."
"By integrating Apache Spark Streaming, the data freshness rate, and latency have significantly improved from 24-hour batch processing to less than one minute, facilitating faster communication to downstream systems, aiding marketing campaigns."
"Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services."
"As an open-source solution, using it is basically free."
 

Cons

"For personal preferences, since we use Managed Kafka in AWS, I would appreciate having some kind of UI integrated into Apache Kafka for connecting to it because using code to connect it is basic, but we can use a UI."
"Something that could be improved is having an interface to monitor the consuming rate."
"The solution should be easier to manage. It needs to improve its visualization feature in the next release."
"We struggled a bit with the built-in data transformations because it was a challenge to get them up and running the way we wanted."
"The solution could always add a few more features to enhance its usage."
"The initial setup and deployment could be less complex."
"Pulsar gives more scalability to an even grouping, but Apache Kafka is used more if you want to send something in a time series-based. If this does not matter to you then Pulsar could be more customizable. Apache Kafka is nothing but a streaming system with local storage."
"The interface of Apache Kafka could be significantly better."
"The cost and load-related optimizations are areas where the tool lacks and needs improvement."
"There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused."
"Monitoring is an area where they could definitely improve Apache Spark Streaming. When you have a streaming application, it generates numerous logs. After some time, the logs become meaningless because they're quite large and impossible to open."
"It was resource-intensive, even for small-scale applications."
"The problem is we need to use it in a certain manner. After that, we need to apply another pipeline for the machine learning processes, and that's what we work on."
"The solution itself could be easier to use."
"The debugging aspect could use some improvement."
"In terms of improvement, the UI could be better."
 

Pricing and Cost Advice

"The price of Apache Kafka is good."
"Running a Kafka cluster can be expensive, especially if you need to scale it up to handle large amounts of data."
"Apache Kafka is an open-source solution and there are no fees, but there are fees associated with confluence, which are based on subscription."
"The solution is open source; it's free to use."
"I would not subscribe to the Confluent platform, but rather stay on the free open source version. The extra cost wasn't justified."
"Apache Kafka is free."
"The solution is free, it is open-source."
"It's a bit cheaper compared to other Q applications."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"Spark is an affordable solution, especially considering its open-source nature."
"I was using the open-source community version, which was self-hosted."
"People pay for Apache Spark Streaming as a service."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
922,921 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
14%
Outsourcing Company
13%
Manufacturing Company
11%
Construction Company
8%
Financial Services Firm
14%
Outsourcing Company
14%
Comms Service Provider
8%
Healthcare Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business33
Midsize Enterprise20
Large Enterprise51
By reviewers
Company SizeCount
Small Business9
Midsize Enterprise2
Large Enterprise7
 

Questions from the Community

What are the differences between Apache Kafka and IBM MQ?
Apache Kafka is open source and can be used for free. It has very good log management and has a way to store the data used for analytics. Apache Kafka is very good if you have a high number of user...
What is your experience regarding pricing and costs for Apache Kafka?
Based on my understanding for the setup and cost to set up Apache Kafka, I was not responsible for the pricing or licensing decisions. Apache Kafka itself is open source and free to use. Infrastruc...
What needs improvement with Apache Kafka?
We can improve the high throughput because there are some limitations. We could add something to improve Apache Kafka. Based on my daily usage and analysis, there is a complex setup and management,...
What needs improvement with Apache Spark Streaming?
One of the improvements we need is in Spark SQL and the machine learning library. I don't think there is too much to work on, but the issue is when we want to use machine learning, we always ne...
What is your primary use case for Apache Spark Streaming?
We work with Apache Spark Streaming for our project because we use that as one of the landing data sources, and we work with it to ensure we can get all of the data before it goes through our data ...
What advice do you have for others considering Apache Spark Streaming?
One thing I would share with other organizations considering Apache Spark Streaming is the necessity of having effective data storage. We want to ensure we acquire and manage our data storage effec...
 

Also Known As

No data available
Spark Streaming
 

Overview

 

Sample Customers

Uber, Netflix, Activision, Spotify, Slack, Pinterest
UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
Find out what your peers are saying about Apache Kafka vs. Apache Spark Streaming and other solutions. Updated: September 2026.
922,921 professionals have used our research since 2012.