No more typing reviews! Try our Samantha, our new voice AI agent.

Apache Spark Streaming vs Redpanda comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark Streaming
Ranking in Streaming Analytics
5th
Average Rating
7.8
Reviews Sentiment
6.4
Number of Reviews
17
Ranking in other categories
No ranking in other categories
Redpanda
Ranking in Streaming Analytics
4th
Average Rating
8.6
Reviews Sentiment
6.4
Number of Reviews
14
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of November 2026, in the Streaming Analytics category, the mindshare of Apache Spark Streaming is 4.7%, up from 3.7% compared to the previous year. The mindshare of Redpanda is 2.2%, up from 1.4% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics Mindshare Distribution
ProductMindshare (%)
Redpanda2.2%
Apache Spark Streaming4.7%
Other93.1%
Streaming Analytics
 

Featured Reviews

Himansu Jena - PeerSpot reviewer
Sr Project Manager at Raj Subhatech
Efficient real-time data management and analysis with advanced features
There are various ways we can improve Apache Spark Streaming through best practices. The initial part requires attention to batch interval tuning, which helps small intervals in micro batches based on latency requirements and helps prevent back pressure. We can use data formats such as Parquet or ORC for storage that needs faster reads and leveraging feature predicate push-down optimizations. We can implement serialization which helps with any Kyro in terms of .NET or Java. We have boxing and unboxing serialization for XML and JSON for converting key-pair values stored in browser. We can also implement caching mechanisms for storing and recomputing multiple operations. We can use specified joins which help with smaller databases, and distributed joins can minimize users. We can implement project optimization memory for CPU efficiency, known as Tungsten. Additionally, load balancing, checkpointing, and schema evaluation are areas to consider based on performance and bottlenecks. We can use Bugzilla tools for tracking and Splunk to monitor the performance of process systems, utilization, and performance based on data frames or data sets.
ArpitShah - PeerSpot reviewer
Software Analyst at CLSA
Event streaming has simplified video data cleanup and now powers real-time analytics
One area for improvement is providing more examples. For instance, Redpanda could be more useful as a sink where you get the data and can directly push to S3. While this is possible through the API, there are better and faster ways to do it. You can make a million API calls and accomplish the task in one and a half hours, but the same thing can be done in ten minutes through other methods. These faster approaches are not documented in obvious places. You have to find information scattered across various blogs. Redpanda should collect all the good blogs and best practices and put them in their documentation. This is more about knowledge management and making it easy for users to understand the product for complex use cases. For simple use cases, it is straightforward. We all use the basic pipe functionality. However, providing more examples would be useful. For example, integration with AWS and the AWS ecosystem would be cool.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple."
"It is the most scalable tool that I have seen before."
"Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services."
"With Apache Spark Streaming, you can have multiple kinds of windows; depending on your use case, you can select either a tumbling window, a sliding window, or a static window to determine how much data you want to process at a single point of time."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"As an open-source solution, using it is basically free."
"It's the fastest solution on the market with low latency data on data transformations."
"Apache Spark Streaming has features like checkpointing and Streaming API that are useful."
"The cost savings have been significant."
"Through a lot of benchmarks and whatnot, we found out that on a larger scale, when the latency of the messages is important, not talking about throughput, the latency is important, Redpanda offers a way better latency profile than Apache Kafka."
"Redpanda was simple and fast, so we went with Redpanda and it just works."
"The performance is superb, and the value we are getting for the money we pay is great."
"I would recommend Redpanda to others because it's easy to set up, consumes less resources, and is stable compared to other tools."
"Redpanda has positively impacted my organization by allowing us to move from a batch approach to a more streaming approach for our jobs, which cuts down on our delivery time and allows us to better meet our SLAs for our clients."
"I do want to mention that there was a part of Redpanda where you can configure and create containers with Docker."
"I tested it with ten-plus nodes, and it's highly scalable."
 

Cons

"Monitoring is an area where they could definitely improve Apache Spark Streaming. When you have a streaming application, it generates numerous logs. After some time, the logs become meaningless because they're quite large and impossible to open."
"The solution itself could be easier to use."
"The initial setup is quite complex."
"One improvement I would expect is real-time processing instead of micro-batch or near real-time."
"In terms of improvement, the UI could be better."
"When dealing with various data types including COBOL, Excel, JSON, video, audio, and MPG files, challenges can arise with incomplete or missing values."
"It was resource-intensive, even for small-scale applications."
"The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better."
"When it comes to self-hosting, their documentation could be improved."
"I think Redpanda needs to increase the connector options."
"For me, I was trying to get a lot of data, but I would only get one day's worth of data, even though I asked how I could increase the retention size."
"Redpanda is not the best technology available on the market."
"Redpanda can be improved in several ways, and the more I experiment with the product, the more limitations I find."
"I think Redpanda is overall very good for us, and I am uncertain whether Redpanda can scale to very large companies as we are a medium-sized startup."
"We had one incident that we concluded was a case of memory leak."
"Recently, for the documentation, they've built their own AI chatbot, which is focused on giving you answers based on their documentation. While using that, I did not find it to be very good."
 

Pricing and Cost Advice

"Spark is an affordable solution, especially considering its open-source nature."
"People pay for Apache Spark Streaming as a service."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"I was using the open-source community version, which was self-hosted."
"It's free. Everybody can use it, only support is paid."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
921,774 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
14%
Outsourcing Company
14%
Comms Service Provider
8%
Healthcare Company
6%
Financial Services Firm
16%
Comms Service Provider
13%
Outsourcing Company
9%
Manufacturing Company
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business9
Midsize Enterprise2
Large Enterprise7
By reviewers
Company SizeCount
Small Business8
Midsize Enterprise1
Large Enterprise4
 

Questions from the Community

What needs improvement with Apache Spark Streaming?
One of the improvements we need is in Spark SQL and the machine learning library. I don't think there is too much to work on, but the issue is when we want to use machine learning, we always ne...
What is your primary use case for Apache Spark Streaming?
We work with Apache Spark Streaming for our project because we use that as one of the landing data sources, and we work with it to ensure we can get all of the data before it goes through our data ...
What advice do you have for others considering Apache Spark Streaming?
One thing I would share with other organizations considering Apache Spark Streaming is the necessity of having effective data storage. We want to ensure we acquire and manage our data storage effec...
What is your experience regarding pricing and costs for Redpanda?
Regarding my experience with pricing, setup cost, and licensing for Redpanda, I am exploring the product. If I am convinced about the product and the capabilities, and I am sure I will be because I...
What needs improvement with Redpanda?
Redpanda can be improved in several ways, and the more I experiment with the product, the more limitations I find. I understand that this is about business, and the product should grow, and they ha...
What is your primary use case for Redpanda?
My main use case for Redpanda is primarily for streaming, and I am currently focusing on building data lakehouses because I find them really interesting. Redpanda fits into my data lakehouse setup ...
 

Also Known As

Spark Streaming
No data available
 

Overview

 

Sample Customers

UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
Information Not Available
Find out what your peers are saying about Apache Spark Streaming vs. Redpanda and other solutions. Updated: September 2026.
921,774 professionals have used our research since 2012.