Try our new research platform with insights from 80,000+ expert users

Apache Spark Streaming vs Redpanda comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark Streaming
Ranking in Streaming Analytics
10th
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
No ranking in other categories
Redpanda
Ranking in Streaming Analytics
16th
Average Rating
8.8
Reviews Sentiment
7.8
Number of Reviews
4
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of June 2025, in the Streaming Analytics category, the mindshare of Apache Spark Streaming is 2.7%, down from 3.8% compared to the previous year. The mindshare of Redpanda is 1.0%, up from 0.0% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

Oscar Estorach - PeerSpot reviewer
Versatile and flexible when dealing with large-scale data streams
What I like about Spark is its versatility in supporting multiple languages and that makes it my preferred choice for building scalable and efficient systems, whether it is hooking databases with web applications or handling large-scale data transformations. Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows. It works well in the cloud, and you can structure data using Databricks or Spark, providing flexibility for different projects. Spark Streaming's flexibility shines when dealing with large-scale data streams. It caters to different needs, offering real-time insights for tasks like online sales analytics. The ability to prioritize data streams is valuable, especially for monitoring competitor prices online.
ArpitShah - PeerSpot reviewer
Affordable, easy to deploy, and it is easy to find things on the user interface
We use the libraries in the different programming languages. We use the message format in Avro, convert the data in the format, and pass it on. We have contacted the sales team about the solution. So far, the product fulfills our requirements. We get lots of data. The data flows through Kafka to Redpanda. Then it goes to a database. If our infrastructure goes down for a week, we will not lose data. It is an advantage of Redpanda. I recommend the product to others. We might choose a different solution if we find something cheaper. We used Redpanda because we did not want to self-host our software. Redpanda is a piece of infrastructure. There is not much of a learning curve. Overall, I rate the tool an eight out of ten.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache Spark's capabilities for machine learning are quite extensive and can be used in a low-code way."
"Spark Streaming is critical, quite stable, full-featured, and scalable."
"The solution is better than average and some of the valuable features include efficiency and stability."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"Apache Spark Streaming has features like checkpointing and Streaming API that are useful."
"Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows."
"Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple."
"As an open-source solution, using it is basically free."
"What makes Redpanda superior is its performance since it's written in C++. C++ is pretty much the standard for high-performance applications."
"The UI is modern."
"The cost savings have been significant."
"I tested it with ten-plus nodes, and it's highly scalable."
 

Cons

"We don't have enough experience to be judgmental about its flaws."
"The cost and load-related optimizations are areas where the tool lacks and needs improvement."
"In terms of improvement, the UI could be better."
"We would like to have the ability to do arbitrary stateful functions in Python."
"The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better."
"There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused."
"Integrating event-level streaming capabilities could be beneficial."
"The debugging aspect could use some improvement."
"The command-line tools need to be improved. To quickly check the status of the topics and all."
"The version control mechanism must be improved."
"When it comes to self-hosting, their documentation could be improved."
"Recently, for the documentation, they've built their own AI chatbot, which is focused on giving you answers based on their documentation. While using that, I did not find it to be very good."
 

Pricing and Cost Advice

"People pay for Apache Spark Streaming as a service."
"Spark is an affordable solution, especially considering its open-source nature."
"I was using the open-source community version, which was self-hosted."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"Redpanda is cheaper than its competitors."
"It's free. Everybody can use it, only support is paid."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
859,129 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
26%
Computer Software Company
21%
Manufacturing Company
5%
University
5%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about Apache Spark Streaming?
Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
What needs improvement with Apache Spark Streaming?
We don't have enough experience to be judgmental about its flaws, as we've only used stable features like batch micro-batch. Integration poses no problem; however, I don't use some features and can...
What is your primary use case for Apache Spark Streaming?
We use Spark Streaming in a micro-batch region. It's not a full real-time system, but it offers high performance and low latency.
What is your experience regarding pricing and costs for Redpanda?
Redpanda is actually a commercial platform, but they do provide free versions as well. I've been working only with the free versions.
What needs improvement with Redpanda?
Recently, for the documentation, they've built their own AI chatbot, which is focused on giving you answers based on their documentation. While using that, I did not find it to be very good. Maybe ...
What is your primary use case for Redpanda?
I have worked with Redpanda for the past two to three months. Mainly in the tech industry or software industry, there's a huge rise of streaming data. Redpanda serves as a very reliable and fast me...
 

Also Known As

Spark Streaming
No data available
 

Overview

 

Sample Customers

UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
Information Not Available
Find out what your peers are saying about Apache Spark Streaming vs. Redpanda and other solutions. Updated: June 2025.
859,129 professionals have used our research since 2012.