Try our new research platform with insights from 80,000+ expert users

Apache Spark Streaming vs Redpanda comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache Spark Streaming
Ranking in Streaming Analytics
10th
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
No ranking in other categories
Redpanda
Ranking in Streaming Analytics
15th
Average Rating
8.8
Reviews Sentiment
7.8
Number of Reviews
4
Ranking in other categories
No ranking in other categories
 

Featured Reviews

AbhishekGupta - PeerSpot reviewer
Easy integration, beneficial auto-scaling, and good open-sourced support community
The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better. Apache Spark Streaming does not have auto-tuning. A customer needs to invest a lot, in terms of management and maintenance.
Vishal M Godi - PeerSpot reviewer
High-performance message brokering with excellent documentation and an easy setup
The industry standard for this kind of platform is Kafka. Confluent Kafka has acquired it. Kafka is an open-source platform built by Apache. Confluent is the commercial version of it. The major improvement of Redpanda over Kafka is firstly, good documentation. Redpanda's documentation is very easily understandable, and they have a lot of examples. In addition to that, most of the setups include using another technology called Docker, which I am very familiar with. Setting up technologies using Docker is very convenient to me, and Redpanda has provided many templates for that. Redpanda has its own built-in metrics exporter, making it easier to monitor and check performance. What makes Redpanda superior is its performance since it's written in C++. C++ is pretty much the standard for high-performance applications.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache Spark's capabilities for machine learning are quite extensive and can be used in a low-code way."
"The platform’s most valuable feature for processing real-time data is its ability to handle continuous data streams."
"The solution is very stable and reliable."
"As an open-source solution, using it is basically free."
"Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services."
"Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows."
"Spark Streaming is critical, quite stable, full-featured, and scalable."
"It's the fastest solution on the market with low latency data on data transformations."
"I tested it with ten-plus nodes, and it's highly scalable."
"What makes Redpanda superior is its performance since it's written in C++. C++ is pretty much the standard for high-performance applications."
"The cost savings have been significant."
"The UI is modern."
 

Cons

"The solution itself could be easier to use."
"We don't have enough experience to be judgmental about its flaws."
"The debugging aspect could use some improvement."
"The initial setup is quite complex."
"The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better."
"The cost and load-related optimizations are areas where the tool lacks and needs improvement."
"It was resource-intensive, even for small-scale applications."
"Integrating event-level streaming capabilities could be beneficial."
"Recently, for the documentation, they've built their own AI chatbot, which is focused on giving you answers based on their documentation. While using that, I did not find it to be very good."
"The version control mechanism must be improved."
"The command-line tools need to be improved. To quickly check the status of the topics and all."
"When it comes to self-hosting, their documentation could be improved."
 

Pricing and Cost Advice

"Spark is an affordable solution, especially considering its open-source nature."
"On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
"People pay for Apache Spark Streaming as a service."
"I was using the open-source community version, which was self-hosted."
"It's free. Everybody can use it, only support is paid."
"Redpanda is cheaper than its competitors."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
850,028 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
28%
Computer Software Company
20%
Manufacturing Company
6%
Healthcare Company
4%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about Apache Spark Streaming?
Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
What needs improvement with Apache Spark Streaming?
We don't have enough experience to be judgmental about its flaws, as we've only used stable features like batch micro-batch. Integration poses no problem; however, I don't use some features and can...
What is your primary use case for Apache Spark Streaming?
We use Spark Streaming in a micro-batch region. It's not a full real-time system, but it offers high performance and low latency.
What is your experience regarding pricing and costs for Redpanda?
Redpanda is actually a commercial platform, but they do provide free versions as well. I've been working only with the free versions.
What needs improvement with Redpanda?
Recently, for the documentation, they've built their own AI chatbot, which is focused on giving you answers based on their documentation. While using that, I did not find it to be very good. Maybe ...
What is your primary use case for Redpanda?
I have worked with Redpanda for the past two to three months. Mainly in the tech industry or software industry, there's a huge rise of streaming data. Redpanda serves as a very reliable and fast me...
 

Also Known As

Spark Streaming
No data available
 

Overview

 

Sample Customers

UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
Information Not Available
Find out what your peers are saying about Apache Spark Streaming vs. Redpanda and other solutions. Updated: April 2025.
850,028 professionals have used our research since 2012.