Try our new research platform with insights from 80,000+ expert users

Amazon Kinesis vs Google Cloud Dataflow comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 17, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Amazon Kinesis
Ranking in Streaming Analytics
2nd
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
27
Ranking in other categories
No ranking in other categories
Google Cloud Dataflow
Ranking in Streaming Analytics
7th
Average Rating
8.0
Reviews Sentiment
7.3
Number of Reviews
13
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of May 2025, in the Streaming Analytics category, the mindshare of Amazon Kinesis is 8.3%, down from 13.6% compared to the previous year. The mindshare of Google Cloud Dataflow is 7.1%, down from 7.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Streaming Analytics
 

Featured Reviews

Rajni Kumar Jha - PeerSpot reviewer
Used for media streaming and live-streaming data
It is not compulsory to use Amazon Kinesis. If you don't want to use the data streaming, you can use just the Kinesis data firehose. Using the Kinesis data firehose is compulsory because we can't store all chats and recordings in Amazon S3 without it. When a call comes in the Amazon Kinesis instance, it will go to Data Streams if we use it. Otherwise, it will go to the Kinesis data firehose, where we need to define the S3 bucket path, and it will go to Amazon S3. So, without the Kinesis data firehose, we can't store all the chats and recordings in Amazon S3. Using Amazon Kinesis totally depends upon the user's requirements. If you want to use live streaming for the data lake or data analyst team, you need to use Amazon Kinesis. If you don't want to use it, you can directly use the Kinesis data firehose, which will be stored in Amazon S3. Overall, I rate the solution an eight out of ten.
Jana Polianskaja - PeerSpot reviewer
Build Scalable Data Pipelines with Apache Beam and Google Cloud Dataflow
As a data engineer, I find several features of Google Cloud Dataflow particularly valuable. The ability to test solutions locally using Direct Runner is crucial for development, allowing me to validate pipelines without incurring the costs of full Dataflow jobs. The unified programming model for both batch and streaming processing is exceptional - requiring only minor code adjustments to optimize for either mode. This flexibility extends to language support, with robust implementations in both Java and Python, allowing teams to leverage their existing expertise. The platform's comprehensive monitoring capabilities are another standout feature. The intuitive interface, Grafana integration, and extensive service connectivity make troubleshooting and performance tracking highly efficient. Furthermore, seamless integration with Google Cloud Composer (managed Airflow) enables sophisticated orchestration of data pipelines.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The integration capabilities of the product are good."
"I have worked in companies that build tools in-house. They face scaling challenges."
"The feature that I've found most valuable is the replay. That is one of the most valuable in our business. We are business-to-business so replay was an important feature - being able to replay for 24 hours. That's an important feature."
"The scalability is pretty good."
"What I like about Amazon Kinesis is that it's very effective for small businesses. It's a well-managed solution with excellent reporting. Amazon Kinesis is also easy to use, and even a novice developer can work with it, versus Apache Kafka, which requires expertise."
"I find almost all features valuable, especially the timing and fast pace movement."
"There is no problem with the tool's stability."
"I like the ease of use and how we can quickly get the configurations done, making it pretty straightforward and stable."
"The integration within Google Cloud Platform is very good."
"I would rate the overall solution a ten out of ten."
"Google Cloud Dataflow is useful for streaming and data pipelines."
"Google's support team is good at resolving issues, especially with large data."
"The service is relatively cheap compared to other batch-processing engines."
"The most valuable features of Google Cloud Dataflow are the integration, it's very simple if you have the complete stack, which we are using. It is overall very easy to use, user-friendly friendly, and cost-effective if you know how to use it. The solution is very flexible for programmers, if you know how to do scripts or program in Python or any other language, it's extremely easy to use."
"The most valuable features of Google Cloud Dataflow are scalability and connectivity."
"It allows me to test solutions locally using runners like Direct Runner without having to start a Dataflow job, which can be costly."
 

Cons

"Amazon Kinesis involved a more complex setup and configuration than Azure Event Hub."
"Could include features that make it easier to scale."
"It would be beneficial if Amazon Kinesis provided document based support on the internet to be able to read the data from the Kinesis site."
"In general, the pain point for us was that once the data gets into Kinesis there is no way for us to understand what's happening because Kinesis divides everything into shards. So if we wanted to understand what's happening with a particular shard, whether it is published or not, we could not. Even with the logs, if we want to have some kind of logging it is in the shard."
"The solution has a two-minute maximum time delay for live streaming, which could be reduced."
"Lacks first in, first out queuing."
"The tool should focus on having an alert system rather than having to use a third-party solution."
"I think the default settings are far too low."
"Google Cloud Dataflow should include a little cost optimization."
"They should do a market survey and then make improvements."
"I would like to see improvements in consistency and flexibility for schema design for NoSQL data stored in wide columns."
"When I deploy the product in local errors, a lot of errors pop up which are not always caught. The solution's error logging is bad. It can take a lot of time to debug the errors. It needs to have better logs."
"I would like Google Cloud Dataflow to be integrated with IT data flow and other related services to make it easier to use as it is a complex tool."
"Google Cloud Data Flow can improve by having full simple integration with Kafka topics. It's not that complicated, but it could improve a bit. The UI is easy to use but the experience could be better. There are other tools available that do a better job."
"The deployment time could also be reduced."
"The technical support has slight room for improvement."
 

Pricing and Cost Advice

"I rate the product price a five on a scale of one to ten, where one is cheap, and ten is expensive."
"In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
"I think for us, with Amazon Kinesis, if we have to set up our own Kafka or cluster, it will be very time-consuming. If one considers the aforementioned aspect, Amazon Kinesis is a cheap tool."
"It was actually a fairly high volume we were spending. We were spending about 150 a month."
"Amazon Kinesis is an expensive solution."
"The tool's pricing is cheap."
"The product falls on a bit of an expensive side."
"Under $1,000 per month."
"The solution is not very expensive."
"Google Cloud is slightly cheaper than AWS."
"The solution is cost-effective."
"The price of the solution depends on many factors, such as how they pay for tools in the company and its size."
"On a scale from one to ten, where one is cheap, and ten is expensive, I rate Google Cloud Dataflow's pricing a four out of ten."
"The tool is cheap."
"On a scale from one to ten, where one is cheap, and ten is expensive, I rate the solution's pricing a seven to eight out of ten."
"Google Cloud Dataflow is a cheap solution."
report
Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
849,686 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
18%
Financial Services Firm
17%
Manufacturing Company
10%
Retailer
5%
Financial Services Firm
17%
Manufacturing Company
12%
Retailer
11%
Computer Software Company
10%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about Amazon Kinesis?
Amazon Kinesis's main purpose is to provide near real-time data streaming at a consistent 2Mbps rate, which is really impressive.
What is your experience regarding pricing and costs for Amazon Kinesis?
Amazon Kinesis is moderately priced. In comparison with other competitors, it is fairly priced, however, if they reduced the price a little, it could add more value to customers.
What needs improvement with Amazon Kinesis?
I do not see any scope for improvement as it does what it is supposed to do. No changes are required. Since it's predominantly a back-end service, any end-user isn't going to interact with it direc...
What do you like most about Google Cloud Dataflow?
The product's installation process is easy...The tool's maintenance part is somewhat easy.
What is your experience regarding pricing and costs for Google Cloud Dataflow?
Pricing is normal. It is part of a package received from Google, and they are not charging us too high.
What needs improvement with Google Cloud Dataflow?
I am not sure, as we built only one job, and it is running on a daily basis. Everything else is managed using BigQuery schedulers and Talend. However, occasionally, dealing with a huge volume of da...
 

Also Known As

Amazon AWS Kinesis, AWS Kinesis, Kinesis
Google Dataflow
 

Overview

 

Sample Customers

Zillow, Netflix, Sonos
Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
Find out what your peers are saying about Amazon Kinesis vs. Google Cloud Dataflow and other solutions. Updated: April 2025.
849,686 professionals have used our research since 2012.