Amazon Kinesis vs Google Cloud Dataflow comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
12,728 views|9,386 comparisons
90% willing to recommend
Google Logo
4,813 views|3,977 comparisons
90% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon Kinesis and Google Cloud Dataflow based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon Kinesis vs. Google Cloud Dataflow Report (Updated: March 2024).
767,667 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable feature is that it has a pretty robust way of capturing things.""The most valuable feature of Amazon Kinesis is real-time data streaming.""Setting Amazon Kinesis up is quick and easy; it only takes a few minutes to configure the necessary settings and start using it.""Kinesis is a fully managed program streaming application. You can manage any infrastructure. It is also scalable. Kinesis can handle any amount of data streaming and process data from hundreds, thousands of processes in every source with very low latency.""The scalability is pretty good.""The solution's technical support is flawless.""The feature that I've found most valuable is the replay. That is one of the most valuable in our business. We are business-to-business so replay was an important feature - being able to replay for 24 hours. That's an important feature.""Great auto-scaling, auto-sharing, and auto-correction features."

More Amazon Kinesis Pros →

"The most valuable features of Google Cloud Dataflow are scalability and connectivity.""The support team is good and it's easy to use.""Google Cloud Dataflow is useful for streaming and data pipelines.""The most valuable features of Google Cloud Dataflow are the integration, it's very simple if you have the complete stack, which we are using. It is overall very easy to use, user-friendly friendly, and cost-effective if you know how to use it. The solution is very flexible for programmers, if you know how to do scripts or program in Python or any other language, it's extremely easy to use.""The best feature of Google Cloud Dataflow is its practical connectedness.""I don't need a server running all the time while using the tool. It is also easy to setup. The product offers a pay-as-you-go service.""It is a scalable solution.""The solution allows us to program in any language we desire."

More Google Cloud Dataflow Pros →

Cons
"Kinesis is good for Amazon Cloud but not as suitable for other cloud vendors.""In general, the pain point for us was that once the data gets into Kinesis there is no way for us to understand what's happening because Kinesis divides everything into shards. So if we wanted to understand what's happening with a particular shard, whether it is published or not, we could not. Even with the logs, if we want to have some kind of logging it is in the shard.""One thing that would be nice would be a policy for increasing the number of Kinesis streams because that's the one thing that's constant. You can change it in real time, but somebody has to change it, or you have to set some kind of meter. So, auto-scaling of adding and removing streams would be nice.""Amazon Kinesis involved a more complex setup and configuration than Azure Event Hub.""Kinesis can be expensive, especially when dealing with large volumes of data.""Snapshot from the the from the the stream of the data analytic I have already on the cloud, do a snapshot to not to make great or to get the data out size of the web service. But to stop the process and restart a few weeks later when I have more data or more available of the client teams.""I think the default settings are far too low.""In order to do a successful setup, the person handling the implementation needs to know the solution very well. You can't just come into it blind and with little to no experience."

More Amazon Kinesis Cons →

"They should do a market survey and then make improvements.""Google Cloud Data Flow can improve by having full simple integration with Kafka topics. It's not that complicated, but it could improve a bit. The UI is easy to use but the experience could be better. There are other tools available that do a better job.""The deployment time could also be reduced.""There are certain challenges regarding the Google Cloud Composer which can be improved.""The technical support has slight room for improvement.""When I deploy the product in local errors, a lot of errors pop up which are not always caught. The solution's error logging is bad. It can take a lot of time to debug the errors. It needs to have better logs.""I would like Google Cloud Dataflow to be integrated with IT data flow and other related services to make it easier to use as it is a complex tool.""The solution's setup process could be more accessible."

More Google Cloud Dataflow Cons →

Pricing and Cost Advice
  • "Under $1,000 per month."
  • "The solution's pricing is fair."
  • "It was actually a fairly high volume we were spending. We were spending about 150 a month."
  • "The fee is based on the number of hours the service is running."
  • "Amazon Kinesis pricing is sometimes reasonable and sometimes could be better, depending on the planning, so it's a five out of ten for me."
  • "In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
  • "The tool's entry price is cheap. However, pricing increases with data volume."
  • "The product falls on a bit of an expensive side."
  • More Amazon Kinesis Pricing and Cost Advice →

  • "The price of the solution depends on many factors, such as how they pay for tools in the company and its size."
  • "Google Cloud is slightly cheaper than AWS."
  • "The tool is cheap."
  • "Google Cloud Dataflow is a cheap solution."
  • "The solution is cost-effective."
  • "On a scale from one to ten, where one is cheap, and ten is expensive, I rate Google Cloud Dataflow's pricing a four out of ten."
  • "On a scale from one to ten, where one is cheap, and ten is expensive, I rate the solution's pricing a seven to eight out of ten."
  • "The solution is not very expensive."
  • More Google Cloud Dataflow Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    767,667 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The solution's technical support is flawless.
    Top Answer:There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required. There is a need to introduce something more into the machine… more »
    Top Answer:The product's installation process is easy...The tool's maintenance part is somewhat easy.
    Top Answer:The authentication part of the product is an area of concern where improvements are required. For some common users, the solution's authentication part is difficult to use. The scalability of the… more »
    Ranking
    2nd
    out of 38 in Streaming Analytics
    Views
    12,728
    Comparisons
    9,386
    Reviews
    8
    Average Words per Review
    562
    Rating
    7.9
    7th
    out of 38 in Streaming Analytics
    Views
    4,813
    Comparisons
    3,977
    Reviews
    10
    Average Words per Review
    308
    Rating
    7.7
    Comparisons
    Also Known As
    Amazon AWS Kinesis, AWS Kinesis, Kinesis
    Google Dataflow
    Learn More
    Overview

    Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

    Google Dataflow is a unified programming model and a managed service for developing and executing a wide range of data processing patterns including ETL, batch computation, and continuous computation. Cloud Dataflow frees you from operational tasks like resource management and performance optimization.
    Sample Customers
    Zillow, Netflix, Sonos
    Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
    Top Industries
    VISITORS READING REVIEWS
    Computer Software Company17%
    Financial Services Firm17%
    Manufacturing Company8%
    Comms Service Provider5%
    VISITORS READING REVIEWS
    Financial Services Firm14%
    Computer Software Company12%
    Retailer11%
    Manufacturing Company10%
    Company Size
    REVIEWERS
    Small Business40%
    Midsize Enterprise30%
    Large Enterprise30%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    REVIEWERS
    Small Business27%
    Midsize Enterprise18%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise72%
    Buyer's Guide
    Amazon Kinesis vs. Google Cloud Dataflow
    March 2024
    Find out what your peers are saying about Amazon Kinesis vs. Google Cloud Dataflow and other solutions. Updated: March 2024.
    767,667 professionals have used our research since 2012.

    Amazon Kinesis is ranked 2nd in Streaming Analytics with 21 reviews while Google Cloud Dataflow is ranked 7th in Streaming Analytics with 10 reviews. Amazon Kinesis is rated 8.0, while Google Cloud Dataflow is rated 7.8. The top reviewer of Amazon Kinesis writes "Used for media streaming and live-streaming data". On the other hand, the top reviewer of Google Cloud Dataflow writes "Easy to use for programmers, user-friendly, and scalable". Amazon Kinesis is most compared with Azure Stream Analytics, Apache Flink, Amazon MSK, Confluent and Apache Spark Streaming, whereas Google Cloud Dataflow is most compared with Databricks, Apache NiFi, Amazon MSK, Spring Cloud Data Flow and Apache Flink. See our Amazon Kinesis vs. Google Cloud Dataflow report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.