Apache Spark Streaming vs Google Cloud Dataflow comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
4,104 views|3,301 comparisons
88% willing to recommend
Google Logo
4,763 views|3,959 comparisons
90% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache Spark Streaming and Google Cloud Dataflow based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache Spark Streaming vs. Google Cloud Dataflow Report (Updated: March 2024).
769,630 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It's the fastest solution on the market with low latency data on data transformations.""Apache Spark Streaming was straightforward in terms of maintenance. It was actively developed, and migrating from an older to a newer version was quite simple.""The solution is very stable and reliable.""Apache Spark Streaming's most valuable feature is near real-time analytics. The developers can build APIs easily for a code-steaming pipeline. The solutions have an ecosystem of integration with other stock services.""The solution is better than average and some of the valuable features include efficiency and stability.""As an open-source solution, using it is basically free.""Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.""Apache Spark Streaming has features like checkpointing and Streaming API that are useful."

More Apache Spark Streaming Pros →

"I don't need a server running all the time while using the tool. It is also easy to setup. The product offers a pay-as-you-go service.""The solution allows us to program in any language we desire.""The service is relatively cheap compared to other batch-processing engines.""The support team is good and it's easy to use.""The best feature of Google Cloud Dataflow is its practical connectedness.""Google Cloud Dataflow is useful for streaming and data pipelines.""The most valuable features of Google Cloud Dataflow are scalability and connectivity.""The most valuable features of Google Cloud Dataflow are the integration, it's very simple if you have the complete stack, which we are using. It is overall very easy to use, user-friendly friendly, and cost-effective if you know how to use it. The solution is very flexible for programmers, if you know how to do scripts or program in Python or any other language, it's extremely easy to use."

More Google Cloud Dataflow Pros →

Cons
"There could be an improvement in the area of the user configuration section, it should be less developer-focused and more business user-focused.""The service structure of Apache Spark Streaming can improve. There are a lot of issues with memory management and latency. There is no real-time analytics. We recommend it for the use cases where there is a five-second latency, but not for a millisecond, an IOT-based, or the detection anomaly-based. Flink as a service is much better.""The initial setup is quite complex.""In terms of improvement, the UI could be better.""The cost and load-related optimizations are areas where the tool lacks and needs improvement.""We would like to have the ability to do arbitrary stateful functions in Python.""The solution itself could be easier to use.""It was resource-intensive, even for small-scale applications."

More Apache Spark Streaming Cons →

"Google Cloud Dataflow should include a little cost optimization.""The solution's setup process could be more accessible.""Google Cloud Data Flow can improve by having full simple integration with Kafka topics. It's not that complicated, but it could improve a bit. The UI is easy to use but the experience could be better. There are other tools available that do a better job.""When I deploy the product in local errors, a lot of errors pop up which are not always caught. The solution's error logging is bad. It can take a lot of time to debug the errors. It needs to have better logs.""The deployment time could also be reduced.""I would like Google Cloud Dataflow to be integrated with IT data flow and other related services to make it easier to use as it is a complex tool.""They should do a market survey and then make improvements.""The authentication part of the product is an area of concern where improvements are required."

More Google Cloud Dataflow Cons →

Pricing and Cost Advice
  • "People pay for Apache Spark Streaming as a service."
  • "I was using the open-source community version, which was self-hosted."
  • "On a scale from one to ten, where one is expensive, or not cost-effective, and ten is cheap, I rate the price a seven."
  • More Apache Spark Streaming Pricing and Cost Advice →

  • "The price of the solution depends on many factors, such as how they pay for tools in the company and its size."
  • "Google Cloud is slightly cheaper than AWS."
  • "The tool is cheap."
  • "Google Cloud Dataflow is a cheap solution."
  • "The solution is cost-effective."
  • "On a scale from one to ten, where one is cheap, and ten is expensive, I rate Google Cloud Dataflow's pricing a four out of ten."
  • "On a scale from one to ten, where one is cheap, and ten is expensive, I rate the solution's pricing a seven to eight out of ten."
  • "The solution is not very expensive."
  • More Google Cloud Dataflow Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    769,630 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Apache Spark Streaming is versatile. You can use it for competitive intelligence, gathering data from competitors, or for internal tasks like monitoring workflows.
    Top Answer:In terms of improvement, the UI could be better. Additionally, Spark Streaming works well for various use cases, but improvements could be made for ultra-fast scenarios where seconds matter. While… more »
    Top Answer:As a data engineer, I use Apache Spark Streaming to process real-time data for web page analytics and integrate diverse data sources into centralized data warehouses.
    Top Answer:The product's installation process is easy...The tool's maintenance part is somewhat easy.
    Top Answer:The authentication part of the product is an area of concern where improvements are required. For some common users, the solution's authentication part is difficult to use. The scalability of the… more »
    Ranking
    8th
    out of 38 in Streaming Analytics
    Views
    4,104
    Comparisons
    3,301
    Reviews
    5
    Average Words per Review
    502
    Rating
    8.2
    7th
    out of 38 in Streaming Analytics
    Views
    4,763
    Comparisons
    3,959
    Reviews
    10
    Average Words per Review
    308
    Rating
    7.7
    Comparisons
    Also Known As
    Spark Streaming
    Google Dataflow
    Learn More
    Overview

    Spark Streaming makes it easy to build scalable fault-tolerant streaming applications.

    Google Dataflow is a unified programming model and a managed service for developing and executing a wide range of data processing patterns including ETL, batch computation, and continuous computation. Cloud Dataflow frees you from operational tasks like resource management and performance optimization.
    Sample Customers
    UC Berkeley AMPLab, Amazon, Alibaba Taobao, Kenshoo, eBay Inc.
    Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
    Top Industries
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company19%
    Comms Service Provider7%
    Manufacturing Company5%
    VISITORS READING REVIEWS
    Financial Services Firm14%
    Computer Software Company12%
    Retailer11%
    Manufacturing Company10%
    Company Size
    REVIEWERS
    Small Business60%
    Midsize Enterprise10%
    Large Enterprise30%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise11%
    Large Enterprise68%
    REVIEWERS
    Small Business27%
    Midsize Enterprise18%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise12%
    Large Enterprise72%
    Buyer's Guide
    Apache Spark Streaming vs. Google Cloud Dataflow
    March 2024
    Find out what your peers are saying about Apache Spark Streaming vs. Google Cloud Dataflow and other solutions. Updated: March 2024.
    769,630 professionals have used our research since 2012.

    Apache Spark Streaming is ranked 8th in Streaming Analytics with 8 reviews while Google Cloud Dataflow is ranked 7th in Streaming Analytics with 10 reviews. Apache Spark Streaming is rated 8.0, while Google Cloud Dataflow is rated 7.8. The top reviewer of Apache Spark Streaming writes "Easy integration, beneficial auto-scaling, and good open-sourced support community". On the other hand, the top reviewer of Google Cloud Dataflow writes "Easy to use for programmers, user-friendly, and scalable". Apache Spark Streaming is most compared with Amazon Kinesis, Spring Cloud Data Flow, Azure Stream Analytics, Confluent and Apache Pulsar, whereas Google Cloud Dataflow is most compared with Databricks, Apache NiFi, Amazon MSK, Amazon Kinesis and Spring Cloud Data Flow. See our Apache Spark Streaming vs. Google Cloud Dataflow report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.