Amazon Kinesis vs Cloudera DataFlow comparison

Cancel
You must select at least 2 products to compare!
Amazon Web Services (AWS) Logo
12,728 views|9,386 comparisons
90% willing to recommend
Cloudera Logo
1,945 views|1,019 comparisons
66% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Amazon Kinesis and Cloudera DataFlow based on real PeerSpot user reviews.

Find out in this report how the two Streaming Analytics solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Amazon Kinesis vs. Cloudera DataFlow Report (Updated: March 2024).
768,578 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"What I like about Amazon Kinesis is that it's very effective for small businesses. It's a well-managed solution with excellent reporting. Amazon Kinesis is also easy to use, and even a novice developer can work with it, versus Apache Kafka, which requires expertise.""The management and analytics are valuable features.""Setting Amazon Kinesis up is quick and easy; it only takes a few minutes to configure the necessary settings and start using it.""The most valuable feature is that it has a pretty robust way of capturing things.""Great auto-scaling, auto-sharing, and auto-correction features.""What turns out to be most valuable is its integration with Lambda functions because you can process the data as it comes in. As soon as data comes, you'll fire a Lambda function to process a trench of data.""I have worked in companies that build tools in-house. They face scaling challenges.""Kinesis is a fully managed program streaming application. You can manage any infrastructure. It is also scalable. Kinesis can handle any amount of data streaming and process data from hundreds, thousands of processes in every source with very low latency."

More Amazon Kinesis Pros →

"The initial setup was not so difficult""DataFlow's performance is okay.""This solution is very scalable and robust."

More Cloudera DataFlow Pros →

Cons
"The solution has a two-minute maximum time delay for live streaming, which could be reduced.""In general, the pain point for us was that once the data gets into Kinesis there is no way for us to understand what's happening because Kinesis divides everything into shards. So if we wanted to understand what's happening with a particular shard, whether it is published or not, we could not. Even with the logs, if we want to have some kind of logging it is in the shard.""The services which are described in the documentation could use some visual presentation because for someone who is new to the solution the documentation is not easy to follow or beginner friendly and can leave a person feeling helpless.""It would be beneficial if Amazon Kinesis provided document based support on the internet to be able to read the data from the Kinesis site.""One area for improvement in the solution is the file size limitation of 10 Mb. My company works with files with a larger file size. The batch size and throughput also need improvement in Amazon Kinesis.""If there were better documentation on optimal sharding strategies then it would be helpful.""Could include features that make it easier to scale.""Something else to mention is that we use Kinesis with Lambda a lot and the fact that you can only connect one Stream to one Lambda, I find is a limiting factor. I would definitely recommend to remove that constraint."

More Amazon Kinesis Cons →

"Although their workflow is pretty neat, it still requires a lot of transformation coding; especially when it comes to Python and other demanding programming languages.""It is not easy to use the R language. Though I don't know if it's possible, I believe it is possible, but it is not the best language for machine learning.""It's an outdated legacy product that doesn't meet the needs of modern data analysts and scientists."

More Cloudera DataFlow Cons →

Pricing and Cost Advice
  • "Under $1,000 per month."
  • "The solution's pricing is fair."
  • "It was actually a fairly high volume we were spending. We were spending about 150 a month."
  • "The fee is based on the number of hours the service is running."
  • "Amazon Kinesis pricing is sometimes reasonable and sometimes could be better, depending on the planning, so it's a five out of ten for me."
  • "In general, cloud services are very convenient to use, even if we have to pay a bit more, as we know what we are paying for and can focus on other tasks."
  • "The tool's entry price is cheap. However, pricing increases with data volume."
  • "The product falls on a bit of an expensive side."
  • More Amazon Kinesis Pricing and Cost Advice →

  • "DataFlow isn't expensive, but its value for money isn't great."
  • More Cloudera DataFlow Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Streaming Analytics solutions are best for your needs.
    768,578 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:The solution's technical support is flawless.
    Top Answer:There are certain shortcomings in the machine learning capacity offered by the product, making it an area where improvements are required. There is a need to introduce something more into the machine… more »
    Top Answer:The initial setup was not so difficult
    Top Answer:It is not easy to use the R language. Though I don't know if it's possible, I believe it is possible, but it is not the best language for machine learning. This feature could be improved.
    Top Answer:Sometimes I need this workflow to make my modules, not for campaign preparation. It is solely focused on developing quality modules for direct telecommunication companies.
    Ranking
    2nd
    out of 38 in Streaming Analytics
    Views
    12,728
    Comparisons
    9,386
    Reviews
    8
    Average Words per Review
    562
    Rating
    7.9
    13th
    out of 38 in Streaming Analytics
    Views
    1,945
    Comparisons
    1,019
    Reviews
    3
    Average Words per Review
    288
    Rating
    6.7
    Comparisons
    Also Known As
    Amazon AWS Kinesis, AWS Kinesis, Kinesis
    CDF, Hortonworks DataFlow, HDF
    Learn More
    Overview

    Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.

    Cloudera DataFlow (CDF) is a comprehensive edge-to-cloud real-time streaming data platform that gathers, curates, and analyzes data to provide customers with useful insight for immediately actionable intelligence. It resolves issues with real-time stream processing, streaming analytics, data provenance, and data ingestion from IoT devices and other sources that are associated with data in motion. Cloudera DataFlow enables secure and controlled data intake, data transformation, and content routing because it is built entirely on open-source technologies. With regard to all of your strategic digital projects, Cloudera DataFlow enables you to provide a superior customer experience, increase operational effectiveness, and maintain a competitive edge.

    With Cloudera DataFlow, you can take the next step in modernizing your data streams by connecting your on-premises flow management, streams messaging, and stream processing and analytics capabilities to the public cloud.

    Cloudera DataFlow Advantage Features

    Cloudera DataFlow has many valuable key features. Some of the most useful ones include:

    • Edge and flow management: Edge agents and an edge management hub work together to provide the edge management capability. Edge agents can be managed, controlled, and watched over in order to gather information from edge hardware and push intelligence back to the edge. Thousands of edge devices can now be used to design, deploy, run, and monitor edge flow apps. Edge Flow Manager (EFM) is an agent management hub that enables the development, deployment, and monitoring of edge flows on thousands of MiNiFi agents using a graphical flow-based programming model.
    • Streams messaging: The CDF platform guarantees that all ingested data streams can be temporarily buffered so that other applications can use the data as needed. This makes it possible for a business to scale efficiently, as data streams from thousands of origination points start to grow to petabyte sizes. To achieve IoT-scale, streams messaging allows you to buffer large data streams using a publish-subscribe strategy.
    • Stream analytics and processing: The third tenet of the CDF platform is its capacity to analyze incoming data streams in real time and with minimal latency, providing actionable intelligence in the form of predictive and prescriptive insights. This stage is essential to completing the Data-in-Motion lifecycle for an enterprise because there is only a use in absorbing all real-time streams if something useful is done with them in the moment to benefit your company.
    • Shared Data Experience (SDX): The most crucial component that transforms CDF into a genuine platform is Cloudera Data Platform's SDX. It is a powerful data fabric that offers the broadest possible deployment flexibility and guarantees total security, governance, and control across infrastructures. You get a single experience for security (with Apache Ranger), governance (with Apache Atlas), and data lineage from edge to cloud because all the CDF components seamlessly connect with SDX.

    Cloudera DataFlow Advantage Benefits

    There are many benefits to implementing Cloudera DataFlow . Some of the biggest advantages the solution offers include:

    • Completely open source: Invest in your architecture with confidence, knowing that there will be no vendor lock-in.
    • More than 300 pre-built processors: This is the only product that provides edge-to-cloud connection this comprehensive as well as a no-code user experience
    • Integrated data provenance: The market's only platform that offers out-of-the-box, end-to-end data lineage tracking and provenance across MiNiFi, NiFi, Kafka, Flink, and more.
    • Multiple stream processing engines to choose from: Supports Spark structured streaming, Kafka Streams, and Apache Flink for real-time insights and predictive analytics.
    • Hundred of Kafka consumers: Cloudera has hundreds of satisfied customers who receive exceptional support for their complex Kafka implementations.
    • Use cases for edge IoT: IoT data from thousands of endpoints may be easily collected, processed, and managed from the edge to the cloud with a multi-cloud/hybrid cloud strategy.
    • Hybrid/multi-cloud approach: Choose a flexible deployment option for your streaming architecture that spans across edge, on-premises, and various cloud environments with ease thanks to the power of CDP.

    Sample Customers
    Zillow, Netflix, Sonos
    Clearsense
    Top Industries
    REVIEWERS
    Computer Software Company29%
    Media Company29%
    Transportation Company14%
    Non Tech Company14%
    VISITORS READING REVIEWS
    Computer Software Company17%
    Financial Services Firm17%
    Manufacturing Company8%
    Comms Service Provider5%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Financial Services Firm14%
    University8%
    Government7%
    Company Size
    REVIEWERS
    Small Business36%
    Midsize Enterprise36%
    Large Enterprise27%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise12%
    Large Enterprise67%
    VISITORS READING REVIEWS
    Small Business15%
    Midsize Enterprise10%
    Large Enterprise74%
    Buyer's Guide
    Amazon Kinesis vs. Cloudera DataFlow
    March 2024
    Find out what your peers are saying about Amazon Kinesis vs. Cloudera DataFlow and other solutions. Updated: March 2024.
    768,578 professionals have used our research since 2012.

    Amazon Kinesis is ranked 2nd in Streaming Analytics with 21 reviews while Cloudera DataFlow is ranked 13th in Streaming Analytics with 3 reviews. Amazon Kinesis is rated 8.0, while Cloudera DataFlow is rated 6.6. The top reviewer of Amazon Kinesis writes "Used for media streaming and live-streaming data". On the other hand, the top reviewer of Cloudera DataFlow writes "A scalable and robust platform for analyzing data". Amazon Kinesis is most compared with Azure Stream Analytics, Apache Flink, Amazon MSK, Confluent and Google Cloud Dataflow, whereas Cloudera DataFlow is most compared with Databricks, Confluent, Amazon MSK, Spring Cloud Data Flow and Informatica Data Engineering Streaming. See our Amazon Kinesis vs. Cloudera DataFlow report.

    See our list of best Streaming Analytics vendors.

    We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.