Google Cloud Dataflow and Amazon Kinesis are solutions in data processing and analytics. Dataflow is known for handling batch processing while Kinesis focuses on real-time data analytics and scalability, making Kinesis favorable for real-time capabilities.
Features: Google Cloud Dataflow is geared towards large-scale processing with features like autoscaling, a unified programming model, and comprehensive batch processing. Amazon Kinesis offers real-time data streaming, seamless AWS integration, and robust data analytics options, including advanced data streams and firehose capabilities.
Room for Improvement: Google Cloud Dataflow could improve its real-time processing and AWS integration capabilities. Its cost model might be refined for consistent large-scale operations. Amazon Kinesis could benefit from enhanced user interface features, improved support for diverse programming languages, and more streamlined data storage options.
Ease of Deployment and Customer Service: Google Cloud Dataflow is noted for an easy deployment process and thorough documentation, simplifying user onboarding. Amazon Kinesis offers straightforward deployments with excellent AWS ecosystem integration, providing robust infrastructure support and dedicated customer service.
Pricing and ROI: Google Cloud Dataflow operates on a pay-per-use model, which is effective for variable workloads, offering flexibility. Amazon Kinesis uses a pay-as-you-go model as well, providing a more predictable pricing structure, potentially leading to better ROI in consistent high-volume data environments, despite initial costs.
With Lambda, there is no need for data transfer charges, which is beneficial for less frequent workloads.
We receive prompt support from AWS solution architects or TAMs.
The fact that no interaction is needed shows their great support since I don't face issues.
Google's support team is good at resolving issues, especially with large data.
Compared to other support systems, such as those in Braze, Tealium, Google, and others like Adobe, Google Cloud takes more time because it is a bigger company.
I would rate the scalability of Amazon Kinesis as a nine.
Amazon Kinesis provides auto-scaling with streams that handle large volumes well.
Google Cloud Dataflow has auto-scaling capabilities, allowing me to add different machine types based on pace and requirements.
Google Cloud Dataflow can handle large data processing for real-time streaming workloads as they grow, making it a good fit for our business.
As a team lead, I'm responsible for handling five to six applications, but Google Cloud Dataflow seems to handle our use case effectively.
I would rate the stability of Amazon Kinesis as high, giving it a 10.
I have not encountered any issues with the performance of Dataflow, as it is stable and backed by Google services.
The job we built has not failed once over six to seven months.
The automatic scaling feature helps maintain stability.
There is no lack of functions in Amazon Kinesis. Functionality-wise, we feel it's complete.
Amazon Kinesis could improve its pricing to be more competitive, especially for large volumes.
I feel there could be something that they can introduce, such as when we have data in the tables, a feature that creates a unique persona of the user automatically, so we do not have to do that manually.
Outside of Google Cloud Platform, it is problematic for others to use it and may require promotion as an actual technology.
Dealing with a huge volume of data causes failure due to array size.
Amazon Kinesis and Lambda pricing is competitive, but we noticed that scaling and large volumes could potentially increase costs significantly.
It is part of a package received from Google, and they are not charging us too high.
Amazon Kinesis integrates easily with the AWS environment.
Lambda's scalability, seamless integration with other AWS services, and support for multiple programming languages are very beneficial.
It supports multiple programming languages such as Java and Python, enabling flexibility without the need to learn something new.
Google Cloud Dataflow's features for event stream processing allow us to gain various insights like detecting real-time alerts.
I can see what is happening with this script, how many users are affected, whether the script is working, what is failing, and how we can rectify issues with proper monitoring.
| Product | Mindshare (%) |
|---|---|
| Amazon Kinesis | 4.7% |
| Google Cloud Dataflow | 3.9% |
| Other | 91.4% |
| Company Size | Count |
|---|---|
| Small Business | 8 |
| Midsize Enterprise | 10 |
| Large Enterprise | 9 |
| Company Size | Count |
|---|---|
| Small Business | 3 |
| Midsize Enterprise | 2 |
| Large Enterprise | 11 |
Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.
We monitor all Streaming Analytics reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
