Try our new research platform with insights from 80,000+ expert users

Apache NiFi vs Google Cloud Dataflow comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
4.8
Apache NiFi users experience significant time savings and improved efficiency, although exact cost benefits aren't always quantifiable.
Sentiment score
5.6
Google Cloud Dataflow was appreciated for cost savings and time efficiency, though some considered its impact not fully assessable yet.
Thanks to improvements on both our side in how we run processes and enhancements to Apache NiFi, we have reduced the time commitment to almost not needing to interact with Apache NiFi except for minor queue-clearance tasks, allowing it to run smoothly.
Data Engineer at The Kudelski Group
It supports not just ETL but also ELT, allowing us to save significant time.
Team Lead Technical Specialist (Production Support) at a recreational facilities/services company with 11-50 employees
There may be return on investment based on the technology and easily moving our workloads onto Apache NiFi from our previous system.
Senior Consultant - Data Analytics at a comms service provider with 201-500 employees
 

Customer Service

Sentiment score
5.7
Apache NiFi users find support adequate, using documentation and forums, with mixed reviews on official support and positive Cloudera experiences.
Sentiment score
6.6
Google Cloud Dataflow support varies, with users praising technical resolution but highlighting inconsistent response times and accessibility.
The customer support is really good, and they are helpful whenever concerns are posted, responding immediately.
Cloud Data Architect at a healthcare company with 10,001+ employees
Customer support for Apache NiFi has been excellent, with minimal response times whenever we raise cases that cannot be directly addressed by logs.
Team Lead Technical Specialist (Production Support) at a recreational facilities/services company with 11-50 employees
I would rate the customer support of Apache NiFi a 10 on a scale of 1 to 10.
Partner at a tech vendor with 10,001+ employees
The fact that no interaction is needed shows their great support since I don't face issues.
Data Engineer at Accenture
Google's support team is good at resolving issues, especially with large data.
Senior Data Engineer at Accruent
Whenever we have issues, we can consult with Google.
Senior Software Engineer at Dun & Bradstreet
 

Scalability Issues

Sentiment score
6.7
Apache NiFi's scalability varies; some users succeed with clusters, while others struggle without Kubernetes, impacting implementation.
Sentiment score
7.3
Google Cloud Dataflow excels in scalability and efficiency, making it ideal for real-time data processing and dynamic needs.
Depending on the workload we process, it remains stable since at the end of the day, it is just used as an orchestration tool that triggers the job while the heavy lifting is done on Spark servers.
Manager at a tech company with 10,001+ employees
Scaling up is fairly straightforward, provided you manage configurations effectively.
Data Engineer at The Kudelski Group
Based on the workload, more nodes can be added to make a bigger cluster, which enhances the cluster whenever needed.
Cloud Data Architect at a healthcare company with 10,001+ employees
Google Cloud Dataflow has auto-scaling capabilities, allowing me to add different machine types based on pace and requirements.
Data Engineer at Accenture
As a team lead, I'm responsible for handling five to six applications, but Google Cloud Dataflow seems to handle our use case effectively.
Senior Software Engineer at Dun & Bradstreet
Google Cloud Dataflow can handle large data processing for real-time streaming workloads as they grow, making it a good fit for our business.
Senior Data Engineer at Accruent
 

Stability Issues

Sentiment score
7.4
Apache NiFi is generally stable but may face occasional crashes and reliability challenges, especially in distributed environments.
Sentiment score
8.3
Google Cloud Dataflow is stable, reliably handles tasks, and benefits from automatic scaling, with minor issues on complex tasks.
I have seen Apache NiFi crashing at times, which is one of the issues we have faced in production.
Manager at a tech company with 10,001+ employees
Apache NiFi is stable in most cases.
Senior Consultant - Data Analytics at a comms service provider with 201-500 employees
I have not encountered any issues with the performance of Dataflow, as it is stable and backed by Google services.
Data Engineer at Accenture
The job we built has not failed once over six to seven months.
Senior Software Engineer at Dun & Bradstreet
The automatic scaling feature helps maintain stability.
Senior Data Engineer at Accruent
 

Room For Improvement

Apache NiFi needs improved integration, UI, scalability, security features, and seamless CI/CD processes for enhanced usability and efficiency.
Google Cloud Dataflow needs better Kafka integration, improved error logs, reduced startup time, and enhanced Python SDK features.
Apache NiFi should have APIs or connectors that can connect seamlessly to other external entities, whether in the cloud or on-premises, creating a plug-and-play mechanism.
Manager at a tech company with 10,001+ employees
The history of processed files should be more readable so that not only the centralized teams managing Apache NiFi but also application folks who are new to the platform can read how a specific document is traversing through Apache NiFi.
Team Lead Technical Specialist (Production Support) at a recreational facilities/services company with 11-50 employees
The initial error did not indicate it was related to memory or size limitations but appeared as a parsing error or something similar.
Data Engineer at The Kudelski Group
Outside of Google Cloud Platform, it is problematic for others to use it and may require promotion as an actual technology.
Data Engineer at Accenture
Dealing with a huge volume of data causes failure due to array size.
Senior Software Engineer at Dun & Bradstreet
I would like to see improvements in consistency and flexibility for schema design for NoSQL data stored in wide columns.
Senior Data Engineer at Accruent
 

Setup Cost

Apache NiFi is an open-source solution with no setup costs, offering time-saving efficiencies despite potential integration expenses.
Google Cloud Dataflow is praised for cost-effectiveness and scalability, offering competitive pricing influenced by pipeline complexity and company size.
The pricing in Italy is considered a little bit high, but the product is worth it.
Partner at a tech vendor with 10,001+ employees
It is part of a package received from Google, and they are not charging us too high.
Senior Software Engineer at Dun & Bradstreet
 

Valuable Features

Apache NiFi simplifies data flow orchestration with drag-and-drop features, scalability, and integration, enhancing productivity and reliability.
Google Cloud Dataflow offers seamless integration, multi-language support, scalability, and serverless data handling for efficient batch and streaming processes.
Apache NiFi has positively impacted my organization by definitely bridging the gap between the on-premises and cloud interaction until we find a solution to open the firewall for cloud components to directly interact with on-premises services.
Manager at a tech company with 10,001+ employees
Development has improved with a reduction in time spent being the main benefit; before we needed a matter of days to create the ingestion flows, but now it only takes a couple of hours to configure.
Senior Data Engineer at a tech vendor with 10,001+ employees
The ease of use in Apache NiFi has helped my team because anyone can learn how to use it in a short amount of time, so we were able to get a lot of work done.
Senior Consultant - Data Analytics at a comms service provider with 201-500 employees
It supports multiple programming languages such as Java and Python, enabling flexibility without the need to learn something new.
Data Engineer at Accenture
The integration within Google Cloud Platform is very good.
Senior Software Engineer at Dun & Bradstreet
Google Cloud Dataflow's features for event stream processing allow us to gain various insights like detecting real-time alerts.
Senior Data Engineer at Accruent
 

Categories and Ranking

Apache NiFi
Average Rating
7.8
Reviews Sentiment
5.3
Number of Reviews
22
Ranking in other categories
Compute Service (7th)
Google Cloud Dataflow
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
14
Ranking in other categories
Streaming Analytics (10th)
 

Mindshare comparison

Apache NiFi and Google Cloud Dataflow aren’t in the same category and serve different purposes. Apache NiFi is designed for Compute Service and holds a mindshare of 9.5%, up 7.7% compared to last year.
Google Cloud Dataflow, on the other hand, focuses on Streaming Analytics, holds 4.5% mindshare, down 7.8% since last year.
Compute Service Market Share Distribution
ProductMarket Share (%)
Apache NiFi9.5%
AWS Lambda13.8%
AWS Batch12.9%
Other63.8%
Compute Service
Streaming Analytics Market Share Distribution
ProductMarket Share (%)
Google Cloud Dataflow4.5%
Apache Flink12.3%
Databricks10.0%
Other73.2%
Streaming Analytics
 

Featured Reviews

YV
architect with 51-200 employees
Unified data flows have simplified large-scale ingestion and have improved SLA reliability
Improvements can be made in the way of the UI. From the deployment perspective, Git configurations are available in 2.6 versions and 2.0 and later versions of Apache NiFi. Before 2.0, templates had to be created and stored in Apache NiFi Registry, which is available. However, templates still need to be imported and exported manually if moving from one environment to another environment. Even in 2.0 versions, although GitHub configurations are available, how it will function needs to be evaluated. Seamless CI/CD deployments are somewhat tricky and challenging when it comes to Apache NiFi with the proper approvals, moving that flow to another environment, and giving the proper RBAC controls. These are areas that could be improved. Documentation is adequate, but the only pain point is the deployment aspect.
Jana Polianskaja - PeerSpot reviewer
Data Engineer at Accenture
Build Scalable Data Pipelines with Apache Beam and Google Cloud Dataflow
As a data engineer, I find several features of Google Cloud Dataflow particularly valuable. The ability to test solutions locally using Direct Runner is crucial for development, allowing me to validate pipelines without incurring the costs of full Dataflow jobs. The unified programming model for both batch and streaming processing is exceptional - requiring only minor code adjustments to optimize for either mode. This flexibility extends to language support, with robust implementations in both Java and Python, allowing teams to leverage their existing expertise. The platform's comprehensive monitoring capabilities are another standout feature. The intuitive interface, Grafana integration, and extensive service connectivity make troubleshooting and performance tracking highly efficient. Furthermore, seamless integration with Google Cloud Composer (managed Airflow) enables sophisticated orchestration of data pipelines.
report
Use our free recommendation engine to learn which Compute Service solutions are best for your needs.
879,853 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Manufacturing Company
16%
Financial Services Firm
11%
Computer Software Company
11%
University
8%
Financial Services Firm
19%
Manufacturing Company
12%
Retailer
11%
Healthcare Company
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business5
Midsize Enterprise1
Large Enterprise18
By reviewers
Company SizeCount
Small Business3
Midsize Enterprise2
Large Enterprise10
 

Questions from the Community

What is your experience regarding pricing and costs for Apache NiFi?
The experience with pricing, setup cost, and licensing was fine, as the integration with the AWS Marketplace was very good. The pricing in Italy is considered a little bit high, but the product is ...
What needs improvement with Apache NiFi?
I believe Apache NiFi could be improved with easier, out-of-the-box provided monitoring solutions. While Apache NiFi has an API that generates logs, it would be beneficial to have simpler access to...
What is your primary use case for Apache NiFi?
I have been using Apache NiFi virtually daily, as it is part of my main responsibility in my current role. My main use case for Apache NiFi involves integrating various data sources and performing ...
What do you like most about Google Cloud Dataflow?
The product's installation process is easy...The tool's maintenance part is somewhat easy.
What is your experience regarding pricing and costs for Google Cloud Dataflow?
Pricing is normal. It is part of a package received from Google, and they are not charging us too high.
What needs improvement with Google Cloud Dataflow?
It can be improved in several ways. The system could function in an automated fashion and provide suggestions based on past transactions to achieve better scalability. Implementing AI-based suggest...
 

Also Known As

No data available
Google Dataflow
 

Overview

 

Sample Customers

Macquarie Telecom Group, Dovestech, Slovak Telekom, Looker, Hastings Group
Absolutdata, Backflip Studios, Bluecore, Claritics, Crystalloids, Energyworx, GenieConnect, Leanplum, Nomanini, Redbus, Streak, TabTale
Find out what your peers are saying about Amazon Web Services (AWS), Apache, Spot - A Flexera company and others in Compute Service. Updated: January 2026.
879,853 professionals have used our research since 2012.