AWS Batch vs Apache NiFi comparison

Apache NiFi

Read 11 Apache NiFi reviews

3,391 Views
1,619 Comparison Views

90% willing to recommend

AWS Batch

Read 4 AWS Batch reviews

5,937 Views
5,638 Comparison Views

100% willing to recommend

Apache NiFi

AWS Batch

Comparison Buyer's Guide

Download the report

Executive Summary

We performed a comparison between Apache NiFi and AWS Batch based on real PeerSpot user reviews.

Find out in this report how the two Compute Service solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.

To learn more, read our detailed AWS Batch vs. Apache NiFi Report (Updated: July 2024).

Buyer's Guide

AWS Batch vs. Apache NiFi

July 2024

Download the complete report

Helped 793,295 peers since 2012

Categories and Ranking

Apache NiFi

Ranking in Compute Service

8th

Average Rating

7.8

Number of Reviews

Ranking in other categories

No ranking in other categories

AWS Batch

Ranking in Compute Service

6th

Average Rating

9.0

Number of Reviews

Ranking in other categories

No ranking in other categories

Mindshare comparison

As of July 2024, in the Compute Service category, the mindshare of Apache NiFi is 6.5%, up from 6.2% compared to the previous year. The mindshare of AWS Batch is 26.3%, up from 16.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Compute Service

Unique Categories:

No other categories found

Featured Reviews

MoulaliNaguri

Project Engineer at Wipro Limited

Aug 23, 2023

The product integrates with other applications easily, but it has fewer features compared to its competitors

We use the solution for data streaming We use the tool to stream live data. The end users can see the real-time data. We can integrate the tool with other applications easily. More features must be added to the product. As compared to Kafka, the tool must be improved. I have been using the…

Read full review

Larry Singh

Head of Bioinformatics at Paratus Sciences

Nov 7, 2023

User-friendly, good customization and offers exceptional scalability, allowing users to run jobs ranging from 32 cores to over 2,000 cores

The main drawback to using AWS Batch would be the cost. It will be more expensive in some cases than using an HPC. It's more amenable to cases where you have spot requirements. So, for instance, you don't exactly know how much compute resources you'll need and when you'll need them. So it's much better for that flexibility. But if you're going to be running jobs consistently and using the compute cluster consistently for a lot of time, and it's not going to have a lot of downtime, then the HPC system might be a better alternative. So, really, it boils down to cost versus usage trade-offs. It's going to be more expensive for a lot of people. In future releases, I would like to see anything that could help make it easier to set up your initial system. And besides improving the GUI a little bit, the interface to it, making it a little bit more descriptive and having more information at your fingertips, so if you could point to the help of what the different features are, you can get quick access to that. That might help. With most of the AWS services, the difficulty really is getting information and knowledge about the system and seeing examples. So, seeing examples of how it's being used under multiple use cases would be the best way to become familiar with it. And some of that would just come with experience. You have to just use it and play with it. But in terms of the system itself, it's not that difficult to set up or use.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The most valuable feature has been the range of clients and the range of connectors that we could use."

"Visually, this is a good product."

"It's an automated flow, where you can build a flow from source to destination, then do the transformation in between."

"The most valuable features of this solution are ease of use and implementation."

"The initial setup is very easy. I would rate my experience with the initial setup a ten out of ten, where one point is difficult, and ten points are easy."

"Apache NiFi is user-friendly. Its most valuable features for handling large volumes of data include its multitude of integrated endpoints and clients and the ability to create cron jobs to run tasks at regular intervals."

"We can integrate the tool with other applications easily."

"The initial setup is very easy."

More Apache NiFi pros

"AWS Batch's deployment was easy."

"We can easily integrate AWS container images into the product."

"AWS Batch manages the execution of computing workload, including job scheduling, provisioning, and scaling."

"There is one other feature in confirmation or call confirmation where you can have templates of what you want to do and just modify those to customize it to your needs. And these templates basically make it a lot easier for you to get started."

Cons

"The use case templates could be more precise to typical business needs."

"I think the UI interface needs to be more user-friendly."

"The overall stability of this solution could be improved. In a future release, we would like to have access to more features that could be used in a parallel way. This would provide more freedom with processing."

"We run many jobs, and there are already large tables. When we do not control NiFi on time, all reports fail for the day. So it's pretty slow to control, and it has to be improved."

"There should be a better way to integrate a development environment with local tools."

"The tool should incorporate more tutorials for advanced use cases. It has tutorials for simple use cases."

"There is room for improvement in integration with SSO. For example, NiFi does not have any integration with SSO. And if I want to give some kind of rollback access control across the organization. That is not possible."

"More features must be added to the product."

More Apache NiFi cons

"The main drawback to using AWS Batch would be the cost. It will be more expensive in some cases than using an HPC. It's more amenable to cases where you have spot requirements."

"When we run a lot of batch jobs, the UI must show the history."

"AWS Batch needs to improve its documentation."

"The solution should include better and seamless integration with other AWS services, like Amazon S3 data storage and EC2 compute resources."

Pricing and Cost Advice

"I used the tool's free version."

"We use the free version of Apache NiFi."

"It's an open-source solution."

"The solution is open-source."

"AWS Batch's pricing is good."

"AWS Batch is a cheap solution."

"The pricing is very fair."

See which vendors are best for you

Use our free recommendation engine to learn which Compute Service solutions are best for your needs.

See recommendations

793,295 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

18%

Computer Software Company

16%

Manufacturing Company

Retailer

Financial Services Firm

27%

Computer Software Company

13%

Manufacturing Company

Educational Organization

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Questions from the Community

What do you like most about Apache NiFi?

The initial setup is very easy.

See all answers

What is your experience regarding pricing and costs for Apache NiFi?

I used the tool's free version.

See all answers

What needs improvement with Apache NiFi?

The tool should incorporate more tutorials for advanced use cases. It has tutorials for simple use cases.

See all answers

Which is better, AWS Lambda or Batch?

AWS Lambda is a serverless solution. It doesn’t require any infrastructure, which allows for cost savings. There is no setup process to deal with, as the entire solution is in the cloud. If you use...

See all answers

What do you like most about AWS Batch?

AWS Batch manages the execution of computing workload, including job scheduling, provisioning, and scaling.

See all answers

What is your experience regarding pricing and costs for AWS Batch?

AWS Batch is a cheap solution.

See all answers

Comparisons

Google Cloud Dataflow vs Apache NiFi

Compared 33% of the time

AWS Lambda vs Apache NiFi

Compared 24% of the time

Apache Spark vs Apache NiFi

Compared 14% of the time

Azure Stream Analytics vs Apache NiFi

Compared 7% of the time

StackStorm vs Apache NiFi

Compared 2% of the time

More Apache NiFi Competitors

AWS Lambda vs AWS Batch

Compared 42% of the time

Apache Spark vs AWS Batch

Compared 29% of the time

AWS Fargate vs AWS Batch

Compared 9% of the time

Oracle Compute Cloud Service vs AWS Batch

Compared 8% of the time

More AWS Batch Competitors

Product Reports

Buyer's Guide

Apache NiFi

July 2024

Download Apache NiFi product report

Buyer's Guide

Compute Service

June 2024

Download AWS Batch product report

Also Known As

No data available

Amazon Batch

Learn More

Apache

Amazon Web Services (AWS)

Overview

Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted. With AWS Batch, there is no need to install and manage batch computing software or server clusters that you use to run your jobs, allowing you to focus on analyzing results and solving problems. AWS Batch plans, schedules, and executes your batch computing workloads across the full range of AWS compute services and features, such as Amazon EC2 and Spot Instances.

Sample Customers

Macquarie Telecom Group, Dovestech, Slovak Telekom, Looker, Hastings Group

Hess, Expedia, Kelloggs, Philips, HyperTrack

Buyer's Guide

AWS Batch vs. Apache NiFi

July 2024

Free Report: AWS Batch vs. Apache NiFi

Find out what your peers are saying about AWS Batch vs. Apache NiFi and other solutions. Updated: July 2024.

DOWNLOAD NOW

793,295 professionals have used our research since 2012.

See our AWS Batch vs. Apache NiFi report.

See our list of best Compute Service vendors.

We monitor all Compute Service reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.