We performed a comparison between Amazon Step Functions and Apache Airflow based on real PeerSpot user reviews.Find out what your peers are saying about Camunda, Pega, Appian and others in Business Process Management (BPM).
"It's a general solution that you can adapt to your own needs and is simple to use. We like that it can be integrated with everything in the AWS suite, and that the creation of the pipeline can be done using the graphical user interface."
"The best feature is the customization."
"Apache Airflow's best feature is its flexibility."
"The solution is flexible for all programming languages for all frameworks."
"We have been quite satisfied with the stability of the solution."
"The product integrates well with other pipelines and solutions."
"The best part of Airflow is its direct support for Python, especially because Python is so important for data science, engineering, and design. This makes the programmatic aspect of our work easy for us, and it means we can automate a lot."
"The initial setup was straightforward and it does not take long to complete."
"I like the UI rework, it's much easier."
"Setup took about one day. We had some errors to understand in the beginning, but now everything is working good."
"The dashboard is connected into the BPM flow that could be improved."
"Apache Airflow could be improved with the addition of more frameworks."
"The scalability of the solution itself is not as we expected. Being on the cloud, it should be easy to scale, however, it's not."
"The solution could be improved by simplifying the integration process."
"I would like to see it more friendly for other use cases."
"UI can be improved with additional user-friendly features for non-programmers and for fewer coding practitioner requirements."
"We're currently using version 1.10, but I understand that there's a lot of improvements in version 2. In the earlier version that we're using, we sometimes have problems with maintenance complexity. Actually using Airflow is okay, but maintaining it has been difficult."
"Technical support is an area that needs improvement."
AWS Step Functions lets you coordinate multiple AWS services into serverless workflows so you can build and update apps quickly. Using Step Functions, you can design and run workflows that stitch together services such as AWS Lambda and Amazon ECS into feature-rich applications. Workflows are made up of a series of steps, with the output of one step acting as input into the next. Application development is simpler and more intuitive using Step Functions, because it translates your workflow into a state machine diagram that is easy to understand, easy to explain to others, and easy to change. You can monitor each step of execution as it happens, which means you can identify and fix problems quickly. Step Functions automatically triggers and tracks each step, and retries when there are errors, so your application executes in order and as expected.
Apache Airflow is an open-source workflow management system (WMS) that is primarily used to programmatically author, orchestrate, schedule, and monitor data pipelines as well as workflows. The solution makes it possible for you to manage your data pipelines by authoring workflows as directed acyclic graphs (DAGs) of tasks. By using Apache Airflow, you can orchestrate data pipelines over object stores and data warehouses, run workflows that are not data-related, and can also create and manage scripted data pipelines as code (Python).
Apache Airflow Features
Apache Airflow has many valuable key features. Some of the most useful ones include:
Apache Airflow Benefits
There are many benefits to implementing Apache Airflow. Some of the biggest advantages the solution offers include:
Reviews from Real Users
Below are some reviews and helpful feedback written by PeerSpot users currently using the Apache Airflow solution.
A Senior Solutions Architect/Software Architect says, “The product integrates well with other pipelines and solutions. The ease of building different processes is very valuable to us. The difference between Kafka and Airflow, is that it's better for dealing with the specific flows that we want to do some transformation. It's very easy to create flows.”
An Assistant Manager at a comms service provider mentions, “The best part of Airflow is its direct support for Python, especially because Python is so important for data science, engineering, and design. This makes the programmatic aspect of our work easy for us, and it means we can automate a lot.”
A Senior Software Engineer at a pharma/biotech company comments that he likes Apache Airflow because it is “Feature rich, open-source, and good for building data pipelines.”
Amazon Step Functions is ranked 15th in Business Process Management (BPM) with 1 review while Apache Airflow is ranked 8th in Business Process Management (BPM) with 9 reviews. Amazon Step Functions is rated 9.0, while Apache Airflow is rated 8.0. The top reviewer of Amazon Step Functions writes "Enabled my organization to create workflows with a lot of different AWS services". On the other hand, the top reviewer of Apache Airflow writes "Integrates well with other pipelines and builds different processes well but the scalability needs improvement". Amazon Step Functions is most compared with Camunda Platform, Pega BPM, IBM BPM, Oracle BPM and IBM Business Automation Workflow, whereas Apache Airflow is most compared with Camunda Platform, IBM Business Automation Workflow, Informatica Cloud Api and App Integration, IBM BPM and Informatica Business Process Manager.
See our list of best Business Process Management (BPM) vendors.
We monitor all Business Process Management (BPM) reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.