Senior Data Engineer at a photography company with 11-50 employees
Real User
Top 5
A tool that offers overall efficiency to its users, particularly in the area of data warehousing
Pros and Cons
  • "I can do everything I want with SSIS and Azure Data Factory."
  • "There aren't many third-party extensions or plugins available in the solution."

What is our primary use case?

In my company, we use Azure Data Factory for everything related to data warehousing. Depending on my customer's wants, I will use SSIS or Azure Data Factory. If my customers want Fivetran, I will use it for them. If the customer wants a suggestion from me on what they should use, then I will look at what they have today and their skills. According to the inputs I receive from my customers, I will recommend what makes more sense for a particular customer. I can be called a software agnostic.

How has it helped my organization?

I can do everything I want with SSIS and Azure Data Factory.

What needs improvement?

There aren't many third-party extensions or plugins available in the solution. Adjunction or addition of third-party extensions or plugins to Azure Data Factory can be a great improvement in the tool. Creation of custom codes, custom extensions, or third-party extensions, like Lookup extension, should be made possible in the tool.

I am unsure if Azure Data Factory bridges the gap between on-premises, cloud, and hybrid solutions. I would like to see a version that would work equally well in both on-premises and cloud environments. I would like to see the aforementioned offerings made to customers as valuable alternatives to the old SSIS tool.

For how long have I used the solution?

I have been using Azure Data Factory for many years. I started using the tool since it was called DTS and then, later, SSIS. I currently use Microsoft SQL SSIS 2019.

Buyer's Guide
Azure Data Factory
April 2024
Learn what your peers think about Azure Data Factory. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,740 professionals have used our research since 2012.

How was the initial setup?

The solution is deployed on the cloud.

What other advice do I have?

Overall, I rate the solution an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
Gyanendu Rai - PeerSpot reviewer
Senior Tech Consultant at Crowe
Real User
Top 20
Improved flexibility when compared to other solutions
Pros and Cons
  • "I enjoy the ease of use for the backend JSON generator, the deployment solution, and the template management."
  • "I would like to be informed about the changes ahead of time, so we are aware of what's coming."

What is our primary use case?

Azure Data Factory allows us to provide BI service. We pull the data and put it into Synapse. From there, we create our dimension fact tables that are being used for reporting. 

What is most valuable?

The most valuable feature of Azure Data Factory is the improved flexibility compared to SSIS that we previously used for our ETL transformation. I also enjoy the ease of use for the backend JSON generator, the deployment solution, and the template management. All we need to do is create ARM templates.

What needs improvement?

Microsoft is constantly upgrading its product. Changes can happen every week. Every time you open Data Factory you see something new and need to study what it is. I would like to be informed about the changes ahead of time, so we are aware of what's coming.

In future releases, I would like to see Azure Data Factory simplify how the information of logs is presented. Currently, you need to do a lot of clicks and go through steps to find out what happened. It takes too much time. The log needs to be more user-friendly.

For how long have I used the solution?

I have been using Azure Data Factory for two years.

What do I think about the scalability of the solution?

Scalability depends on the use case. 

How are customer service and support?

As far as customer service and support with Azure Data Factory, we are not always satisfied with the response time. However, once they attend to the issue, everything is good.

How would you rate customer service and support?

Positive

How was the initial setup?

All we needed to do was create ARM templates and deployment is easy.

What about the implementation team?

We deployed in-house. For deployment, we use ARM templates that are a part of Azure's deployment strategy. It's not only available for Data Factory, it is built in. It links with DevOps, then the ICD integration.

What other advice do I have?

Azure Data Factory is a good tool. Given that the data platform ecosystem is provided by Microsoft, you know it is good.

I would rate the solution an eight out of ten overall.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Buyer's Guide
Azure Data Factory
April 2024
Learn what your peers think about Azure Data Factory. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,740 professionals have used our research since 2012.
Azure Architect\Informatica ETL Developer at Relativity
Real User
A helpful and responsive GUI, but there are a lot of tasks for which you need to write code
Pros and Cons
  • "The most valuable feature is the ease in which you can create an ETL pipeline."
  • "The support and the documentation can be improved."

What is our primary use case?

I use this primarily for ETL tasks.

What is most valuable?

The most valuable feature is the ease in which you can create an ETL pipeline.

The GUI is very helpful when it comes to creating pipelines. The user interface is also very fast.

The connection to Snowflake is easy. I can store data and transform it during the ETL process before sending it to Snowflake.

What needs improvement?

Azure Data Factory is a bit complicated compared to Informatica. There are a lot of connectors that are missing and there are a lot of instances where I need to create a server and install Integration Runtime.

The support and the documentation can be improved.

There are a lot of tasks that you need to write code for.

For how long have I used the solution?

I have been using Azure Data Factory for about six months.

Which solution did I use previously and why did I switch?

I have experience with Informatica and I find it easier to use. For example, there are a lot of connectors that are directly available. Also, Informatica is able to take incremental copies, but with Azure, you have to write code to do that.

I have also worked with Matillion and Fivetran, and I feel that there are a lot of things that Azure can learn from these products. For example, with Fivetran there are very good connectors for copying data between other solutions. This is unlike Azure, where a lot of the time, I have to build my own logic.

How was the initial setup?

The initial setup is complex.

What other advice do I have?

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Solution Architect at a computer software company with 1,001-5,000 employees
Real User
Top 20
Helps us to load data to warehouses and useful for ETL processes
Pros and Cons
  • "The tool's most valuable features are its connectors. It has many out-of-the-box connectors. We use ADF for ETL processes. Our main use case involves integrating data from various databases, processing it, and loading it into the target database. ADF plays a crucial role in orchestrating these ETL workflows."
  • "When working with AWS, we have noticed that the difference between ADF and AWS is that AWS is more customer-focused. They're more responsive compared to any other company. ADF is not as good as AWS, but it should be. If AWS is ten out of ten, ADF is around eight out of ten. I think AWS is easier to understand from the GUI perspective compared to ADF."

What is our primary use case?

We use the product for data warehouses. It helps us to load data to warehouses. 

What is most valuable?

The tool's most valuable features are its connectors. It has many out-of-the-box connectors. We use ADF for ETL processes. Our main use case involves integrating data from various databases, processing it, and loading it into the target database. ADF plays a crucial role in orchestrating these ETL workflows. 

The tool's visual interface is good. The ADS scheduling feature impacts data management by determining when jobs must be run and setting up dependencies. This capability eliminates the need to rely on enterprise data scheduling tools. 

What needs improvement?

When working with AWS, we have noticed that the difference between ADF and AWS is that AWS is more customer-focused. They're more responsive compared to any other company. ADF is not as good as AWS, but it should be. If AWS is ten out of ten, ADF is around eight out of ten. I think AWS is easier to understand from the GUI perspective compared to ADF.

For how long have I used the solution?

I have been using the product for 6 months. 

What do I think about the stability of the solution?

ADF is stable. 

What do I think about the scalability of the solution?

I rate the tool's scalability an eight out of ten. 

How was the initial setup?

The tool's deployment is easy. The deployment typically takes around two to three days to set up. However, the duration may vary depending on factors such as the number of integrated endpoints. In our company, the deployment team had three to four people. This team consisted of an IT engineer, a network engineer, and an ETL admin.

We still haven't required much maintenance since we're still in the development phase. However, as time progresses and we move into production, we'll better understand the maintenance requirements.

What's my experience with pricing, setup cost, and licensing?

ADF is cheaper compared to AWS. 

What other advice do I have?

The tool has met our projects' growing data needs effectively so far. I rate it an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
reviewer826419 - PeerSpot reviewer
CIO, Director at Prosys Infotech Private Limited
Real User
Top 10
Easy to deploy, good support, and scalable
Pros and Cons
  • "We have been using drivers to connect to various data sets and consume data."
  • "We require Azure Data Factory to be able to connect to Google Analytics."

What is our primary use case?

The primary use case is to connect to various different data sets and do an EAT into our data warehouse.

What is most valuable?

We have been using drivers to connect to various data sets and consume data. The solution gives everything under one roof, which is an important feature.

What needs improvement?

We require Azure Data Factory to be able to connect to Google Analytics.

For how long have I used the solution?

I have been using the solution for two years.

What do I think about the stability of the solution?

The solution is stable.

What do I think about the scalability of the solution?

The solution is scalable.

How are customer service and support?

We had a few technical calls with the Microsoft technical support team for some issues that we were facing, which they helped us resolve.

How would you rate customer service and support?

Positive

How was the initial setup?

The initial setup is straightforward and the team is able to deploy between six and seven days.

What about the implementation team?

The implementation was completed in-house.

What's my experience with pricing, setup cost, and licensing?

The cost is based on the amount of data sets that we are ingesting. The more data we ingest the more we pay.

What other advice do I have?

I give the solution a nine out of ten. We have been happy with all the customer implementations, and the customers are satisfied with the ADF pipelines. We are also currently examining the Synapse pipelines, which are likely similar.

We have six developers using the solution in our organization.

People should use the solution for two reasons. Firstly, we can switch off any data pipelines we set up to save costs. Secondly, there are several connectors available in one place, including most standard connectors.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
Zubair_Ahmed - PeerSpot reviewer
Senior Consultant at Veraqor
MSP
Top 5
Seamless cloud-based data integration providing a versatile platform with scalable data processing, diverse data connectors, and comprehensive monitoring and management capabilities
Pros and Cons
  • "The most valuable aspect is the copy capability."
  • "Currently, smaller businesses face a disadvantage in terms of pricing, and reducing costs could address this issue."

What is our primary use case?

My task involves extracting data from a source, performing necessary transformations, and subsequently loading the data into a target destination, which happens to be Azure SQL Database.

How has it helped my organization?

The company is experiencing significant benefits as one of our customers is successfully implementing the solution we provide. We offer support to the customer in utilizing Azure Data Factory, and their satisfaction level is quite high.

What is most valuable?

The most valuable aspect is the copy capability.

What needs improvement?

Implementing a standard pricing model at a more affordable rate could make it accessible to a larger number of companies. Currently, smaller businesses face a disadvantage in terms of pricing, and reducing costs could address this issue.

For how long have I used the solution?

I have been working with it for more than six months.

What do I think about the stability of the solution?

The stability is quite satisfactory. I would rate it nine out of ten.

What do I think about the scalability of the solution?

It provides impressive scalability. There are a total of eight switches currently in use. I would rate it nine out of ten.

How are customer service and support?

Technical support is available for all products, and you can reach them without any hassle. They offer assistance through various channels and are proficient in addressing technical issues, ensuring the highest level of support. I would rate it nine out of ten.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

In the past, we used Oracle Data Integrator.

How was the initial setup?

The initial setup has been smooth and without any difficulties.

What about the implementation team?

Deployment time is contingent on the volume of data. If there are millions of records to process, it will understandably take a significant amount of time. Conversely, for smaller datasets, the deployment can be relatively quick, often within a matter of minutes to reach the destination. In the cloud deployment process, the initial step involves defining the instance. Subsequently, in the copy activity, we specify both the source and destination. Following this, communication with the destination takes place. This process constitutes the necessary steps for deployment, and we proceed accordingly. Due to the cloud system being provided by Microsoft, they handle the maintenance of the servers.

What was our ROI?

The routing value is quite impressive, especially considering that we successfully implemented it for one of our clients, and they expressed satisfaction. For our latest projects, we've acquired additional customers who also require this product for their setups. I would rate it eight out of ten.

What's my experience with pricing, setup cost, and licensing?

While I can't specify the actual cost, I believe it is reasonably priced and comparable to similar products.

What other advice do I have?

I would recommend considering this solution because, from my perspective, it is not overly expensive. The pricing seems reasonable, making it a viable option to explore. Overall, I would rate it nine out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Disclosure: I am a real user, and this review is based on my own experience and opinions.
Flag as inappropriate
PeerSpot user
BI Technical Development Lead at a energy/utilities company with 10,001+ employees
Real User
A solution that is ideal for individuals or teams looking to extract, transform, and load data into a database
Pros and Cons
  • "Feature-wise, one of the most valuable ones is the data flows introduced recently in the solution."
  • "Currently, our company requires a monitoring tool, and that isn't available in Azure Data Factory."

What is our primary use case?

Our company uses the solution to extract, transform, and load the data into the database.

What is most valuable?

Feature-wise, one of the most valuable ones is the data flows introduced recently in the solution.

What needs improvement?

Currently, our company requires a monitoring tool, and that isn't available in Azure Data Factory. Although the platform displays which pipelines are running, it doesn't offer a monitoring tool that allows for the sequential execution of pipelines and the ability to visualize end-to-end data flow. As such, this feature is currently missing from the platform.

For how long have I used the solution?

I have been using Azure Data Factory for more than six years. Also, I am an end-user of the solution, and I initially used to work on Azure Data Factory V1. Now, I have switched to Azure Data Factory V2.

What do I think about the stability of the solution?

It is a stable solution. Stability-wise, I rate the solution an eight or nine out of ten.

What do I think about the scalability of the solution?

Scalability-wise, I rate the solution a seven or eight out of ten. So, scalability can be improved. Also, there are around 150 people in my company using the solution. Moreover, we use the solution daily in our company.

How are customer service and support?

I rate the technical support between eight to nine out of ten.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

Previously, I was using Informatica. My company wanted to shift to a solution that could be deployed on the cloud, so we chose Azure Data Factory.

How was the initial setup?

The solution's initial setup process was easy. On a scale where one is difficult and ten is easy, I rate the initial setup process an eight out of ten. The solution is deployed on the cloud.

Since multiple projects are going on in my organization, there is no uniformity in the time taken to deploy the solution in our company. However, I can say that it only takes a few days to carry out the deployment process.

Our organization has multiple project teams, so each team carries out its deployment process.

To give an average, I would consider that if there are fifty ongoing projects in our company, and if we consider a person from each project, fifty people are needed for the deployment and maintenance process.

What about the implementation team?

The solution's implementation process was done with our in-house team's help.

What's my experience with pricing, setup cost, and licensing?

I cannot comment on the pricing parts since our company's admin team handles it.

What other advice do I have?

Those who want to move to a cloud platform can choose Azure Data Factory since it is the best tool. Since certain improvements are required in the solution, I rate the overall solution an eight out of ten.

Which deployment model are you using for this solution?

Private Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PedroNavarro - PeerSpot reviewer
BI Development & Validation Manager at JT International SA
Real User
Top 5
Well performing solution for ELTs
Pros and Cons
  • "The overall performance is quite good."
  • "Occasionally, there are problems within Microsoft itself that impacts the Data Factory and causes it to fail."

What is our primary use case?

We use this solution to perform ELTs so that we do not need to keep code within a database.

What is most valuable?

The overall performance is quite good.

What needs improvement?

Occasionally, there are problems within Microsoft itself that impact the Data Factory and cause it to fail.

For how long have I used the solution?

I've worked with this solution for two and a half years.

What do I think about the stability of the solution?

I wouldn't consider it to be stable since it fails at times.

What do I think about the scalability of the solution?

The solution is scalable.

How are customer service and support?

Support is quite slow and they have bugs that they are unaware of and claim that that is how the system is supposed to work.

Which solution did I use previously and why did I switch?

My company used Informatica PowerCenter in the past but I was not involved in that.

How was the initial setup?

The initial setup was quick and easy. The whole process took about fifteen minutes. We have about a hundred users at the moment and have plans to increase.

What about the implementation team?

Two of our in-house developers were able to complete the setup.

What other advice do I have?

This solution has good performance but could use better stability. I would rate this a nine out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Azure Data Factory Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Azure Data Factory Report and get advice and tips from experienced pros sharing their opinions.