Azure Data Factory Reviews

Our company uses the solution as a data pipeline. We get information outside the cloud from our factory such as data relating to production. We categorize it, clean it up, and transfer it to a database and data model. From there, we analyze the data using BI and other things. We gather information in data lake products like Microsoft Synapse and Microsoft Data Lake. 

We have two to three administrators who use the solution in a quite standard, mainstream way with nothing extreme. They handle administration, security, and development. 

It is difficult to define the total number of users because that depends on the number of data factory agents. We built the solution to have a different data factory agent for every customer. For example, if we have ten customers then we have ten users. We hope to increase usage but growth depends on our marketing efforts and how well we sell our products. 

The data factory agent is quite good and programming or defining the value of jobs, processes, and activities is easy. We have the agent installed on-premises in order to gather information.  

The cloud includes all kinds of API connections so we can easily gather information from other services. 

The solution seamlessly integrates with the Azure infrastructure. 

The pricing model should be more transparent and available online. When you start programming, you define the fields, variables, activities, and components but don't know the implication on price. You get a general idea but the more activities you add, the more you pay. It would be better to know price implications up front. 

There is a calculator you can run to simulate price but it doesn't help a lot. Practically speaking, you have to build your job and run it to see the exact price implications. This is an issue because you might realize you are paying too much so you have to reprogram or change things. 

I have been using the solution for three years. 

The solution is stable with no issues. Stability is rated a nine out of ten. 

We did have some breaches, but that was because we misconfigured something. Since we corrected it, we haven't had any issues. 

The solution is scalable with no performance issues. We haven't yet reached our limit that would require scaling. Scalability is rated an eight out of ten. 

We have discussions with our Microsoft partner all the time. 

In the last three years, we have contacted Microsoft directly three or four times. Once was for a general architectural issue and the rest were for the data factory or other items. Each time, we talked together with Microsoft and our partner. 

Support gave us answers and solved our issues. Sometimes, we didn't like the answer but we accepted that it was the correct answer. 

Support is rated a nine out of ten. 

We have not used another solution to this magnitude for real development and production. We work a little bit on Google Cloud. 

The initial setup was quite quick. Deployment was fairly simple and took less than a week. The setup got us up and running. 

After that, we had to write the implications of the data model and the kinds of activities. We are still doing this today because we make changes all the time.

The initial setup was seamless because we worked with a gold star Microsoft partner. Our side of setup was pretty quiet. We talked with our partner and told them what we needed from a security and monitoring point of view. We had a few high-level discussions from the block diagram perspective. Basically we said we need this or that, and our partner made it happen. 

The team included one person from our partner and three in-house team members with varying expertise across data modeling, security, and devops. We always worked with the same person but maybe behind the scenes he talked with coworkers. He did talk several times with Microsoft but we don't really know how many people were involved.

The solution does not require infrastructure maintenance. If we ever have issues, we can use Azure Defender to resolve them. We only make slight changes at the application level. 

We haven't calculated ROI on a formal level, but the fact is we need the solution. Because of the integration, we save a lot but haven't run exact numbers. 

The pricing model is based on usage and is not cheap. Based on our activity, we pay about $2,000 per month. 

Pricing is rated a four out of ten. 

If we didn't have the solution, we would have to find another tool because data pipelines are an essential part of our business. 

The biggest advantage to the solution is its integration with the Azure infrastructure that includes the active directory, security, Synapse, Data Lake, Power BI, and the data factory agent. 

All of the integration was a big consideration for us. We had general guidelines that said working with one vendor would provide the best integrations. The guideline was to use Microsoft unless there was an issue. 

We did not look at a third party or open source even though there are similar tools available. 

My best advice is to keep an eye on the pricing because we found out the hard way. Pricing is actually related to the way you use what the solution calls activity. This activity stuff drastically changes the coding to the rate you gather information from your client environment. 

So, when marketing guys tell you to gather information every minute, you have to weigh the heavy implications in comparison to collecting data once an hour or day. Programmers and developers designed the solution based on usage activity and building tasks or jobs. 

Pay a lot of attention to the pricing implications from the starting point of view. Technically, you can solve all issues but you need to keep an eye on the pricing. 

From a technical point of view, the solution is rated an eight out of ten. Because of pricing, the solution's overall rating is downgraded to a seven out of ten. 

We use the solution for migration. We collect data from SAP and various other sources, including multiple ERP systems. These ERP systems encompassed different versions of SAP, Dynamics, Navision, and Oracle, presenting a considerable challenge for data integration. The objective was to consolidate all data into Azure Data Factory and Data Warehouse, establishing a structured framework for reporting and analytics. The main hurdle encountered was data ingestion, particularly with SAP data, due to its significant volume. Alternative tools such as PolyBase were utilized to expedite the process, as standard SAP APIs were insufficient for loading data into Azure Data Services. Collaboration with an Azure data engineer facilitated the exploration of alternative ingestion methods. 

The most important feature is the Data Catalog. We need to define all the data fields we test. It has technical information in the Data Catalog. The main feature is data ingestion in ADF. We also extended it to PurView because PurView is an extension of the Azure data catalog. It can scan metadata. There is a limitation in ADF when setting up the data catalog.

Integration with other tools, such as SAP, could be enhanced. It still has challenges when we talk about different types of structured and non-structured datages. Azure Data Factory has data ingestion issues. There are no delays out of the box. We needed a lot of tools to make the ingestion happen because of the data structure and size of the data.

The transformation we needed to do on data was also not so easy. It was also a long process. We had a bit more capabilities for setting up the Data Catalog, but it still didn't solve the problem from the data ingestion.

I have been using Azure Data Factory as a consultant for five years.

Sometimes, we experienced some instability, mainly on injection.

I rate the solution’s stability as seven out of ten.

I rate the solution’s scalability an eight out of ten.

The support is very good.

Positive

You need to be experienced in deploying the solution. It's not so easy for a business user. Depending on the use case, it takes around six months to get a proof of concept done.

I rate the initial setup a seven out of ten, where one is easy and ten is difficult.

The pricing is visible because you pay for what you do.

The product looks quite expensive because it charges based on the size of the data. If you're not aware, your cost can be very high. If you are experienced, you know that.

I rate the product’s pricing a seven out of ten, where one is cheap and ten is expensive.

I was mainly focusing on ingestion and cataloging. Data engineers were handling data orchestration.

The tool’s maintenance is easy.

There could be a bit more clarity in the pricing structure. It should be understandable for business users. The cost is is becoming too high because users are unaware of the pricing structure. Secondly, the tool should integrate better with other tools like ERP systems.

Overall, I rate the solution a seven out of ten.

We use Azure Data Factory for data integration.

The most valuable features of the solution are its ease of use and the readily available adapters for connecting with various sources.

Some known bugs and issues with Azure Data Factory could be rectified.

I have been using Azure Data Factory for about two years.

I rate the solution an eight out of ten for stability.

Azure Data Factory is a scalable solution. A team of 16 people from the data analytics team use the solution in our organization.

I rate the solution an eight out of ten for scalability.

On a scale from one to ten, where one is difficult and ten is easy, I rate the solution's initial setup a seven out of ten.

A team of three people deployed Azure Data Factory in three to four days.

The solution's pricing is competitive.

We build data pipelines primarily for integration. Few of them are real-time data transfers, and few of them would be a batch-free file. These would direct the data from various sources to our data warehouse. Azure Data Factory helps build the data pipelines and adaptors.

The solution has built-in features and a control center for us to monitor the status of the pipelines. The solution's email notification also helps us in monitoring. We didn't face any challenges to set up the data pipelines. We know there are some controls, but governance is customized for the organization's requirements. We have our own policies.

Azure Data Factory is deployed on the cloud in our organization. I would recommend Azure Data Factory to other users.

Overall, I rate the solution a nine out of ten.

We use the product for data warehouses. It helps us to load data to warehouses. 

The tool's most valuable features are its connectors. It has many out-of-the-box connectors. We use ADF for ETL processes. Our main use case involves integrating data from various databases, processing it, and loading it into the target database. ADF plays a crucial role in orchestrating these ETL workflows. 

The tool's visual interface is good. The ADS scheduling feature impacts data management by determining when jobs must be run and setting up dependencies. This capability eliminates the need to rely on enterprise data scheduling tools. 

When working with AWS, we have noticed that the difference between ADF and AWS is that AWS is more customer-focused. They're more responsive compared to any other company. ADF is not as good as AWS, but it should be. If AWS is ten out of ten, ADF is around eight out of ten. I think AWS is easier to understand from the GUI perspective compared to ADF.

I have been using the product for 6 months. 

ADF is stable. 

I rate the tool's scalability an eight out of ten. 

The tool's deployment is easy. The deployment typically takes around two to three days to set up. However, the duration may vary depending on factors such as the number of integrated endpoints. In our company, the deployment team had three to four people. This team consisted of an IT engineer, a network engineer, and an ETL admin.

We still haven't required much maintenance since we're still in the development phase. However, as time progresses and we move into production, we'll better understand the maintenance requirements.

ADF is cheaper compared to AWS. 

The tool has met our projects' growing data needs effectively so far. I rate it an eight out of ten. 

Azure Data Factory is an all-in-one solution for ETL in our company.

My company doesn't use the product for development purposes.

I use the solution in my company as an ETL tool and for orchestration.

As a DevOps engineer, I feel that the CI/CD part and the tool's integration with GitHub are the product's best features. If you compare it with other tools, like Glue, AWS, and other solutions, I feel Azure Data Factory's deployment part is a lot easier to manage. The code promotions and the data pipeline promotions to higher environments are a lot easier with Azure Data Factory.

The product's technical support has certain shortcomings, making it an area where improvements are required. Instead of sending out documents, I think the tool's support team should focus on how to troubleshoot issues. I want the tool's support team to have real-time interaction with users.

The product's price can be problematic for small businesses, making it an area where improvements are required.

I have experience with Azure Data Factory. I am the end user of the tool. Azure Data Factory is a PaaS solution. I use the solution's latest version.

It is a stable solution since it is a PaaS product. Stability-wise, I rate the solution an eight out of ten.

The scalability of the product is impressive. Scalability-wise, I rate the solution an eight out of ten.

Most of the people in my company work on Azure, and those who want to use the native ETL capabilities provided by the product opt for Azure Data Factory.

The product is useful in medium to large-sized businesses. Smaller businesses can opt for other options other than Azure Data Factory, considering the amount of money they are ready to spend. There are better options available in the market than Azure Data Factory.

I rate the technical support a five to six out of ten.

Neutral

I rate the product's initial setup phase a seven or eight on a scale of one to ten, where one is difficult and ten is easy.

In my company, we take care of the product's deployment process and maintenance phase.

The solution is deployed using Azure's cloud services.

The solution can be deployed in ten to fifteen minutes.

For deployments, my company usually creates codes in Terraform so that we can have automated deployments, and it is connected to us with a CI/CD tool like Azure DevOps. Azure DevOps does the automated deployment for our company.

During the setup phase, users may face issues when it comes to infrastructure deployment and the configuration around it, especially if you consider the integration runtime, as it is something that is too complicated for a normal developer to understand. There is a need for a cloud expert with a good understanding to be able to take care of the deployment in the right manner and in a secure way. The networking setup and security part of the product are a bit complicated, which I might understand since I am a DevOps engineer, but a developer who is new to the product might not understand such parts of the tool. The deployment of the service in an infrastructure can be possible only if the person involved in the deployment has a basic level of understanding related to the product.

I rate the product price as six on a scale of one to ten, where one is low price and ten is high price.

I wanted to compare Azure Data Factory with Fivetran.

Users rely on Azure Data Factory's connectors to meet data integration and transformation needs. Users use connectors that are native to Azure Data Factory. The tool offers more than 90 connectors that can be used to ingest data from different sources.

The feature of the solution I find to be the most beneficial for data management tasks is its connectors, and it can even be used for hybrid scenarios. The tool can connect to a different cloud, like AWS. The product can connect to your on-premises systems. In general, users are able to ingest data from everywhere, and the best part is that all of the aforementioned areas can be managed through GUI. The tool is like a low code-no code solution.

The visual interface of the solution impacts workflow efficiency because I think it is easier to start with for any developer who wants to use the tool. It is easier to start with and also easier to troubleshoot or debug, especially at a time when you cannot expect all your developers to understand codes. It would be good to have an intuitive GUI. Azure Data Factory

does a pretty good job when you compare it with its competitors.

Most of the time, my company uses integration runtime, so we mostly use a self-hosted integration runtime. In short, my company has not seen my impact has not seen much impact on a project from the product's scalability capabilities on any projects because we use it according to the needs of our customers.

I rate the tool an eight out of ten.

We use Azure Data Factory to set up a data lake information repository.

Most of our customers are Microsoft shops and prefer Azure Data Factory because they have good licensing options and a trust factor with Microsoft. Our core customers are traditional Microsoft shops who prefer to expand on Microsoft on-cloud.

Azure Data Factory's pricing in terms of utilization could be improved. Our customers complain that the solution's bills keep growing.

I have worked with Azure Data Factory for more than five years as a consultant.

Azure Data Factory is a pretty stable solution. I rate Azure Data Factory a nine out of ten for stability.

Azure Data Factory is a scalable solution. We have around 15 to 20 customers, of which about 8 to 10 use Azure Data Factory.

Azure Data Factory's initial setup needs some amount of professional training and qualification.

It seems very low initially, but as the data grows, the solution’s bills grow exponentially.

Azure Data Factory is deployed on-cloud for our clients.

Azure Data Factory is a pretty solid solution with all the factors and integration built in. It's as good as any product.

I recommend users compare with Snowflake before choosing Azure Data Factory. We've had customers who prefer Snowflake just for its ease of use. Since we're not a Microsoft official reseller, I give options to customers and then let them pick and choose some from Azure Data Factory, Snowflake, or anything on Amazon.

Overall, I rate Azure Data Factory an eight out of ten.

Our company uses the solution to extract, transform, and load the data into the database.

Feature-wise, one of the most valuable ones is the data flows introduced recently in the solution.

Currently, our company requires a monitoring tool, and that isn't available in Azure Data Factory. Although the platform displays which pipelines are running, it doesn't offer a monitoring tool that allows for the sequential execution of pipelines and the ability to visualize end-to-end data flow. As such, this feature is currently missing from the platform.

I have been using Azure Data Factory for more than six years. Also, I am an end-user of the solution, and I initially used to work on Azure Data Factory V1. Now, I have switched to Azure Data Factory V2.

It is a stable solution. Stability-wise, I rate the solution an eight or nine out of ten.

Scalability-wise, I rate the solution a seven or eight out of ten. So, scalability can be improved. Also, there are around 150 people in my company using the solution. Moreover, we use the solution daily in our company.

I rate the technical support between eight to nine out of ten.

Positive

Previously, I was using Informatica. My company wanted to shift to a solution that could be deployed on the cloud, so we chose Azure Data Factory.

The solution's initial setup process was easy. On a scale where one is difficult and ten is easy, I rate the initial setup process an eight out of ten. The solution is deployed on the cloud.

Since multiple projects are going on in my organization, there is no uniformity in the time taken to deploy the solution in our company. However, I can say that it only takes a few days to carry out the deployment process.

Our organization has multiple project teams, so each team carries out its deployment process.

To give an average, I would consider that if there are fifty ongoing projects in our company, and if we consider a person from each project, fifty people are needed for the deployment and maintenance process.

The solution's implementation process was done with our in-house team's help.

I cannot comment on the pricing parts since our company's admin team handles it.

Those who want to move to a cloud platform can choose Azure Data Factory since it is the best tool. Since certain improvements are required in the solution, I rate the overall solution an eight out of ten.

I use Azure Data Factory for architecture creation, for example, loading data from Oracle DB to Azure Synapse Analytics, creating facts and dimensions using Azure Data Pipeline, and creating Azure Synapse notebooks for data transformation. 

Another use case for Azure Data Factory is dashboard creation to help customers make informed decisions.

Compared to the on-premise SSIS, Azure Data Factory has better infrastructure. It also benefits my company because you can scale the solution up or down with different resources.

Azure Data Factory is also on a pay-as-you-go or pay-as-you-use model, which is suitable for the company because my company only pays for its usage or requirement.

The solution is also very user-friendly, and the Azure Data Factory support team responds quickly whenever my team has a loading issue.

One advantage of Azure Data Factory is that it's fast, unlike SSIS and other on-premise tools.

It's also very convenient because Azure Data Factory has multiple connectors. It has sixty connectors which you can't find in SSIS. The availability of native connectors allows you to connect to several resources to analyze data streams.

I also like that you can set up your own VM and infrastructure on Azure Data Factory without any help from the IT team because it only requires a single click.

What's missing in Azure Data Factory is an Oracle connector. If you want to connect directly to the Oracle database, you must copy and transform the data. There's no Oracle connector if you want to do transformation using data flow activity, so Azure Data Factory needs more connectors for data flow transformation.

Sending out emails after a job is completed is another area for improvement in the tool.

I've been using Azure Data Factory for three years.

Azure Data Factory is a scalable tool.

We used SSIS, but its on-premise version is slower than Azure Data Factory, and Azure Data Factory, infrastructure-wise, is better, so we went with Azure Data Factory.

The initial setup for Azure Data Factory is an eight out of ten.

Manually deploying Azure Data Factory is easy and doesn't take much time, but I'm not sure how long it takes for an automated approach to deployment.

The licensing model for Azure Data Factory is good because you won't have to overpay. Pricing-wise, the solution is a five out of ten. It was not expensive, and it was not cheap. It's in the middle.

I have experience with both Azure Data Factory and SSIS.

I'm using the latest version of Azure Data Factory.

My rating for Azure Data Factory is eight out of ten.

My company is an Azure Data Factory user.