Azure Data Factory Reviews

We had an old, traditional data warehouse. We decided to put it into the cloud and we used Azure Data Factory to reform the EEL process from SQL server integration services to extra data.

Azure Data Factory was chosen by the team that I was not on at the time and who decided that this would be the move to the future. So I just went along with it.

In terms of my personal experience, it works fine.

We didn't have a very good experience. The first steps were very easy but it turned out that we used Europe for a Microsoft data center, also partly abroad for our alpha notes. As soon as we started using Azure Data Factory, the bills got higher and higher. At first we couldn't understand why, but it is very expensive to put data into a data center abroad. So instead, we decided to use only Northern Europe, which worked out for a while in the beginning. And then we had nothing to show for it. They gave me a really hard time for this.

Azure Data Factory should be cheaper to move data to a data center abroad for calamities in case of disasters.

What I really miss is the integration of Microsoft TED quality services and Microsoft Data services. If they were to combine those features in Data Factory, I think they would have a very strong proposition. They promise something like that on Microsoft Congress. That was years ago and it's still not here.

I have been using Azure Data Factory for a couple of years now, since about 2017.

Azure Data Factory is a stable solution.

Yes, Azure Data Factory is scalable.

We previously used SSIS because of Microsoft.

The installation is straightforward.

We use data engineers to do the install.

We pay monthly for this.

On a scale of one to ten, I would give Azure Data Factory a seven. Compared to Informatica, it's really crude. I think it's a very crude solution. 

Would I recommend Azure Data Factory? It depends if they need a straight reading in data, then I would say it's perfect. But with Informatica, you can do data storing and data quality checks - there is a lot there than just a data center.

I think Azure Data Factory is a mature product. We used Version One in my project and a lot of it isn't possible on this version. The Version Two is much faster and much better. It's not at the same level as Informatica.

I use Azure Data Factory in my company because we are implementing a lot of different projects for a big company based in the USA. We're getting certain information from different sources—for example, some files in the Azure Blob Storage. We're migrating that information to other databases. We are validating and transforming the data. After that, we put that data in some databases in Azure Synapse and SQL databases.

I think it makes it very easy to understand what data flow is and so on. You can leverage the user interface to do the different data flows, and it's great. I like it a lot.

It would be better if it had machine learning capabilities. For example, at the moment, we're working with Databricks and Azure Data Factory. But Databricks is very complex to do the different data flows. It could be great to have more functionalities to do that in Azure Data Factory.

I have been using Azure Data Factory for about one year.

Azure Data Factory is a stable solution.

It's scalable. We're doing a lot of different integrations with a lot of data, and scalability is great.

The initial setup is straightforward. I think that it's so easy to start a project using that technology.

We have a team that's in charge of doing the deployments in Azure in different environments.

I would tell potential users that there are many technologies to do this. For example, if you like to manage big data and do something with it, it would be better to use Databricks.

On a scale from one to ten, I would give Azure Data Factory a nine.

The solution is primarily used for data integration. We are using it for the data pipelines to get data out of the legacy systems and provide it to the Azure SQL Database. We are using the SQL data source providers mainly.

The data pipeline and the orchestration functionality are the most valuable aspects of the solution.

The interface is very good. It seeks to be very responsive and intuitive.

The initial setup is very quick and easy.

I'm more of a general manager. I don't have any insights in terms of missing features or items of that nature.

Integration of data lineage would be a nice feature in terms of DevOps integration. It would make implementation for a company much easier. I'm not sure if that's already available or not. However, that would be a great feature to add if it isn't already there.

We've used the solution for the last 12 months or so.

From what I have witnessed, the solution is quite stable. It doesn't crash or freeze. There are no bugs or glitches. It's reliable.

We work with medium to enterprise-level organizations. Customers have anywhere from 300 employees up to 160,000 employees.

Microsoft offers a great community. There's a lot of support available. We're quite satisfied with the level of assistance on offer.

Since the solution is a service, it's basically just a click and run setup. It's very simple. There's very little implementation necessary. A company should be able to easily arrange it. The deployment doesn't take very long at all.

We do provide the implementation for our clients. We're able to provide templates as well. We have predefined implementation space in Data Factory and provide it to the customer.

While clients might individually evaluate other options, however, we're not aware of that information. I can't say what other solution clients might consider before ultimately choosing Microsoft. I would say that it is likely Talend and maybe SQL Server Integration Services.

We are like an integrator. We are a data warehouse NPI consulting company and we use Data Factory to pull data from different legacy systems and do all these transformations that are necessary in order to provide analytical models.

In our normal scenario is that we are providing Azure SQL Databases together with Azure Data Factory and Power BI. 80% of our customers have recognized such a scenario.

On a scale from one to ten, I'd rate the solution at an eight. We've been largely happy with the capabilities of the product.

We are not using this product specifically as a data factory. We have taken Synapse Analytics as the entire component for the data warehousing solution. Azure Data Factory is one of the components of that, and we are using it for ETL. 

Prior to this, we did not have a proper data warehousing solution. Instead, we had segregation between different tools like Oracle Data Warehouse, Exadata, and other products. Now, most of the tools that we have are from Microsoft, including Power BI, which has been rolled out throughout the organization. Synapse was the better choice for us to implement, as it has a lot of out-of-the-box connectors that we can utilize for data transformation and organization. 

The best part of this product is the extraction, transformation, and load. In fact, we have found that the three of them work quite well. We are implementing the cloud-based system right now.

We see a lot of improvement with the most recent version of this solution. Some of the new features are very important to us.

The need to work more on developing out-of-the-box connectors for other products like Oracle, AWS, and others.

We have been working with Azure Data Factory for approximately six months. We are still implementing and it is not live, yet, but we expect it to be in 2021.

I have found it to be quite stable. Here and there, there could be some issues and problems but overall, I'm okay with the product.

Scalability is one of the points that we were looking for because we are hosting approximately two terabytes of data and we expect that it will grow at least five times over the next two years. This is one of the reasons that we adopted this solution.

In perhaps a year, we will increase our usage.

The technical support from Microsoft is quite good. if you get good resources and they can provide you with free consulting, then it is quite good. However, when you purchase paid consulting and dedicated support, it is quite costly compared to the market.

I don't think that the initial setup was very complex. We have quite an advanced IT infrastructure team and the Microsoft FastTrack team also helped us a lot during the programming of the development and setup.

I would not say that this product is overly expensive. It is competing with the other providers, and they have almost the same pricing model.

In general, I would recommend this product. However, it depends on the target IT ecosystem. If they are utilizing a lot of Microsoft products like Power BI, Office, Project, SharePoint, and so forth, it's better to implement Data Factory because it will reduce a lot of effort spent to consume data from other sources.

At this point, I can only rate based on my pre-implementation experience, so I would rate this solution an eight out of ten.

The primary use case of this solution is for data integration.

It has built-in connectors for more than 100 sources and onboarding data from many different sources to the cloud environment.

It has everything we needed.

Being able to post your feedback and queries is a very good feature that is offered by Azure Data Factory.

Understanding the pricing model for Data Factory is quite complex. It needs to be simplified, and easier to understand.

We have experienced some issues with the integration. This is an area that needs improvement.

I have been using this solution for almost two years.

So far it's been stable. We have not experienced any issues.

I haven't put much thought into scalability.

I have contacted technical support.

If there are any queries, they have the provision to post them in the Data Factory GUI and we can contact the team directly. This is a very nice feature.

Any feedback or improvements that we post is acknowledged and taken care of.

The initial setup was straightforward. It was not complex.

Pricing is quite complex.

I have had feedback from many people and many of my team members, and they say that it is difficult to understand. 

Understanding the pricing of Data Factory is quite complex. 

It is not presented in a straightforward way.

I would definitely recommend this solution to anyone who is interested in using it.

I would rate Azure Data Factory an eight out of ten.

We are using this solution to gather information from SCADA systems, analyze it using AI and machine learning, and then sending the results to our users. They receive and view the data using the Power BI interface.

The integration with the whole environment is smooth and transparent.

The reason that we implemented this product is for the full integration with the whole Azure environment. It is very important because you don't have to deal with security, identity flow, or audit flow.

The security of the agent that is installed on-premises is very good. This is another important feature for us.

It comes with a lot of connectors out of the box, including support for SQL, Oracle, SAP, and ODBC.

The pricing scheme is very complex and difficult to understand. Analyzing it upfront is impossible, so we just decided to start using it and figure out the costs on a weekly or monthly basis.

We have just begun using Azure Data Factory within the past two or three months and it is not fully rolled out yet.

We have no issues with technical support. We are working closely with Microsoft partners. There were a couple of problems during the installation that were solved on the fly, and otherwise, we haven't had and trouble.

We started with iConduct and as we migrated to the Azure environment, we began the process of switching to the Microsoft Azure Data Factory.

The initial setup was not very complex and the deployment was very quick. We were set up within a matter of days, or perhaps a week.

We received help from one of the Microsoft partners, who handled the installation for us.

To this point, we are still learning the system and have only tried a very simple data flow. At this point, we haven't had any issues.

I would rate this solution an eight out of ten.

It's an integration platform, we migrate data across hybrid environments. We have data in our cloud environment or on-prem system so we use it for when we want to integrate data across different environments. It was a problem for us to get data from different hybrid environments.

From my experience so far, the best feature is the ability to copy data to any environment. We have 100 connectors and we can connect them to the system and copy the data from its respective system to any environment. That is the best feature. 

The user interface could use improvement. It's not a major issue but it's something that can be improved. 

It has the ability to create separate folders to organize objects, Data Factory objects. But any time that we created a folder we were not able to create objects. We had to drag and drop into the folder. There were no default options. It was manual work. We offered their team our feedback and they accepted my request.

I have been using Azure Data Factory for around one year. 

Based on my experience with other products on the market, the stability is good. 

I haven't had much experience with scalability. I know we do have scalability options though. It's used daily. 

There are around 1,000 plus users using this solution in my company. 

It requires two people for maintenance. The administrators are the ones who maintain it and give access to the engineers. They regulate who has privileges. 

We have needed to contact their technical support. If we can't find the answers ourselves on the blogs, we contact them with our questions. We get most of the answers we need from the blogs but if not then we can directly speak to the Microsoft team from the Data Factory interface itself, it's really helpful.

I have only used Data Factory for the cloud. For on-prem we have used SSIS.

The initial setup was a bit complex but once you understand its setup, it's less complex. There are certain processes that need to be followed. Once you understand the process, it becomes easier to implement.

The implementation took a little less than one day. The planning for the deployment takes around one or two days. 

We had a discussion with the Microsoft team about the data. We discussed how we were going to implement. Based on the discussion we were able to deploy. A Microsoft partner helped us with some parts. 

We also evaluated AWS.

The advice that I would give to someone considering this solution is to have some background in data warehousing and ETL concepts. Have the background about data warehousing and ETL that extract, transform, and load. If you have the background you need, you will be successful. If not, then my advice would be to learn a little more about it before using Data Factory.

I would rate Data Factory as an eight out of ten. 

There was a need to bring a lot of CRM and marketing data for some PNL analysis. We are connecting to the Salesforce cloud. In it, there's a specific solution in Salesforce Core CRM for the pharmaceutical industry. We are using the solution to connect to that and we are bringing in the various dimensions and transactions from that data source.

Data Factory itself is great. It's pretty straightforward. You can easily add sources, join and lookup information, etc. The ease of use is pretty good. 

They have a lot of other components like a newer monitor, which helps track and generate alerts for any failed jobs and things of that nature, which is helpful.

At this point in time, they should work on somehow integrating the big data capabilities within it. I have not explored it, but it would be good if somehow we could call a Spark job or something to do with the Spark SQL within ADS so that we wouldn't need a Spark tested outside.

On the UI side, they could make it a little more intuitive in terms of how to add the radius components. Somebody who has been working with tools like Informatica or DataStage gets very used to how the UI looks and feels. 

In ADS, adding a new table or joining a new table and overriding that with an override SQL that I could customize would be helpful.

Being able to debug from the design mode itself would be helpful.

I've been using the solution for one year.

In the latest version, the v2 version, the solution is pretty stable. It does not give unknown letters or things like that.

The solution allows you to create reusable components, so it can be scaled pretty easily.

Being an IT services company, we have a gold or a platinum partnership with Microsoft. For us, getting the technical support we need is not a big issue. Their community is also pretty active in responding to any issues. It's quite good. We've been satisfied with the level of support that is offered.

We were not actually involved in the initial setup. That was all with the client, so I won't be able to comment on it.

In terms of licensing costs, we pay somewhere around S14,000 USD per month. There are some additional costs. For example, we would have to subscribe to some additional computing and for elasticity, but they are minimal. 

For disaster recovery and readability setups, we did that on Data Lake.

We use the public cloud deployment model.

I'd warn others to ensure that the design should be frozen before you start building because overriding each other's code and managing code takes effort. To avoid or to reduce that effort, ensure that the design is frozen. You can build some configurable code rather than hard-coding everything into the jobs. That's the biggest recommendation.

I'd rate the solution seven out of ten. It's a pretty good solution, but over the past year, I've been limited on the number of cases I have on it. If it had a better user interface and was more intuitive I would have rated it higher.