2014-08-13T11:12:00Z
Avigail Sugarman - PeerSpot reviewer
Community Manager at PeerSpot (formerly IT Central Station)
  • 2
  • 4

What are the must-have features for a Data integration system?

From a user's or a developer's perspective. Solutions you have have experience with which include these features?

3
PeerSpot user
3 Answers
it_user108354 - PeerSpot reviewer
Manager of Data Analytics at Tata Consultancy Services
Real User
2014-08-14T07:14:00Z
Aug 14, 2014

Thanks Gary for the details I missed to include. Indeed the cost, skill and maintenance of licensed tool is the make-or-break factor while deciding which tool to opt for, often realized through experience over period of time.

Search for a product comparison in Data Integration Tools
GaryM - PeerSpot reviewer
Data Architect at World Vision
Real User
Top 5Leaderboard
2014-08-14T04:10:39Z
Aug 14, 2014

The assumption that you are referring to batch/ETL data integration rather than process mentioned by Abhishek said is critical. The primary difference between ETL verses IAI being in the areas of expected latency, data format, and data verses process transformation. I say that because there is overlapping functionality between those two categories of integration tools while being fundamentally different in design and expectations.

Other tools which are potentials are Ab Initio and Microsoft SqlServer Integration Services. You can't go wrong with InfoSphere or Informatica if money is no object and willing to make the investment.

While all of the above tools will share some level of features that Abhishek mentioned (which was a great summary btw), the devil as they say is in the details. Usability of logging, scalability, richness and usability of metadata, user friendliness/level of support, scheduling - these are often very different and you won't easily tell significant differences until you actually use them for awhile. The differences will show up in how much customization developers have to do to make them perform and are supportable in the real world.

it_user108354 - PeerSpot reviewer
Manager of Data Analytics at Tata Consultancy Services
Real User
2014-08-13T12:23:47Z
Aug 13, 2014

Data Integration systems, I would assume, are not referring to messaging and EAI here. For non-messaging or non-EAI Data Integration systems, I would look for these features:
01. Range of built-in components available to transform data.
02. Degree of customization possible at transformation level, process level and group of processes (batch) level.
03. Exception Handling mechanism supported, either through: built-in, configuration or custom.
04. Scheduling and Reporting of status of process(es).
05. Notification, Alerts and Logging, as required for specific process(es).
06. Variety of Sources and Targets which can be used for design of ETL process(es).
07. Architecture scalability, when: processing large (and very large) data volumes, failure recovery, high availability.
08. Concurrency and Stability of the system during BCP and/ or Failover recovery.
09. Available and accessible Metadata Repository.
10. Client software being available in various compatible OS (optional).

Few of the market leading solutions which meet most of the requirements are:
1. Informatica PowerCenter (licensed).
2. IBM InfoSphere DataStage (licensed)..
3. SAP BODI (licensed).
4. Talend DI (OpenSource).
5. Pentaho Kettle (OpenSource).
6. Oracle DI/ Oracle WB (licensed).

Find out what your peers are saying about Microsoft, Informatica, Oracle and others in Data Integration Tools. Updated: November 2022.
653,584 professionals have used our research since 2012.
Related Questions
Netanya Carmi - PeerSpot reviewer
Content Manager at PeerSpot (formerly IT Central Station)
Sep 14, 2022
Why do you recommend this particular data integration tool?
See 2 answers
Beth Safire - PeerSpot reviewer
Tech Blogger
Sep 4, 2022
I highly recommend Informatica PowerCenter as a data integration tool if you are looking for a solution for a large enterprise. I would say that it is one of the most stable and reliable platforms for data governance. Informatica PowerCenter is ideal for integrating and performing transformations on very large amounts of data in a very short amount of time. This is a very mature and complete product that easily performs complex data transformations. It is very stable and reliable and can easily handle large data sources at any given time. We have all types of different files coming into our systems and Informatica PowerCenter is able to accept all these different sources, such as spreadsheets and databases, and then perform all types of transformations on their data. One of the features that we find to be most valuable is the metadata repository because it can easily understand the lineage of first target mapping. After you provide the source and the target, mappings are automatically done, which makes it easy to use for the development team. We can use Informatica PowerCenter to transfer transitional databases to and from the data warehouse. Using this method, we can easily find our data reports and filter the data, which we use to create AI models. We also use it in order to create data warehouse applications, which can then be used for analytics, helping us generate business value. Informatica PowerCenter has a very nice user interface. Our staff finds that it is really intuitive and user friendly - it is easy to work with and can be picked up in just a few days. We are very satisfied with the technical support that Informatica PowerCenter offers. They are available 24/7. The support staff is knowledgeable and responsive. There is also a good online knowledge base. The basic deployment is straightforward. But for systems with data integration services and other services, the deployment will take more time. Some of the benefits and advantages of Informatica PowerCenter include: Performance: Informatica PowerCenter is a very reliable and robust tool for data management and data governance strategy. It can manage and transform huge quantities of data. Stability: The system is reliable and does not crash or stall. Customer support: Customer support is available for customers 24/7. It is also very easy to find helpful information online. Ease-of-use: The system is user-friendly and users are able to quickly learn how to effectively use it in a short amount of time. The main downside of the product is its price. It is a bit on the expensive side and probably too pricey for mid and small sized companies. Another feature we would like to see integrated with the tool is monitoring. Currently, there is no viable monitoring solution. Informatica PowerCenter provides us with all the functionality that we need and more. I definitely recommend it. Users that are familiar with ETL tools will find it easy and worthwhile to use Informatica PowerCenter. I rate it a nine out of ten.
Deepak Damodarr - PeerSpot reviewer
Data Office Lead at a comms service provider with 501-1,000 employees
Sep 14, 2022
As in most platform selection situations, you should create a capability framework that will satisfy your use case and then use the budget criteria to shortlist the vendors.
Theodore Omtzigt - PeerSpot reviewer
President and Founder at STILLWATER SUPERCOMPUTING INC
Feb 5, 2020
I am the president and CEO of a differentiated system integration company for high-performance deep learning and intelligent systems.  I am looking for feedback on the use of MTL for HPC applications.  Specifically in terms of:  Ease of use Performance Functionality Numerical robustness Thanks! I appreciate the help. 
See 1 answer
Walter Kuhn - PeerSpot reviewer
ICT Architect at a tech services company with 51-200 employees
Feb 5, 2020
Not sure whether I got your problem. Based on my background, I used some matrix libraries many years ago, however at that time no real template libaries... I guess you are using C++? Could you interface to Fortran, have you researched on the various libraries available, such as the old SCALAPACK, LAPACK, or MAGMA etc? MTL4? see also https://www.cscs.ch/fileadmin/user_upload/contents_publications/tutorials/handson_intro_to_PETSc/CSCS_libraries.pdf for an overview of various libraries... you should read it...
Related Articles
Anna Odrynska - PeerSpot reviewer
Chief Strategy Officer at Alpha Serve
Oct 11, 2022
Business owners cannot rely on their own market assessments and strategic assumptions to make informed tactical decisions. Rapid technology development and tough competition mean that thorough data analysis is vital for success. In this article, we explain how business analysts, IT teams, and company managers can benefit from Microsoft Power BI integration with the help of BI connectors. Why i...
Ricardo Giampaoli - PeerSpot reviewer
EPM/BI certified Consultant, Oracle ACE and TeraCorp Consulting CEO at TeraCorp Consulting
Mar 22, 2021
Hey guys, how are you?  In this post, I’ll talk about my preferred tips and tricks that I use in ODI (any version). I’m always using these pieces of code for pretty much everything I do in ODI especially because it makes the code more elegant, dynamic, and easier to change later. First, let’s talk about my all-time preferred, Loops. Normally we learn to loop in ODI using a count variable and ...
Related Articles
Anna Odrynska - PeerSpot reviewer
Chief Strategy Officer at Alpha Serve
Oct 11, 2022
Power BI Integration: Why Should You Integrate Power BI and Your Software?
Business owners cannot rely on their own market assessments and strategic assumptions to make inf...
Ricardo Giampaoli - PeerSpot reviewer
EPM/BI certified Consultant, Oracle ACE and TeraCorp Consulting CEO at TeraCorp Consulting
Mar 22, 2021
How to use ODI to generate Dynamic code for you
Hey guys, how are you?  In this post, I’ll talk about my preferred tips and tricks that I use in...
Related Categories
Download Free Report
Download our free Data Integration Tools Report and find out what your peers are saying about Microsoft, Informatica, Oracle, and more! Updated: November 2022.
DOWNLOAD NOW
653,584 professionals have used our research since 2012.