2020-04-03T11:07:00Z

Which ETL tool would you recommend to populate data from OLTP to OLAP?

Hi,

I am working as a solution architect for a tech vendor with 10,000+ employees. 

I need to perform comparative analysis for ETL tools available to populate data from OLTP to OLAP.

The main criteria I am considering are:

  • Price
  • Functionality (transformation, error logging and handling, loading patterns to be supported)
  • Development and maintenance efforts
  • Popularity in the market.

I want to evaluate both Oracle and Open Source options. I am also open to both tools (ODI, Golden Gate, etc) and technology- e.g. Oracle Materialized view.

Thanks! I appreciate your help. 

RS
Solution Architect at a tech vendor with 10,001+ employees
  • 8
  • 485
12
PeerSpot user
12 Answers
GM
Data Architect at World Vision
Real User
Top 5Leaderboard
2021-09-08T18:45:19Z
Sep 8, 2021

As someone mentioned, if you're purely Oracle shop and staying that way then there's value with prioritizing Oracle tools.  However, let me contrast that with this caveat...


Consider expectations for tool and vendor longevity. Oracle has a long history of retiring and/or replacing tools leaving customers in the cold with prior versions/tools (I've been burned multiple times by Oracle product retirements or replacements including OWB, Oracle Designer2k, Oracle Express, Oracle OEDW, their purchase of Sagent ETL which as later abandoned).


But I would also consider these questions and relative prioritization:  


What is your organization's plans for moving to other database technologies?  


Where is your org going with on-prem versus cloud solutions?  How important are PaaS versus IaaS solutions?  


Where is your current staff's expertise?  


Prioritize mature over immature tools. 


How many sources do you have?  What are their technologies and does the integration tool support them?


Is it just moving data from a single ERP such as Oracle EBS to Olap? When you say Olap what do you mean by that?  Are you talking Oracle Olap product or something else?  That makes a really big difference of course - if your ETL tool doesn't support your source(s) and target(s) then it shouldn't be considered.


Given the industry's trajectory, I myself would highly prioritize PaaS solutions over others.

Product comparison that may be of interest to you
YJ
Manager at Crimsonlogic Pte
Real User
2021-09-09T04:22:18Z
Sep 9, 2021

What is the OLAP that you are using? Hosted in Cloud or on-premise? 


The target DB should have its tool to extract data.

ED
TitleBusiness Development Manager at Komtaş
User
2021-09-08T09:46:57Z
Sep 8, 2021

Pentaho is a really nice tool if opensource is the only option. 


Please think about issues such as upgrade and disaster in the future. These operations are very easy in Pentaho.


I can only suggest one thing for replication and that is Qlik. (ex-Attunity).

AT
Solution Manager - Healthcare and lifescience at a computer software company with 11-50 employees
User
2020-04-07T09:48:17Z
Apr 7, 2020

There are two products I know about
* TimeXtender : Microsoft based, Transformation logic is quiet good and can easily be extended with T-SQL , Has a semantic layer that generates metat data for cubes . price approx 40K$, works with tables
. Attunity (Bought by Qlik) : technology agnostic , nice web interface , expensive > 100K€. Works with transaction logs

There are many other pure ETL tools
* ERWIN has a nice one ,

PW
Enterprise Integration Architect at Capgemini
Consultant
Top 5Leaderboard
2020-11-02T18:18:40Z
Nov 2, 2020

Depends upon the technologies being used. If you're using Oracle for both OLTP and OLAP then you'll get a lot of value from an Oracle solution.


The other question is how up to date do you want your OLAP DB to be? Goldengate is a good answer if you're looking to minimize latency, but it can be expensive. ODI is less expensive but better suited to bulkier data sets.  If an Oracle product wasn't the option I'd probably consider something like Informatica.

Karoly Krokovay - PeerSpot reviewer
CEO at Informula Ltd
Real User
Top 5
2020-04-10T06:18:30Z
Apr 10, 2020

Hi Rajneesh,
yes here is the feature comparison between the community and enterprise edition : https://www.hitachivantara.com/en-us/pdf/brochure/leverage-open-source-benefits-with-assurance-of-hitachi-overview.pdf

And a short description of the community edition: https://www.predictiveanalyticstoday.com/pentaho-community-edition/

And the download link: https://community.hitachivantara.com/s/article/downloads

You can ask more from the great community: https://forums.pentaho.com/

Regards
Károly

Find out what your peers are saying about Oracle Data Integrator (ODI) vs. Talend Data integration and other solutions. Updated: March 2023.
708,461 professionals have used our research since 2012.
Karoly Krokovay - PeerSpot reviewer
CEO at Informula Ltd
Real User
Top 5
2020-04-07T11:13:23Z
Apr 7, 2020

We have experiences only in Pentaho Data Integrator (open source competitor of the Oracle Data Integrator).
But OLAP exporting wasn't in our scope until now.

SS
CEO / Owner with 51-200 employees
User
2020-04-06T14:29:39Z
Apr 6, 2020

We usually use Talend.
Look here: https://community.talend.com/t5/Design-and-Development/The-way-from-OLTP-to-OLAP/td-p/116719

RS
Solution Architect at a tech vendor with 10,001+ employees
Real User
2020-04-13T03:28:45Z
Apr 13, 2020

Hi Karoly, Thanks for your input. community: https://forums.pentaho.com/ is not allowing new registrations for new users. I guess they accept queries from customers only and not from any one. Do you know any other forum, community, SMEs contacts who can help on queries?

RS
Solution Architect at a tech vendor with 10,001+ employees
Real User
2020-04-08T13:44:08Z
Apr 8, 2020

Hi Karoly,

Thanks for your response !!!
Is Pentaho Data Integrator available as freeware/open source tool? Does it come in basic, standard and enterprise editions flavors?

It integrates data from various heterogeneous systems like multiple variety of databases (SQL server, Oracle, DB2 etc), files (XML, XLS, CSV, text etc)? Targets can be any type of DB , file etc.?

What all flavors available like Basic, Standard, Enterprise editions? All editions are free/ open source?

Thanks,
Rajneesh

RS
Solution Architect at a tech vendor with 10,001+ employees
Real User
2020-04-07T13:09:28Z
Apr 7, 2020

Hi AThire ,
Thanks for your response, I am looking for open source tools.

Regards,
Rajneesh

RS
Solution Architect at a tech vendor with 10,001+ employees
Real User
2020-04-07T06:11:21Z
Apr 7, 2020

Thanks Stefan !!!
May I know if Talend is opensource /free ? It is available in all 3 editions - basic , standard end enterprise? it is capable to read data from all heterogeneous system like various types of data bases and files etc..?

Related Questions
NC
Content Manager at PeerSpot (formerly IT Central Station)
Dec 6, 2022
Do you feel the tool is worth the price?
See 2 answers
DG
Tech blogger
Dec 6, 2022
This product saved my company a lot of money. On one hand, Hitachi Lumada Data Integration offers a very simple-to-use interface. This means our employees did not need extensive and expensive training on how to use it. Even beginners could do data reports thanks to this product. And then it is definitely worth mentioning that this tool does not cost as much as some of its competitors in the field. Last, but definitely not least, it does a great job of handling complicated data from multiple sources. This eliminates the need for other products. So yes, it is worth the money and it saved my company plenty.
Beth Safire - PeerSpot reviewer
Tech Blogger
Dec 6, 2022
In my opinion, this tool is more than cost-effective, considering how well it does its job. The initial purchase of the product paid out many times over the years and we have used it effectively for data integration. But not only that, it saved a considerable amount of our employees' time and sped up many processes. I believe that by using this you will benefit from efficient results and quickly get the money for it back. My company was using a competitor of Hitachi Lumada Data Integrations when I came to work here. Older employees can confirm that this product is better for our needs than previously used ones!
NC
Content Manager at PeerSpot (formerly IT Central Station)
Dec 6, 2022
Are you completely satisfied with this product or is there something you think stops its seamless data integration?
See 2 answers
DG
Tech blogger
Dec 6, 2022
In my opinion, the reporting side of this tool needs serious improvements. In my previous company, we worked with Hitachi Lumada Data Integration and while it does a good job for what it’s worth, it can definitely up its reporting features. While I used it, there were plenty of basic components I felt that it missed. For example, it did not provide the option to search the repository for a report. I feel like this is a huge miss out since it would save on a lot of manual searching. If they upped their game there, I would be among the first to recommend it.
Beth Safire - PeerSpot reviewer
Tech Blogger
Dec 6, 2022
I do not see any big problems with this solution. It works very well for my company, a medium-sized one. We have been using it for a while now and the only issue I have caught during that time is with caching. We had to integrate a larger data set once and then we encountered a slight problem with the tool. We were used to its high speed with all operations but with the larger data set, things got slower than usual. I am not sure if it was a one-time thing or if it is common, so you may want to look into that if you are a big data company.
Related Articles
NC
Content Manager at PeerSpot (formerly IT Central Station)
May 11, 2022
PeerSpot’s crowdsourced user review platform helps technology decision-makers around the world to better connect with peers and other independent experts who provide advice without vendor bias. Our users have ranked these solutions according to their valuable features, and discuss which features they like most and why. You can read user reviews for the Top Message Queue (MQ) Software to help ...
Moderator
Chris Childerhose - PeerSpot reviewer
Lead Infrastructure Architect at ThinkON
Real User
ExpertTop 5
Product Comparisons
Related Articles
NC
Content Manager at PeerSpot (formerly IT Central Station)
May 11, 2022
Best-Rated Message Queue (MQ) Software 2022
PeerSpot’s crowdsourced user review platform helps technology decision-makers around the world to...
Download Free Report
Download our FREE report comparing Oracle Data Integrator (ODI) and Talend Data integration based on reviews, features, and more! Updated: March 2023.
DOWNLOAD NOW
708,461 professionals have used our research since 2012.