EPM/BI certified Consultant, Oracle ACE and TeraCorp Consulting CEO at TeraCorp Consulting
18
Published:Jul 25, 2017
Today at 9am PST (12pm EST) IT Central Station will be hosting consultant and ODI expert Ricardo Giampaoli for an Ask Our Consultant Anything session.
Ricardo has more than 20 years engaging in EIS, BI, EPM projects in Brazil, working for the last 5 years in global projects for a fortune 100 client.
Are you afraid of ODI?
His achievements include:
• First and only Oracle ACE in Business Intelligence track in Brazil. • Design and implementation of management models & systems, deep expertise of key components to the EPM function in the Financial Services industry. • Business architecture design, end-to-end integrated processes, implementation, business solution testing and enhancement of key technologies. • Driver-based financial models linking corporate objectives and strategies to actionable insights. • Models for financial institution in Hyperion Planning for net interest margin, risk adjusted returns, spreads from transfer rates, and allocated costs and capital.
Responsible for overall architecture and strategy for the deployment of Oracle Hyperion technologies.
Ricardo’s specialties: Hyperion Planning and Essbase (versions from system 9 to 11.1.2.4), BIEE 10g and 11g, ODI 10g,11g and 12c and OWB 10g and 11g.
Ask Ricardo a question in the comments, and join us later for the ACA session.
EPM/BI certified Consultant, Oracle ACE and TeraCorp Consulting CEO at TeraCorp Consulting
Consultant
Top 20
Jul 26, 2017
Hi Moses how are you? I usually try to avoid XML as much as I can since XML is always a problem... The only case I end up using XML is when need to extracting metadata from huge essbase outlines (more than 500k members). Even so is a problematic operation since you need to worry about the Sync step, that uses a lot of memory of the agent, you need to worry about not overlap the loads and some time (to not say most of the time) you need some time of tweak in the KM to help you. If is possible try to get txt files instead of XML or anything like that.
EPM/BI certified Consultant, Oracle ACE and TeraCorp Consulting CEO at TeraCorp Consulting
Consultant
Top 20
Jul 26, 2017
Feel free to ask about anything related with ODI as architecture, possible uses, ideas.... and also tell stories of success or failure using the tool! We can even discuss why it failure and if there're anything different that could change the situation!!
I recommend Talend if you're looking for an on-premises solution. For cloud-based options, ADF or Azure Fabric would work well. These tools are suggested based on the diverse data sources and the large data volume involved.
Data Strategist, Cloud Solutions Architect at BiTQ
Aug 22, 2023
Hi Ornit, My preffered would be Informatica, SSIS, Wherescape. Informatica because it's a mature product that has been outfor a while with minimal development effort required. SSIS for SQL Server based solutions. Wherescape for ETL automation. Wherescape enables SQL users to write etl code in SQL using templates built into the product
Enterprise Data Architect at a manufacturing company with 201-500 employees
Aug 22, 2023
Good morning, Ornit.
We are using the enterprise edition of Hitachi Vantara's Pentaho Data Integration (PDI) (it also has a community edition that is free to use but lacks some of the automation features that the enterprise edition has) for over a decade now and it will do just about anything we throw at it. We use if not only for ETL but also to generate reports that are burst out to the business. I've used Informatica in the past and the thing that impressed me about Pentaho was it was much easier to build transformations. That may have improved since then (this was back in the early 2000s) but having to link each and every field between each step was super tedious. PDI does it by name with the option to change the mapping manually if needed.
Abe,The first thing that you should understand to set expectations properly is that there is no magic bullet. As a former partner of mine wisely said, the biggest V of data is "V-Integration." =). Every single integration tool that we have reviewed or worked with has a significantly incomplete inventory of integrations, although they will never admit that. Why is this? Quite simply because in...
Hi Abe, I would require a few more details on your requirements. However, with your current request, I would like to recommend Maiora's DO IT RIGHT (DiR) which is a lightweight ETL tool.
DiR helps you to integrate data from various sources and departments. Also, perform data quality checks, standardization checks, check for data duplication and transform data. You can extract the required results in any file format, such as Excel, SAS, JSON, and many more. DiR is a user-friendly ETL tool that does not require much technical knowledge to perform any activity. Also, it has a good user interface that can be further simplified as per your requirements and usage. Considering you are a university, this tool is efficient and very cost-effective.
Senior Solutions Architect at a tech consulting company with 201-500 employees
Apr 17, 2023
Hi Abe, before talking about the integration tools , i would recommend you to prepare a source system understanding document. This to cover : i. type of source system ( ie rdbms / nosql/api/etc) ii. nature of data that you plan to pull along with the volume iii. frequency of data pull...... these questions will form the baseline for your selection process and then you can start with your integration journey. Next step will be do feature comparison per tool . Do let me know if you need more information. Thanks
Hi Moses how are you? I usually try to avoid XML as much as I can since XML is always a problem... The only case I end up using XML is when need to extracting metadata from huge essbase outlines (more than 500k members). Even so is a problematic operation since you need to worry about the Sync step, that uses a lot of memory of the agent, you need to worry about not overlap the loads and some time (to not say most of the time) you need some time of tweak in the KM to help you. If is possible try to get txt files instead of XML or anything like that.
Feel free to ask about anything related with ODI as architecture, possible uses, ideas.... and also tell stories of success or failure using the tool! We can even discuss why it failure and if there're anything different that could change the situation!!
Hi Ricardo,
It would of great help if you can give some tips on loading complex XML into Oracle Table and vice versa
Thanks,
Moses V