What is our primary use case?
My main use case for Dremio is building a lakehouse data platform, integrating several sources, other databases, and Parquet files from S3 buckets, building Iceberg tables to provide the company a central platform where all data are available for a couple of use cases such as BI analytics and AI.
One specific example of how I have used Dremio in a project is addressing a challenge with a heterogeneous BI landscape where they have grown a lot of applications, such as Qlik, where they extract data from different databases and then they have decentralized versions of the data. Dremio could help to centralize all data that are used for analytics in the company.
How has it helped my organization?
Dremio has positively impacted our organization by streamlining the whole BI and analytics processes and reducing the heterogeneous landscape, allowing us to have everything in one place under one hood, which reduced a lot of maintenance and processing efforts in our everyday work.
What is most valuable?
In my opinion, the best features Dremio offers are the catalog, which is Polaris-based, and also data federation, allowing you to query across several other vendors' databases. Additionally, reflections and automatic reflections speed up queries automatically based on usage, which means it detects what dimensions and measures are used the most and then materializes the answers upfront, speeding up the whole BI and analytics use case.
The catalog and reflections features specifically help my work by speeding up access to data on S3 buckets, for instance, and reflections pre-calculate results which are then just delivered instantly. This means you do not need to wait to run a query for a longer time on huge amounts of data, and the user gets very quick answers.
What needs improvement?
One area where Dremio can be improved is the lack of tooling or functionalities for importing data in a pipeline way, as it is not an ETL or ELT component. This is somehow missing, and we are doing this now separately using other tools and Python scripts, but I think this is a missing feature in the whole platform. I choose to rate Dremio a nine out of ten because this ETL and ELT functionality is missing and some effort is needed to build up all those data pipelines around Dremio and to create all these Iceberg tables and other components. It requires some engineering to bring everything in place, which should actually be supported inside of Dremio.
Before we wrap up, I want to add that Dremio is lacking a semantic layer in a manner that the user can just choose dimensions, metrics, and filters to query the data. What Dremio considers a semantic layer is a layer of bronze, silver, and gold level semantic views or SQL views on top of the data, but this is not very flexible. This means you need another product beside Dremio to support ad-hoc analysis, so I think that a semantic layer should be part of Dremio.
For how long have I used the solution?
I have been using Dremio for around five years now, but in a customer project with a real license on it, I am using it for two years with the on-premise version.
What do I think about the stability of the solution?
What do I think about the scalability of the solution?
Dremio's scalability depends on your hardware and your deployment. We have deployed it to Kubernetes, and there is some auto-scaling, and we did not face any problems with that.
How are customer service and support?
My experience with customer support has been very good so far, but we did not have many cases, only some for sizing on the Helm charts at the beginning, and that was very good from our German Dremio partners. I would rate customer support a ten out of ten.
Which solution did I use previously and why did I switch?
We did not use a different solution before Dremio because there is nothing similar on the market.
What was our ROI?
I cannot provide any return on investment metrics with Dremio, such as money saved, time saved, or fewer employees needed.
What's my experience with pricing, setup cost, and licensing?
I had a good experience with pricing, as the pricing seems okay to me and the client, and the setup could be done by ourselves.
Which other solutions did I evaluate?
Before choosing Dremio, we evaluated different options, but as I mentioned, there is no similar platform, so it was easy to decide.
What other advice do I have?
Regarding Dremio's AI capabilities, I cannot say much about governance and security because I have not used it yet. I have not used Dremio's AI capabilities yet, so I cannot judge anything about it. What I have seen looked to me more to be a showcase demo case rather than real capabilities for productive use, but I could be wrong.
Dremio is deployed in my organization on-premises. My advice to others looking into using Dremio is to just try it out yourself, as there is also a community edition you can play around with upfront. I would rate Dremio a nine out of ten overall.
Which deployment model are you using for this solution?
On-premises