Share your experience using Gigaspaces Smart Cache

My main use case for Databricks involves the pipelines and ETL processes that we are implementing. Following the Medallion architecture with Gold, Silver, and Bronze layers, we filter the data, perform transformations, and integrate AI. Databricks has made this process significantly easier.

I worked for an airline company where they experienced substantial delays in data processing. When a passenger booked a ticket, it took 20 to 25 minutes for the transaction to reflect in the system. Using Databricks, we compressed that time from 10 to 6 minutes initially and eventually reduced it to just a few seconds. After setting up all the pipelines and leveraging Databricks features to enhance and accelerate the process, this project became truly impactful and time-based, resulting in reduced processing time and ultimately increased profit for the airline company.

The best features Databricks offers are Unity Catalog, Databricks Workflow, Databricks AI, Agentic AI, and the automated pipelines that utilize AI. The AI models are very easy to create and deploy in just a few seconds. These are helpful and user-friendly tools.

I find myself using Unity Catalog most frequently because it provides a unified governance solution for all data and AI needs on Databricks, offering centralized access control, auditing, lineage, and data discovery capabilities across the platform. The main features include access control, security compliance standard models, built-in auditing, and lineage tracking. Most of my projects have involved integrating Unity Catalog into systems and providing overall security, including a migration project to transition to Unity Catalog.

The platform's unified data intelligence capabilities allow teams to analyze, manage, and activate data at scale, leading to faster time to insights, cleaner data pipelines, and significant savings on infrastructure and engineering efforts. Databricks eliminates data silos, accelerates the time to insight, empowers all data personnel, and provides built-in governance and security. It also supports AI and ML, which is an added advantage in today's AI-driven field.

Databricks already provides monthly updates and continuously works on delivering new features while enhancing existing ones. However, the platform could become easier to use. While instruction-led workshops are available, offering more free instructional workshops would allow a wider audience to access and learn about Databricks. Additionally, providing use cases would help beginners gain more knowledge and hands-on experience.

Regarding my experience, I was initially unfamiliar with the platform and had to conduct research and learn through various videos. I did find some instruction-led classes, but several of those required payment. The platform should provide more free resources to enable a broader audience to access and learn about Databricks. The platform itself is user-friendly and easy to use without complex issues, so I believe it does not need improvement in its core functionality. Rather, supporting aspects can be enhanced.

I have been working as a data engineer for four years. Initially, I was a software engineer, but my career has progressed as a data engineer over this four-year period.

Definitely. As I mentioned regarding my airline project, it was impactful because the cost was reduced by 60 to 70 percent. The company was initially using Azure Blob storage, and in Databricks, the cluster and associated infrastructure were cheaper than other platforms. This reduction in both time and money resulted in real-time impact and significant cost savings.

For advice for others considering Databricks, it is important to start by understanding its place in the data ecosystem and how it fits into your specific needs. Key points to consider include familiarizing yourself with Databricks, learning the basics, starting with data engineering, and incorporating ETL processes. You can then dive deeper into Databricks features such as notebooks, clusters, and jobs. Achieving certification enhances your skills validation. For best practices, it is critical to optimize performance and minimize complexity while continuously learning to stay competitive in the data field. Following these steps will be very beneficial for anyone pursuing a career as a data engineer and Databricks engineer.

Databricks is a truly essential platform for data engineering needs, and I recommend it to anyone looking to advance in the data engineering field. It is a very important platform and tool for every data engineer. I encourage everyone to learn and explore this product and to maximize its potential. I rate this product a 9 out of 10.

My main use case for Coralogix is that it's a great application performance monitoring tool. I use it to take care of the services through it. I set up the dashboard here for all the types of services and routes to check whenever we receive any kind of error response, time request, or issues.

The best features Coralogix offers include the ability for any organization, institution, or any kind of project owner to migrate their data to Coralogix. Coralogix has the best feature to do the migration. If we are using Grafana or any other type such as Elasticsearch, Splunk, or Datadog, we are easily able to migrate our data to Coralogix with their features. I really appreciate how they migrate directly by just exporting and importing it.

My experience with the migration process was really straightforward and quick as compared to other tools.

I want to mention that as compared to other application performance monitoring tools, this APM tool specifically has a really good looking dashboard that is very attractive and very easy to use.

After implementing Coralogix, I noticed specific outcomes and improvements. Whenever we try to fetch the data or check the monitoring logs, the spikes, the bars, and the graphs open very quickly. The latency is really very low and it opens everything very fast. It works very fast, which I really appreciate. This makes a good impact on our organization.

I think Coralogix can be improved by setting up some AI type of tool inside it which can help new users. Whenever they face any kind of issue or troubleshooting problem, I know that they already share a user guide whenever we try to set up and install Coralogix and use it for the first time. However, I would prefer an AI feature as per current trends. AI is coming into most tools, so I would prefer the same for Coralogix.

I have used Coralogix for more than four years.

Coralogix is really stable.

Coralogix's scalability is working well. It is totally scalable and not an issue.

Throughout the three to four years I have been using Coralogix, I didn't get any chance to connect directly with the customer support team. However, one of my friends used to talk to the customer care support. His personal official ID got crashed when he was trying to log in after a month. He tried to contact the customer care team by their toll-free number, and they helped him out very easily by connecting with him.

I did not use a different solution after Coralogix.

I see a return on investment in time saving. Fewer employees is a scenario that mostly comes under the NOC team. Fewer employees might not be the solution which can help with this because it's an application performance monitoring tool. For monitoring, we always need multiple employees.

I am not aware of the pricing, setup cost, and licensing for Coralogix, as this comes under the business analyst, marketing team, and pre-sales team. I am from the technical line.

Before choosing Coralogix, I did not evaluate other options. In the first option, I already had Coralogix available, so I chose it after the demo.

Coralogix has not impacted my organization in a bad manner. We are the customer here who uses Coralogix in our day-to-day work, and Coralogix is doing great. It's working very well. We had no such kind of issue with it. I would give Coralogix a rating of 10 on a scale of 1 to 10. I give it a 10 because it works really fast and mostly because of its attractive look. I would advise others looking into using Coralogix to just try to use it for once. You will really appreciate their attractive dashboard and the way they show the performance of the application. Overall, I rate this product a 10 out of 10.