What is our primary use case?
The use cases for Splunk Real User Monitoring (RUM) are almost the same as Dynatrace, for people who want to do infrastructure monitoring, application monitoring, or check their front-end monitoring, such as monitoring for the real user. They are actually using Splunk Real User Monitoring (RUM).
What is most valuable?
The best advantages and features in the product are notable. Splunk Real User Monitoring (RUM) seemed to have advantages in 2015, but when Cisco acquired AppDynamics, they stopped upgrading for a few years. Their advantage now is that they are the only solution that can monitor above SAP. Apart from that, Datadog and Dynatrace have superior features. Splunk Real User Monitoring (RUM) has one great advantage in that if they have SAP users, they can monitor their SAP applications.
In terms of features, UI, or the ability to do monitoring of RUM, the picture by UI or the ability to actually do the monitoring is pretty good, but not as good as Dynatrace, Catchpoint, Datadog, and New Relic.
What needs improvement?
My thoughts on room for improvement in general relate to Cisco trying to mount the Cisco cloud solution when they have AppDynamics, but after acquiring Splunk, they changed their roadmap. It's inevitable that when a big company has resources but changes the roadmap, it takes time to establish well-structured manuals and guidelines. I believe they will get better, but right now, they need some improvement.
For how long have I used the solution?
I have been selling Splunk Real User Monitoring (RUM) for almost the same duration as NetScout; it's been 3 years.
What was my experience with deployment of the solution?
In terms of deployment, Dynatrace is the easiest by far. For Datadog and Splunk Real User Monitoring (RUM), you have to work with scripts, meaning you need an engineer for deployment; Dynatrace is straightforward and really easy.
What do I think about the stability of the solution?
Regarding stability of RUM, stability is also a problem because during the POC, we ask customers not to deploy RUM or EUM scripts in the actual stage. We encourage them to test in staging because even if those solutions are certified and tested, customers have many different environments. Unlike NetScout or regular agents for APM, RUM has many problems during the POC phase because customer environments vary widely.
What do I think about the scalability of the solution?
In terms of scalability, the solution is scalable enough, but sometimes implementation is hard. However, it doesn't take more than a month. The issue is mainly about pricing because if they want to monitor more, it costs money. Those who have a great pricing plan or volume table will gain an advantage.
How are customer service and support?
Support from Splunk is not very helpful because Splunk doesn't have a dedicated APM; they only have one APM engineer in Korea.
If I were to rate technical support for Splunk Real User Monitoring (RUM) from 1 to 10 points, I would give it a score of 5.5. I appreciate the engineer, but since there's only one person doing everything, it's not easy. Cisco doesn't hire enough personnel, and I heard they don't have enough staff in APAC. Datadog and Dynatrace, especially Datadog, cover a huge market share in Asia, and that's why other competitors are not investing enough at this time.
How would you rate customer service and support?
What about the implementation team?
My clients, such as Hyundai and POSCO, are using RUM; most of them use Dynatrace. For those using Splunk Real User Monitoring (RUM), it took time to implement because our engineer tried really hard.
What was our ROI?
Regarding whether the solution provides ROI or savings, I understand that even Dynatrace, Datadog, or Splunk has a low price per transaction, but it concerns the number of data and sessions. People struggle to comprehend the total budget, which might be massive. Customers need to understand this, and I'm not sure if it's possible; maybe some companies just decided to take the entire market and cut down prices, but anyone working in front-end management should recognize the market price to see the true value of end-user monitoring.
What other advice do I have?
I am the general manager of this company, and a team leader focusing on Dynatrace, Cisco AppDynamics, and NetScout, while we used to do some other APM solutions but not extensively. We only focus on those three solutions.
We try to sell Splunk User Behavior Analytics, but we haven't been able to sell it so far because Splunk used to be a great company in Korea. After Cisco acquired it, it's complicated because when two companies merge together, they have issues with who will be the product seller, the sales personnel or the engineer. Their organization is not fully merged yet, which leads to fewer marketing and sales activities.
The integration in real user monitoring from Splunk is actually another problem because of some vacancies when they merged the companies and changed the organizations; there are issues with the manual not being complete. When you work with integration, Datadog and Dynatrace have issues but have to work with the manual; AppDynamics has many people and support. The satisfaction level is around six compared to Dynatrace, which might be a seven or eight. The innovation level is not complete, but they are working on it.
When using real user monitoring to analyze performance bottlenecks, the most critical metrics include data from Catchpoint, which has extensive data to gather, and Dynatrace also gathers substantial data. However, sometimes it's unnecessary because customers in charge of front-end monitoring should see the problems immediately and act with reporting to their superior. A simple UI is crucial; that's perhaps why Datadog has the advantage with their comprehensive UI.
Regarding pricing for RUM, it becomes another problem because Splunk and Dynatrace and Datadog don't ask customers to use RUM for every single session. Many large customers want to monitor every session, resulting in a big gap. For example, Korean Air, which is among the top five air travel companies in the world, uses Datadog but changed to Dynatrace because, even with a limited budget, Dynatrace managed to persuade them to monitor just 10% of user sessions to reduce the budget, and they are satisfied with the results.
This review rates Splunk Real User Monitoring (RUM) 5 out of 10.
Which deployment model are you using for this solution?
Hybrid Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Disclosure: My company has a business relationship with this vendor other than being a customer. Reseller