Jun 29, 2021
There are many factors and we know little about your requirements (size of org, technology stack, management systems, the scope of implementation). Our goal was to consolidate APM and infra monitoring. We maintain critical processing on our mainframe so there was a desire to include this in our transaction trace. Due to a highly mature ELK implementation, we are not trying to incorporate log analytics into solution buy may consider in the future. We had AppD, Dynatrace, New Relic, and CA Wily all in house at the time of our evaluation. We eliminated Datadog due to a lack of real user monitoring and AppD based on experience and licensing. Between Dynatrace and New Relic, Dynatrace won based on the automation, integrated AI, support for "old" techs, and confidence we could eliminate multiple APM and infra monitoring tools.
I would not include products like BigPanda, MoogSoft, in this analysis. They are not monitoring solutions but event correlation solutions. You will need additional monitoring products to capture data and feed them. Having said that if you cannot consolidate tools you will likely need to purchase an event solution to make sense of all the alarms. We did evaluate these products but with Dynatrace AI did not feel the business value was there for the investment.
Here's a quick pro/con list on Dynatrace & New Relic from our analysis.
New Relic Pros: Insights is an awesome product and capability. Lots of capabilities and plugins to extend data collection. The APM dashboard is aesthetically pleasing and intuitive. Good training and documentation are available to support the product.
New Relic Cons: Requires lots of manual configurations to implement and support. Insights product requires an investment of time to achieve value. Licensing is a nightmare as there is virtually no transparency in what you are being charged for. Lack of solution to consolidate alerts across implementation other than significant investment in insights to manually achieve this.
Dynatrace Pros: Very simple to implement and maintain with out of the box automation which supports modern (cloud/Kubernetes) and "old" (mainframe). In-app chat is helpful. High integration of infra and APM data for full-stack observability and engineering. Topology and trace discovery is more reliable than other products or our CMDB. Synthetics are easy to set up for any user. AI-assisted problem analysis on the trace discovery streamlines troubleshooting. AI includes "events" in an analysis like VMotion, deployment events. Have not done yet but looking to leverage monitoring as code for a fully integrated and automated delivery pipeline. See keptn.sh open source project.
Dynatrace Cons: User SQL lacks some functions of NRQL for user analysis. Host, process, and service data is not available to query within the product. Alarm processing lacks some granular controls. The Plug-in library is less robust.
Good luck with your decision!
