Generate interactive reports in the notebook or export them as an HTML file. Use them for visual evaluation, debugging and sharing with the team. Run the data and model checks as part of the pipeline. Integrate with tools like Mlflow or Airflow to schedule the tests and log the results. Collect the model quality metrics from the deployed ML service. Currently works through integration with Prometheus and Grafana.
Model Performance Management (MPM) is the foundation of model/MLOps, providing continuous visibility into your training and production ML, understanding why predictions are made, and enabling teams with actionable insights to refine and react to changes to improve your models. MPM is reliant not only on metrics but also on how well a model can be explained when something eventually goes wrong.
NannyML empowers data scientists to detect and understand silent model failure, so you can end these worries in minutes!
NannyML turns the machine learning flow into a cycle, empowering data scientists to do meaningful and informed post-deployment data science to monitor and improve models in production through iterative deployments.
Arthur helps data scientists, ML engineers, product owners, and business leaders accelerate model operations at scale. We work with enterprise teams to monitor, measure, and optimize model performance and quality.
