Enterprise IT / AI
Model Monitoring
What is Model Monitoring?
The performance of AI models deployed in real-world scenarios can degrade over time. When the model encounters real-world data that varies significantly from the data used during training, AI efficiency and accuracy both decrease (known as “data draft”). Model monitoring software generates insights regarding model performance, outliers in predictions, and suspected adversarial attacks. Vendors here solve for the “black box” problem in AI — the lack of visibility into algorithmic decision-making — increasing the transparency surrounding business decisions made using AI.
Selling a product or service?
Reach more buyers.
Your future customers are researching their next tech solution on CB Insights. Make sure they can find you.
Claim your CB Insights ProfileLeaders
Leaders are the most established service providers in the market and possess the breadth to address various customer needs.
See why these companies made it as leaders for Model Monitoring. These companies include Fiddler AI and ArthurAI.
United States / Founded Year: 2018
Fiddler AI is building an explainable AI engine that will allow companies to analyze, manage, and deploy their machine learning models at scale. It serves businesses ranging from large enterprises to startups.
United States / Founded Year: 2018
ArthurAI partners with the companies in industries such as financial services, insurance, and healthcare to develop and deploy enterprise-grade artificial intelligence (AI) systems. It specializes in centralized AI monitoring and explainability and helping businesses build and maintain control over production AI.
Key People
Gregory Benko
United States / Founded Year: 2019
Arize AI develops a real-time analytics platform for “observability” in artificial intelligence and machine learning to watch, troubleshoot and guardrail deployed AI.
Known Partners
Key People
Jason Lopatecki, Aparna Dhinakaran
Highfliers
Highfliers are the most innovative service providers in the market and possess the resources to address evolving customer needs.
See why these companies made it as highfliers for Model Monitoring. These companies include WhyLabs and Robust Intelligence.
United States / Founded Year: 2019
WhyLabs is an AI observability platform for model monitoring and data monitoring that scales to support massive data. Built for practitioners, by practitioners.
Known Partners
Anyscale, Confluent, Databricks, and 2 more
Key People
Alessya Visnjic, Maria Karaivanova, Sam Gracie
United States / Founded Year: 2019
Robust Intelligence builds products that integrate seamlessly into the AI development life cycle to ensure robustness and reliability. Its customers include technology companies, financial institutions, and government agencies.
Key People
Yaron Singer, Alexander Rilee, Eric Balkanski, and 1 more
Israel
Aporia helps artificial intelligence and machine learning teams with model productization. The company provides a monitoring platform for machine learning to address concept drift, data integrity issues, and retraining insights.
Known Partners
Key People
Zohar Einy, Liran Hason, Dvora Nuriel-Valach, and 1 more
Outperformers
Outperformers are the most specialized service providers in the market and possess the expertise to address unique customer needs.
See why these companies made it as outperformers for Model Monitoring. These companies include Superwise.ai and NannyML.
Israel / Founded Year: 2019
Superwise.ai’s AI assurance platform includes performance management, bias detection, explainability and AI analytics capabilities. The platform gives business leaders a direct view into what’s happening in their AI models and why, and also offers proactive actions and recommendations to optimize the model’s behavior for better performance and outcomes.
Belgium / Founded Year: 2020
NannyML develops an AI-monitoring platform designed to detect data drift, concept drift and estimate possible model degradation. The company's system measures the performance of the AI models in production, automatically lets the user know when their AI models are failing and offering a deep and intuitive understanding of how the AI models make decisions and those change over time, enabling decision-makers to monitor the decisions that AI takes and make their business decisions accordingly.
Key People
Wiljan Cools, Wojciech Kuberski, Hakim Elakhrass
Challengers
Challengers are the most promising service providers in the market and possess the agility to address emerging customer needs.
See why these companies made it as challengers for Model Monitoring. These companies include .
What is Model Monitoring?
The performance of AI models deployed in real-world scenarios can degrade over time. When the model encounters real-world data that varies significantly from the data used during training, AI efficiency and accuracy both decrease (known as “data draft”). Model monitoring software generates insights regarding model performance, outliers in predictions, and suspected adversarial attacks. Vendors here solve for the “black box” problem in AI — the lack of visibility into algorithmic decision-making — increasing the transparency surrounding business decisions made using AI.
Selling a product or service?
Reach more buyers.
Your future customers are researching their next tech solution on CB Insights. Make sure they can find you.
Claim your CB Insights Profile