šŸ¤– ML Model Explainability & Monitoring Platform

Real-time governance, explainability, and drift detection for production ML models

Model Registry

Performance Over Time (6 Months)

Annotated with deployment events. Red zones indicate performance degradation.

Prediction Distribution Monitor

Prediction Probability Distribution
Calibration Curve

Model Evaluation Metrics

Confusion Matrix
ROC Curve
Precision-Recall Curve
Threshold Optimization
0.50
Sensitivity (TPR)
0.85
Specificity (TNR)
0.82
F1 Score
0.83

Feature Importance (Global Explainability)

Permutation-based feature importance showing the impact of each feature on model predictions.

SHAP Beeswarm Plot (Top 12 Features)

Each dot represents a prediction. X-axis = SHAP value (impact on model output). Color = feature value (red=high, blue=low).

Partial Dependence Plots (PDP) & Individual Conditional Expectation (ICE)

PDP (blue line) shows average model behavior. ICE (gray lines) show individual prediction changes. Use dropdown to explore different features.
Partial Dependence Plot
Individual Conditional Expectation (ICE)

Data Drift Heatmap (PSI Over Time)

Population Stability Index (PSI) per feature across time periods. Red = high drift (>0.25), Yellow = medium drift (>0.1), Green = low drift.

Population Stability Index (Current vs Reference)

PSI threshold: >0.1 (yellow), >0.25 (red). Green bars indicate stable distributions.

Distribution Comparison: Reference vs Current

KDE curves comparing training (blue) vs production (orange) distributions for each feature.
Feature Distribution

Fairness & Bias Analysis

Monitoring demographic parity, equal opportunity, and disparate impact ratios across protected groups.
Demographic Parity (Positive Rate by Group)
Equal Opportunity (TPR by Group)
Disparate Impact Ratios
Fairness Metrics Summary (Age Groups)
Age Group Positive Rate TPR TNR DI Ratio

Prediction Explorer & What-If Analysis

Adjust input features to see real-time predictions. Waterfall chart shows local explainability (feature contributions to this specific prediction).
Input Features
35 years
$60k
5 years
25 events/month
5 tickets
0 days
Current Model: Customer Churn Predictor
35.2%
Confidence: High

Local Explainability (SHAP-style Feature Contributions)

Sensitivity Analysis

Model Comparison

Side-by-side comparison of different model versions. Select models to compare across multiple metrics.
Model Metrics Comparison
Metric v1.0 v2.0 Delta
Radar Chart Comparison
Performance Metrics Across Time