Classification and Score Validation
10 algorithms in Model Validation and Backtesting · 10 with asserted arithmetic.
In this family#
-
ROC Curve and ROC-AUC verified
rocCurveAndRocAuc(inputs) -
Precision-Recall Curve and PR-AUC verified
precisionRecallCurveAndPrAuc(inputs) -
Brier Score verified
brierScore(inputs) -
Log Loss verified
logLoss(inputs) -
Reliability Diagram and Expected Calibration Error verified
reliabilityDiagramAndExpectedCalibrationError(inputs) -
Gains, Lift, and Decile Capture verified
gainsLiftAndDecileCapture(inputs) -
Cost-Sensitive Threshold Optimization verified
costSensitiveThresholdOptimization(inputs) -
Score Stability and Migration Matrix verified
scoreStabilityAndMigrationMatrix(inputs) -
Slice-Based Validation by Sector, Country, and Regime verified
sliceBasedValidationBySectorCountryAndRegime(inputs) -
Rare-Event Backtest and Confidence Bounds verified
rareEventBacktestAndConfidenceBounds(inputs)
What they share#
Every topic here is a record-transform, so once you have
called one the rest follow the same shape. Import paths differ only in the final segment:
import { rocCurveAndRocAuc } from "fintech-algorithms/model-validation-and-backtesting/classification-and-score-validation/roc-curve-and-roc-auc";
import { precisionRecallCurveAndPrAuc } from "fintech-algorithms/model-validation-and-backtesting/classification-and-score-validation/precision-recall-curve-and-pr-auc";Read them in the order above — the sequence is pedagogical, not alphabetical.
Where this sits#
Model Validation and Backtesting collects 10 algorithms across 1 family. For the concept behind this family rather than the call signatures, see the concept guides.