SHWASA
CALIBRATING SIGNAL042%
LIVE RESEARCH PROTOTYPENOT FOR CLINICAL DIAGNOSIS

04 / Evaluation

Measure what matters.

Evaluation is framed around useful separation, calibration, and failure analysis—not a single headline number.

MEASURED / MODEL 0187.73%Accuracy · Held-out test cohort
MEASURED / MODEL 0292.56%ICBHI score · Average sensitivity + specificity

These scores come from different tasks and split protocols. They are complementary evidence, not a direct ranking.

Research artifactInteractive figure
Evaluation processClick to inspect · Esc to close
Research artifactInteractive figure
Held-out performance metricsClick to inspect · Esc to close
Interactive evaluation lab

Read the model under pressure.

Move the operating point, inspect class behavior, and compare how the model generalizes. Every chart below uses illustrative demo data.

DEMO DATA
Headline metric
Accuracy87.73%
CNN + BiLSTM
87.7
EfficientNetB0
84.2
MFCC baseline
76.4
Confusion matrix · threshold linked
Pred +Pred −True +8515True −1486
Normalized illustrative counts
ROC curvethreshold marker follows the slider
Training / validation losseight illustrative epochs
stable
Class-wise performancemacro F1 by sound type
90.3%
Decision threshold0.50
Sensitivity 89%Specificity 86%Precision 83%F1 86%
01

Label balance

Inspect class coverage before interpreting a result.

02

Patient-level separation

Keep recordings from the same patient out of both train and test evidence.

03

Calibration

Compare confidence with correctness before review.

04

Error review

Return to the recording and understand the model’s miss.

Prototype statusThreshold interactions are illustrative until linked to persisted evaluation artifacts.
SHWASA · RESPIRATORY ACOUSTIC INTELLIGENCEOPEN METHODS / INSPECTABLE OUTPUTS