KwickClips Artificial Intelligence · 42 sec · free
Can a 99% accurate model be useless?
Short answer. Yes, when the cases you care about are rare.
Which metric for a spam filter?
Precision.
Pick the right metric
| Problem | Trust |
|---|---|
| Disease test | Recall |
| Spam filter | Precision |
| Fraud | F1 score |
Remember
| Rare cases fool accuracy |
| Ask which mistake costs more |
Can a ninety nine percent accurate model be useless? Yes. Pick by the costly mistake. Disease tests need recall. Spam filters need precision. Fraud needs F1 balance. Rare cases fool accuracy. Ask which mistake costs more.
This clip is from the full lesson: Model Evaluation Metrics: Confusion Matrix, Accuracy, Precision, Recall and F1 — 8 minutes, with the tables, the quick answers and the whole lesson in text.
Useful for: CBSE Class 10 Artificial Intelligence (417), CBSE Class 10 Artificial Intelligence (417), CBSE Class 10 Artificial Intelligence (417), CBSE Class 10 Artificial Intelligence (417)
More KwickClips from this lesson
Disclaimer. KwickAcademy is free study material for general learning and revision. Parts of it, including the voice-over, are produced with the help of AI tools and may contain errors; if you spot one, please tell us and we will correct it. Syllabus, marks and exam details follow the latest official board publications available to us, and boards can change them at any time, so always confirm against your board's official website and your school. Using this material does not guarantee any marks or result. Board names and trademarks belong to their owners; Kwickprep is not affiliated with or endorsed by any examination board. We never ask for passwords, OTPs or ID numbers. Your progress is saved only in this browser. Full disclaimer · Privacy