Encyclopedia · 176 concepts

Core ML Concepts · beginner · concept 19 of 176

Naive Bayes

A classifier that applies Bayes' theorem with one bold simplification: treat every feature as independent. Wrong assumption, great results, especially on text, where it filtered spam for a decade and still makes a hard-to-beat baseline. Also the cleanest example of a generative classifier next to logistic regression's discriminative approach.

Key terms

Conditional independencePrior & likelihoodGenerative vs discriminativeSpam filteringLaplace smoothing

Where you meet it in the real world

Spam and abuse filters, quick text classification baselines, medical triage scoring

Videos

Courses, papers, and more