Core ML Concepts · advanced · concept 30 of 176

🧠Self-Supervised Learning

Learning from unlabeled data by inventing the labels: predict the next word, fill in the masked patch, decide whether two crops came from the same image. This is the idea that unlocked LLMs, since the internet is unlabeled and labeling it is impossible.