Pretraining Is General Education

The candidate's education comes in two stages. The first is pretraining.

Pretraining has the model read an enormous body of text, out of which grow language ability, world knowledge, and basic reasoning. This stage targets no particular job; it provides the underlying caliber. It corresponds to everything from learning to read through a university's general curriculum — it teaches not how to do some profession, but the general abilities an educated person is supposed to have.

General education sets the ceiling, not competence

What general education produces is potential, not competence in a role.

Someone who has finished the general curriculum has the foundation to study any major, but at this moment they cannot do a single concrete piece of your company's work. Pretraining gives the model the same thing: broad knowledge, strong language and reasoning — the things that set the ceiling and breadth of its ability. But whether it can do your work is a question pretraining cannot answer. That falls to the vocational education and onboarding training that come later.

There is a common misuse here: treating a generalist as a specialist. You expect pretrained knowledge to cover your proprietary domain, your company's internal conventions, your customers' specifics — and then watch the model get it wrong with a straight face. The model has not gotten dumber. You are demanding specialist output from the product of a general education. General knowledge is broad but shallow; it knows roughly how the world works, not how your particular corner of it works.

Everything beyond the ceiling comes later

Why a model, as a probabilistic component, produces inherently uncertain output is a model-layer question (see the first book). Here we take just one angle: what pretraining delivers is a brain with potential, not yet an employable person.

Turning that brain into an employable person is the job of the second stage of education.