LiveSPX7,620-1.28%NDX29,127-1.41%US10Y4.961%+3.23%BTC76,816-1.24%ETH2,468-2.07%GOLD4,320-1.02%NVDA210.96-8.42%MSFT505.41+1.14%GOOGL349.39+3.23%
Advertisement
AI glossary

Distillation

Training a small model to imitate a big one.

Distillation uses a large "teacher" model to generate outputs that train a much smaller "student", transferring most of the behaviour at a fraction of the serving cost.

The resulting small model is cheaper, faster and often good enough for a narrow task — which is what makes on-device and high-volume AI economically viable.

It is also contentious: distilling a competitor's model is prohibited by most frontier providers' terms.

Related terms