Small language model (SLM)

Small language model (SLM)

A language model deliberately built or reduced, through methods such as distillation or quantisation, to have far fewer parameters than the largest frontier models, trading some capability for the ability to run cheaply, locally, and with lower energy use. Small language models are of particular interest to organisations prioritising digital sovereignty, since they can be self-hosted rather than accessed through a large provider's API. (See also: Knowledge distillation, Digital sovereignty)