Skip to main content

Module reasoning_effort

Module reasoning_effort 

Source
Expand description

The reasoning_effort level — how hard the model is asked to think.

Kept out of inference deliberately. This is not a sampler and it does not behave like one: it is a string that a chat template may read at render time, its level vocabulary is per-template folklore (ADR 0007 finding 3), and the whole reason it exists as a type rather than a String is a governance argument that needs room to be written down. inference.rs is already the largest file in this module and the ladder is the thing it should be about; template_caps (the other half of ADR 0007) set the same precedent one PR ago.

Enums§

ReasoningEffort
A reasoning-effort level gglib is willing to put on the wire.