Skip to main content

sampling_templates

Function sampling_templates 

Source
fn sampling_templates() -> Vec<InferenceProfile>
Expand description

The distribution-shaping templates: temperature and top_p only.

chat is the only one listed in /v1/models out of the box — it is the conversational-client case that motivates the feature, and one visible variant keeps the model picker useful without swamping it.