Skip to main content

Module sampling

Module sampling 

Source
Expand description

Stage 4–5: resolving what the model is asked to sample with.

Unlike super::messages, nothing here reads messages — these transforms only ever touch top-level keys.

Structs§

SamplingLayers
The sampling layers that sit below the client’s own request parameters.

Functions§

describe_provenance 🔒
Which layer supplied each resolved sampling value, as field=layer pairs.
resolve_sampling
Resolve the sampling hierarchy into body, then pin cache_prompt.