Skip to main content

describe_provenance

Function describe_provenance 

Source
fn describe_provenance(
    ordered: &[(&'static str, Option<&InferenceConfig>)],
) -> String
Expand description

Which layer supplied each resolved sampling value, as field=layer pairs.

Nothing else records this. Without it the effective sampling config is invisible at every log level, and answering “where did this presence_penalty come from?” means probing llama-server’s live /slots mid-generation — which is how the leak behind #621 had to be found.

Takes the exact same ordered layer array resolve_sampling folds through InferenceConfig::resolve_layers, so provenance can never drift from what was actually resolved — there is one ladder, read by both. Mirrors the coupling rule documented there: once a layer declares a temperature, layers below it can no longer supply the parameters tuned against it, so those report floor even though a lower layer names a value. A field with no layer naming it at all also reports floor — the two cases are indistinguishable from the wire body alone, which is the point: either way nothing above the floor spoke for it.