Enum ParamSource 

pub enum ParamSource {
    Layer(usize),
    Floor,
    FloorCoupled,
    Unset,
}

Which rung of a sampling ladder supplied one resolved parameter.

Layer carries an index into the ladder that was resolved, rather than a name, because the ladders differ: the request pipeline adds cli and client rungs above the five that SamplingLayer describes. Callers map the index back to whatever names their own ladder used.

Variants

Layer(usize)

The layer at this index in the resolved ladder named the value.

Floor

The class floor, because no layer named a value at all.

FloorCoupled

The class floor, because a layer claimed temperature and this parameter is tuned against it, so no layer beneath was eligible to supply one. Distinct from Floor: here a lower layer may well have named a value and was deliberately passed over.

Unset

Nothing named it and the floor carries none either — max_tokens is the only parameter with no floor value, deliberately. See InferenceConfig::with_hardcoded_defaults.

Implementations

impl ParamSource

pub const fn is_floor(self) -> bool

Whether the value came from the floor rather than from any layer.

Trait Implementations

impl Clone for ParamSource

fn clone(&self) -> ParamSource

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParamSource

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ParamSource

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ParamSource

fn eq(&self, other: &ParamSource) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ParamSource

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for ParamSource

impl Eq for ParamSource

impl StructuralPartialEq for ParamSource