Struct InferenceProfile 

pub struct InferenceProfile {
    pub name: String,
    pub description: Option<String>,
    pub config: InferenceConfig,
    pub list_in_models: bool,
}

A named sampling profile applied on top of a model’s own defaults.

Fields

name: String

Profile slug, used as the :{suffix} on a model id.

Constrained by validate_name to lowercase alphanumerics and -.

description: Option<String>

Human-readable summary, surfaced in /v1/models and the settings UI.

config: InferenceConfig

The sampling overrides. Sparse — see the module docs.

list_in_models: bool

Whether to advertise {model}:{name} as its own /v1/models entry.

Off by default: with several models and several profiles the full cross product would swamp a client’s model picker. Users opt in for the one or two profiles they switch between often; the rest stay addressable by name without appearing in the list.

Implementations

impl InferenceProfile

pub fn validate(&self) -> Result<(), ProfileNameError>

Validate this profile’s name.

Errors

Propagates validate_name.

Trait Implementations

impl Clone for InferenceProfile

fn clone(&self) -> InferenceProfile

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceProfile

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferenceProfile

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for InferenceProfile

fn eq(&self, other: &InferenceProfile) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for InferenceProfile

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for InferenceProfile