Struct ServerConfig 

pub struct ServerConfig {
    pub context_length: Option<usize>,
}

Server-level defaults for a specific model.

Stores per-model server configuration parameters that override global settings but can themselves be overridden at request time. This is part of the 5-level fallback chain:

1. Runtime request / CLI flag (highest priority)
2. Model server_defaults (from DB, stored as JSON in server_defaults column)
3. Global app setting, when the user set one
4. Fitted to this machine
5. Hardcoded default (lowest priority)

All fields are optional to support partial configuration.

Examples

use gglib_core::domain::ServerConfig;

// Override only the context length for a long-context model
let config = ServerConfig {
    context_length: Some(32768),
};

Fields

context_length: Option<usize>

Context length (number of tokens) for the model server.

Controls the maximum context window the server will use. This field is level 2 of the chain above, so None falls through to levels 3 through 5: the global setting, a context fitted to this machine, and finally the built-in floor — which is where a host whose device gglib cannot read ends up. Common values: 8192, 32768, 131072.

Trait Implementations

impl Clone for ServerConfig

fn clone(&self) -> ServerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ServerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ServerConfig

fn default() -> ServerConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ServerConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ServerConfig

fn eq(&self, other: &ServerConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ServerConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for ServerConfig

impl StructuralPartialEq for ServerConfig