Skip to main content

resolve_context_size

gglib_core::server_config

Function resolve_context_size 

Source 
pub fn resolve_context_size(opts: &ServerConfigOptions) -> u64
Expand description

Resolve context size using the 4-level fallback chain.

  1. Runtime request / CLI flag (opts.context_size) — highest priority
  2. Per-model server defaults (opts.model_server_ctx) — from DB
  3. Global app setting (opts.global_default_ctx)
  4. Hardcoded default (DEFAULT_CONTEXT_SIZE = 4096) — lowest priority