Expand description
Canonical context-size resolver (4-level fallback chain).
Extracted to gglib-core so that crates which cannot depend on
gglib-runtime (e.g. gglib-proxy) can still use the same resolution
logic for idle-model advertisements in /v1/models.
Re-exports§
pub use crate::cache_config::CacheRamSetting;pub use crate::domain::cache_budget::CACHE_RAM_FLOOR_BYTES;pub use crate::domain::cache_budget::CACHE_RAM_HEADROOM_BYTES;pub use crate::domain::cache_budget::CACHE_RAM_UNKNOWN_KV_ALLOWANCE_BYTES;pub use crate::domain::cache_budget::compute_auto_cache_ram_mb;
Structs§
- Server
Config Options - Caller-supplied overrides for
resolve_context_size.
Enums§
- CtxSize
Arg - A parsed
--ctx-sizeCLI flag, before it is resolved against model metadata.
Functions§
- parse_
ctx_ size_ flag - Parse an optional raw
--ctx-sizeflag into aCtxSizeArg. - resolve_
context_ size - Resolve context size using the 4-level fallback chain.