Struct SlotFootprint 

pub struct SlotFootprint {
    pub weights_bytes: u64,
    pub kv_bytes: u64,
}

What one resident model is expected to occupy in VRAM.

Weights and KV are tracked separately rather than pre-summed because they come from different places and fail differently: weights are a measured file size, KV is an estimate from GGUF metadata that may be missing entirely. A caller reporting a refusal wants to say which half was the problem.

Fields

weights_bytes: u64

Model weights on disk, summed across shards. 0 when unknown.

kv_bytes: u64

KV cache at the context this launch will use.

Implementations

impl SlotFootprint

pub const fn new( weights_bytes: u64, kv_elems_per_token: Option<KvElemsPerToken>, cache_type_k: KvCacheType, cache_type_v: KvCacheType, context_size: u64, ) -> Option<Self>

Assemble a footprint from a model’s launch inputs.

kv_elems_per_token is None for models whose GGUF metadata does not carry the layer/head counts (see estimate_kv_elems_per_token). That yields a footprint of weights alone, which understates the true cost — so decide_secondary_slot treats an unknown KV as disqualifying rather than free. See SecondarySlotDecision::RefuseUnknownFootprint.

pub const fn total(&self) -> u64

Total VRAM this model is expected to occupy.

Trait Implementations

impl Clone for SlotFootprint

fn clone(&self) -> SlotFootprint

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SlotFootprint

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SlotFootprint

fn eq(&self, other: &SlotFootprint) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for SlotFootprint

impl Eq for SlotFootprint

impl StructuralPartialEq for SlotFootprint