Skip to main content

decide_secondary_slot

Function decide_secondary_slot 

Source
pub fn decide_secondary_slot(
    candidate: Option<SlotFootprint>,
    free_vram_bytes: Option<u64>,
) -> SecondarySlotDecision
Expand description

Decide whether candidate may stay resident alongside what is already loaded.

free_vram_bytes is the live figure — what is actually free on the device now, with the primary model already loaded — not the card’s nominal capacity. None means gglib could not read it, which is a refusal rather than an assumption in either direction.

The candidate must clear both tests: the absolute ceiling (SECONDARY_MAX_BYTES) and the live budget scaled by RESIDENCY_UTILISATION. The ceiling is checked first so a large model on a large card reports the reason that will still be true tomorrow.