Enum SecondarySlotDecision 

pub enum SecondarySlotDecision {
    Grant {
        footprint_bytes: u64,
        headroom_bytes: u64,
    },
    RefuseTooLarge {
        footprint_bytes: u64,
        ceiling_bytes: u64,
    },
    RefuseNoHeadroom {
        footprint_bytes: u64,
        free_bytes: u64,
    },
    RefuseUnknownFootprint,
    RefuseUnknownBudget,
}

Whether a candidate may take the second resident slot, and why not when it may not.

A reason-carrying enum rather than a bool for the same reason CacheRamHealth is one: the dashboard has to explain an empty second slot to a user who can see they have 12 GB free, and “no” on its own is the least useful answer available.

Variants

Grant

The candidate fits with headroom to spare and may be co-loaded.

Fields

footprint_bytes: u64

What the candidate is expected to occupy.

headroom_bytes: u64

Free VRAM left over after it, before the utilisation margin.

RefuseTooLarge

The candidate exceeds SECONDARY_MAX_BYTES. The second slot is for auxiliary models; this one belongs in the swap path.

Fields

footprint_bytes: u64

What the candidate is expected to occupy.

ceiling_bytes: u64

The ceiling it exceeded.

RefuseNoHeadroom

Small enough in principle, but there is not enough free VRAM right now.

Fields

footprint_bytes: u64

What the candidate is expected to occupy.

free_bytes: u64

Free VRAM at the moment of the decision.

RefuseUnknownFootprint

The candidate’s KV footprint could not be estimated, so its true cost is unknown. Refused rather than guessed: an under-estimate co-loads a model that then OOMs the primary mid-generation.

RefuseUnknownBudget

gglib cannot read this machine’s free VRAM — every non-NVIDIA, non-Apple-Silicon GPU, and every CPU-only host. Single-slot behaviour is preserved exactly.

Implementations

impl SecondarySlotDecision

pub const fn is_grant(&self) -> bool

Whether the candidate may be co-loaded.

pub const fn label(&self) -> &'static str

Stable machine-readable label, for styling and for telemetry that should not have to parse prose.

Trait Implementations

impl Clone for SecondarySlotDecision

fn clone(&self) -> SecondarySlotDecision

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SecondarySlotDecision

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SecondarySlotDecision

fn eq(&self, other: &SecondarySlotDecision) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for SecondarySlotDecision

impl Eq for SecondarySlotDecision

impl StructuralPartialEq for SecondarySlotDecision