Struct ModelCandidate 

pub struct ModelCandidate {
    pub repo: &'static str,
    pub quantization: &'static str,
    pub weights_bytes: u64,
    pub kv_elems_per_token: KvElemsPerToken,
    pub context: u64,
    pub rationale: &'static str,
}

One entry in the shortlist.

Weights are recorded as the actual byte size of the quantized file on Hugging Face — not a rounded “about 18 GB” — because the whole point is to compare against a real memory figure. The KV shape comes from the model’s own config so the cache cost is computed by kv_estimate, not restated here as a second magic number.

Fields

repo: &'static str

Hugging Face repository id, passed verbatim to the download queue.

quantization: &'static str

Quantization to request from that repository.

weights_bytes: u64

Size of the quantized weights, in bytes.

kv_elems_per_token: KvElemsPerToken

Per-token KV cache element counts, derived from the model’s config.

context: u64

Context this candidate is sized for.

rationale: &'static str

Why this model, in the user’s terms. Printed verbatim.

Implementations

impl ModelCandidate

pub const fn required_bytes(&self) -> u64

Total memory this candidate needs: weights plus KV cache at context, quantized to the gglib default.

Uses kv_bytes_per_token with KvCacheType::Q8_0 on both sides because that is what the runtime actually launches with (see gglib_runtime::llama::args::kv_cache_type). A recommendation computed against f16 would over-reserve by roughly the KV cache again.

pub fn min_budget_bytes(&self) -> u64

The smallest memory budget this candidate may be recommended for.

Trait Implementations

impl Clone for ModelCandidate

fn clone(&self) -> ModelCandidate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelCandidate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ModelCandidate

fn eq(&self, other: &ModelCandidate) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ModelCandidate

impl Eq for ModelCandidate

impl StructuralPartialEq for ModelCandidate