const BUDGET_UTILISATION: f64 = 0.9;Expand description
Fraction of the memory budget a candidate is allowed to occupy.
The remainder absorbs what this estimate deliberately does not model: the compute buffer, the framebuffer already in use by the desktop, allocator fragmentation. Sizing to 100% of nominal VRAM reliably produces a model that almost fits, which is the slowest possible outcome.