pub struct CompareConfig {
pub model_ids: Vec<i64>,
pub prompt: String,
pub system_prompt: Option<String>,
pub inference: Option<InferenceConfig>,
pub ctx_size: Option<u64>,
}Expand description
Configuration for a compare benchmark run.
Fields§
§model_ids: Vec<i64>Models to benchmark (by database ID), run sequentially.
prompt: StringPrompt text to send to every model.
system_prompt: Option<String>Optional system prompt.
inference: Option<InferenceConfig>Per-request inference overrides (temperature, max_tokens, etc.).
ctx_size: Option<u64>Override the llama-server context window size for this run.
When None the benchmark service falls back to the app-wide
default_context_size setting (same fallback the proxy uses).
Trait Implementations§
Source§impl Clone for CompareConfig
impl Clone for CompareConfig
Source§fn clone(&self) -> CompareConfig
fn clone(&self) -> CompareConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CompareConfig
impl Debug for CompareConfig
Source§impl<'de> Deserialize<'de> for CompareConfig
impl<'de> Deserialize<'de> for CompareConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CompareConfig
impl RefUnwindSafe for CompareConfig
impl Send for CompareConfig
impl Sync for CompareConfig
impl Unpin for CompareConfig
impl UnsafeUnpin for CompareConfig
impl UnwindSafe for CompareConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more