pub struct ModelBenchmarkSummary {
pub model_id: i64,
pub best_tg_tps: Option<f64>,
pub best_pp_tps: Option<f64>,
pub latest_tg_tps: Option<f64>,
pub latest_pp_tps: Option<f64>,
pub latest_backend: Option<String>,
pub perf_run_count: i64,
pub compare_run_count: i64,
pub last_benchmarked_at: DateTime<Utc>,
pub updated_at: DateTime<Utc>,
}Expand description
Denormalised benchmark summary for a single model.
Upserted in the same transaction as each new result so that the model list query can LEFT JOIN this table and show speed badges without extra round-trips.
Fields§
§model_id: i64Foreign key → models.id.
best_tg_tps: Option<f64>Best token-generation throughput across all perf runs.
best_pp_tps: Option<f64>Best prompt-processing throughput across all perf runs.
latest_tg_tps: Option<f64>Token-generation throughput from the most recent perf run.
latest_pp_tps: Option<f64>Prompt-processing throughput from the most recent perf run.
latest_backend: Option<String>Backend reported by the most recent perf run.
perf_run_count: i64Total number of perf runs recorded for this model.
compare_run_count: i64Total number of compare runs recorded for this model.
last_benchmarked_at: DateTime<Utc>UTC timestamp of the most recent benchmark (either type).
updated_at: DateTime<Utc>UTC timestamp of the last summary update.
Trait Implementations§
Source§impl Clone for ModelBenchmarkSummary
impl Clone for ModelBenchmarkSummary
Source§fn clone(&self) -> ModelBenchmarkSummary
fn clone(&self) -> ModelBenchmarkSummary
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelBenchmarkSummary
impl Debug for ModelBenchmarkSummary
Source§impl<'de> Deserialize<'de> for ModelBenchmarkSummary
impl<'de> Deserialize<'de> for ModelBenchmarkSummary
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for ModelBenchmarkSummary
impl RefUnwindSafe for ModelBenchmarkSummary
impl Send for ModelBenchmarkSummary
impl Sync for ModelBenchmarkSummary
impl Unpin for ModelBenchmarkSummary
impl UnsafeUnpin for ModelBenchmarkSummary
impl UnwindSafe for ModelBenchmarkSummary
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more