Struct AgenticTaskComparison 

pub struct AgenticTaskComparison {
    pub task_id: String,
    pub category: TaskCategory,
    pub raw: Vec<TuneTaskResult>,
    pub gglib: Vec<TuneTaskResult>,
}

One task’s outcome under both arms, for drill-down.

Both sides carry one entry per seed, in seed order, rather than a single result. Collapsing them to a representative run would hide the thing a multi-seed eval is for: a task that passes 3/3 under one arm and 1/3 under the other is a different finding from one that passes 3/3 versus 0/3, and both render as “passed / failed” once the per-seed detail is gone.

Fields

task_id: String

Task identifier from the suite.

category: TaskCategory

The task’s BFCL-style category.

raw: Vec<TuneTaskResult>

Per-seed results under the raw arm, in seed order.

gglib: Vec<TuneTaskResult>

Per-seed results under the gglib arm, in seed order.

Implementations

impl AgenticTaskComparison

pub fn pass_counts(&self) -> (usize, usize)

How many of this task’s seeds passed under each arm.

The per-task view of stability: (2, 3) means two of three seeds passed, which is a materially different claim from a bare passed: true taken from whichever seed happened to run first.

pub fn is_unstable(&self) -> bool

Whether either arm disagreed with itself across seeds.

A task that flips between passing and failing on identical configuration is where suite-level variance comes from, and naming it per task is what turns “the numbers moved” into something actionable.

Trait Implementations

impl Clone for AgenticTaskComparison

fn clone(&self) -> AgenticTaskComparison

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AgenticTaskComparison

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for AgenticTaskComparison

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for AgenticTaskComparison

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.