Enum LlmStreamEvent 

pub enum LlmStreamEvent {
    TextDelta {
        content: String,
    },
    ReasoningDelta {
        content: String,
    },
    ToolCallDelta {
        index: usize,
        id: Option<String>,
        name: Option<String>,
        arguments: Option<String>,
    },
    PromptProgress {
        processed: u32,
        total: u32,
        cached: u32,
        time_ms: u64,
    },
    Done {
        finish_reason: String,
    },
    NormalizationError {
        kind: NormalizationErrorKind,
        raw: String,
    },
}

A single event produced by a streaming LLM response.

These low-level events are the currency of crate::ports::LlmCompletionPort; they are parsed by adapter crates from raw SSE frames and handed to gglib-agent’s stream collector, which:

• Forwards TextDelta items directly to the caller’s AgentEvent channel so text appears in real time.
• Accumulates ToolCallDelta fragments until the stream ends, then assembles them into ToolCall values.
• Waits for Done before triggering tool execution.

Variants

TextDelta

An incremental text fragment from the model’s response.

Fields

content: String

The new text fragment (append to the running content buffer).

ReasoningDelta

An incremental reasoning/thinking fragment (CoT tokens).

Produced by reasoning-capable models (e.g. DeepSeek R1, QwQ) when llama-server is started with --reasoning-format deepseek. The runtime adapter maps delta["reasoning_content"] frames to this variant; the stream collector forwards them as AgentEvent::ReasoningDelta and accumulates them in a separate buffer that is never sent back to the LLM as context.

Fields

content: String

The new reasoning fragment (append to the current reasoning buffer).

ToolCallDelta

An incremental fragment of a tool-call request.

The adapter crate streams these before the model has finished generating the full arguments JSON. The stream collector accumulates all deltas for a given index into a single ToolCall.

Fields

index: usize

Zero-based index of the tool call within the current response.

id: Option<String>

Call identifier (only present in the first delta for this index).

name: Option<String>

Tool name (only present in the first delta for this index).

arguments: Option<String>

Partial arguments JSON string fragment (accumulate with push_str).

PromptProgress

Prompt-processing progress from llama-server.

Emitted when the request includes return_progress: true. These frames arrive during the pre-fill phase (before any TextDelta), giving real-time visibility into how far along token ingestion is.

Fields

processed: u32

Number of tokens processed so far.

total: u32

Total number of tokens in the prompt.

cached: u32

Number of tokens served from KV cache (already processed).

time_ms: u64

Elapsed wall-clock time in milliseconds since processing began.

Done

Signals the end of the stream.

Every conforming stream must end with exactly one Done item.

Fields

finish_reason: String

The OpenAI-compatible finish reason (e.g. "stop", "tool_calls", "length").

NormalizationError

A non-fatal normalization issue surfaced by the crate::normalize layer.

Emitted when a dialect-specific parser detects malformed markup (e.g. a Qwen <tool_call> whose body is not valid JSON, or a tag that the stream ended without closing). The stream is not aborted; the offending bytes are simply discarded or surfaced via this event so consumers can log diagnostics.

Fields

kind: NormalizationErrorKind

Structured detail about what went wrong.

raw: String

Short, human-readable excerpt of the offending input.

Trait Implementations

impl Clone for LlmStreamEvent

fn clone(&self) -> LlmStreamEvent

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmStreamEvent

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LlmStreamEvent

fn eq(&self, other: &LlmStreamEvent) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for LlmStreamEvent

impl StructuralPartialEq for LlmStreamEvent