Struct CacheUsage 

pub struct CacheUsage {
    pub reporting_requests: u64,
    pub unreported_requests: u64,
    pub prompt_tokens: u64,
    pub cached_tokens: u64,
    pub last_prompt_tokens: Option<u32>,
    pub last_cached_tokens: Option<u32>,
}

A point-in-time view of prompt-cache reuse since the proxy started.

Fields

reporting_requests: u64

Completed requests whose upstream reported a cached-token count. The denominator for Self::cached_tokens and Self::prompt_tokens.

unreported_requests: u64

Completed requests whose upstream omitted the field. Excluded from every other figure here — counted so a consumer can tell “no reuse” apart from “no data”.

prompt_tokens: u64

Total prompt tokens across Self::reporting_requests.

cached_tokens: u64

Total prompt tokens served from the KV cache across those requests. Always <= prompt_tokens.

last_prompt_tokens: Option<u32>

Prompt tokens in the most recent reporting request.

last_cached_tokens: Option<u32>

Tokens reused from cache in the most recent reporting request.

Trait Implementations

impl Clone for CacheUsage

fn clone(&self) -> CacheUsage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CacheUsage

fn default() -> CacheUsage

Returns the “default value” for a type.

impl PartialEq for CacheUsage

fn eq(&self, other: &CacheUsage) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for CacheUsage

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for CacheUsage

impl Eq for CacheUsage

impl StructuralPartialEq for CacheUsage