Module model_runtime 

Model runtime port for proxy model management.

This port defines the interface for ensuring a model is running and ready to serve requests. It abstracts the process management details from the proxy layer.

Modules

error_type

Canonical error.type discriminants, shared by every surface.

Structs

LaunchOverrides

Per-call launch overrides layered on a runtime’s standing configuration.

NoopModelRuntime

A ModelRuntimePort that never has anything running.

RunningTarget

Target information for a running model instance.

RuntimeErrorEnvelope

Structured, serializable view of a ModelRuntimeError.

Enums

ModelRuntimeError

Errors that can occur during model runtime operations.

Traits

ModelRuntimePort

Port for managing model runtime (ensuring models are running).

Functions

is_retryable_error_type

Whether a wire error.type discriminant denotes a retryable condition.