Module model_runtime 

Model runtime port for proxy model management.

This port defines the interface for ensuring a model is running and ready to serve requests. It abstracts the process management details from the proxy layer.

Structs

RunningTarget

Target information for a running model instance.

Enums

ModelRuntimeError

Errors that can occur during model runtime operations.

Traits

ModelRuntimePort

Port for managing model runtime (ensuring models are running).