Expand description
Perf-mode benchmark types: llama-bench configuration and results.
Structsยง
- Model
Perf Result - Result of running
llama-benchon a single model. - Perf
Config - Configuration for a performance (
llama-bench) run.
Perf-mode benchmark types: llama-bench configuration and results.
llama-bench on a single model.llama-bench) run.