Skip to main content

llama_bench_path

Function llama_bench_path 

Source
pub fn llama_bench_path() -> Result<PathBuf, PathError>
Expand description

Get the path to the managed llama-bench binary.

llama-bench is included in the pre-built binary archives alongside llama-server. For source builds it requires -DLLAMA_BUILD_BENCH=ON (see Phase 6 of the benchmark implementation plan).