Module llama

Module llama 

Source
Expand description

Llama.cpp binary path resolution.

Provides paths to the managed llama-server and llama-cli binaries, as well as the llama.cpp repository and configuration files.

Functionsยง

gglib_data_dir
Get the gglib data directory containing llama binaries.
llama_cli_path
Get the path to the managed llama-cli binary.
llama_config_path
Get the path to the llama build configuration file.
llama_cpp_dir
Get the path to the llama.cpp repository directory.
llama_server_path
Get the path to the managed llama-server binary.