llama_cpp_for_radxa_dragon_.../tools
Radoslav Gerganov 41386cf365
rpc : report actual free memory (#16616)
* rpc : report actual free memory

Start reporting the free memory on every device instead of using
fixed values. Now llama-cli users can get a nice memory breakdown
when using RPC devices.

* drop --mem in rpc-server
2025-10-17 18:02:52 +03:00
..
batched-bench
cvector-generator
export-lora
gguf-split
imatrix
llama-bench llama : add --no-host to disable host buffers (#16310) 2025-10-06 19:55:53 +02:00
main
mtmd mtmd : support home-cooked Mistral Small Omni (#14928) 2025-10-16 19:00:31 +02:00
perplexity
quantize
rpc rpc : report actual free memory (#16616) 2025-10-17 18:02:52 +03:00
run
server webui: reorganize settings layout (#16607) 2025-10-17 10:35:03 +02:00
tokenize
tts
CMakeLists.txt