pingu_98/llama_cpp_for_radxa_dragon_wing_q6a
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llama_cpp_for_radxa_dragon_.../tools
History
Nicolò Scipione f7c9429c85
sycl : Overcoming workaround for mmap() allocation on Windows (#13482) 
* Remove mmap workaround on windows

After some testing I found that mmap is supported on windows and for
many GPUs on Linux. Therefore I remove the workaround for windows since
it is not necessary.

* Update llama-bench README

SYCL backend introduced a workaround that allows execution of
llama-bench also without specifying `--mmp 0` flag
2025-05-20 08:54:43 +08:00
..
batched-bench batched-bench : fix pp batch contents (#13492) 2025-05-13 18:01:53 +03:00
cvector-generator
export-lora
gguf-split
imatrix imatrix : Add --parse-special for enabling parsing of special tokens in imatrix calculation (#13389) 2025-05-09 11:53:58 +02:00
llama-bench sycl : Overcoming workaround for mmap() allocation on Windows (#13482) 2025-05-20 08:54:43 +08:00
main llama : do not crash if there is no CPU backend (#13395) 2025-05-09 13:02:07 +02:00
mtmd mtmd : add vision support for llama 4 (#13282) 2025-05-19 13:04:14 +02:00
perplexity context : remove logits_all flag (#13284) 2025-05-08 14:26:50 +03:00
quantize quantize : improve tensor-type pattern matching (#13033) 2025-05-13 19:12:31 +02:00
rpc llama : do not crash if there is no CPU backend (#13395) 2025-05-09 13:02:07 +02:00
run llama-run: add support for downloading models from ModelScope (#13370) 2025-05-09 10:25:50 +01:00
server server : added --no-prefill-assistant flag (#13608) 2025-05-17 23:59:48 +02:00
tokenize
tts
CMakeLists.txt mtmd : rename llava directory to mtmd (#13311) 2025-05-05 16:02:55 +02:00