llama_cpp_for_radxa_dragon_.../tools
Georgi Gerganov e92d53b29e
sampling : optimize samplers by reusing bucket sort (#15665)
* sampling : optimize sorting using bucket sort in more places

ggml-ci

* sampling : do not sort in dist sampler

ggml-ci

* sampling : avoid heap allocations for sort buffers

ggml-ci

* common : add option to sort sampling candidates by probability

ggml-ci

* sampling : revert the change for preserving sort buffers

* sampling : use std::copy instead of memcpy

* sampling : clarify purpose of partial sort helpers

ggml-ci

* cont : remove wrong comment [no ci]

* common : update comment

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2025-08-31 20:41:02 +03:00
..
batched-bench llama: use FA + max. GPU layers by default (#15434) 2025-08-30 16:32:10 +02:00
cvector-generator
export-lora
gguf-split
imatrix
llama-bench llama: use FA + max. GPU layers by default (#15434) 2025-08-30 16:32:10 +02:00
main cli : change log to warning to explain reason for stopping (#15604) 2025-08-28 10:48:20 +03:00
mtmd mtmd : fix mtmd ios build (#15579) 2025-08-26 20:05:50 +02:00
perplexity perplexity: give more information about constraints on failure (#15303) 2025-08-14 09:16:32 +03:00
quantize
rpc
run
server sampling : optimize samplers by reusing bucket sort (#15665) 2025-08-31 20:41:02 +03:00
tokenize
tts sampling : optimize samplers by reusing bucket sort (#15665) 2025-08-31 20:41:02 +03:00
CMakeLists.txt