g2mt 94933c8c2e server : implement universal assisted decoding (#12635) ... * llama-server : implement universal assisted decoding * Erase prompt tail for kv-cache * set vocab_dft_compatible in common_speculative * rename ctx_main to ctx_tgt * move vocab_dft_compatible to spec struct * clear mem_dft, remove mem * detokenize id_last for incompatible models * update comment * add --spec-replace flag * accept special tokens when translating between draft/main models * Escape spec-replace * clamp draft result to size to params.n_draft * fix comment * clean up code * restore old example * log common_speculative_are_compatible in speculative example * fix * Update common/speculative.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * Update common/speculative.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * Update common/speculative.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		2025-07-31 14:25:23 +02:00
..
arg.cpp	server : implement universal assisted decoding (#12635)	2025-07-31 14:25:23 +02:00
arg.h
base64.hpp
build-info.cpp.in
chat-parser.cpp
chat-parser.h
chat.cpp
chat.h
CMakeLists.txt
common.cpp
common.h	server : implement universal assisted decoding (#12635)	2025-07-31 14:25:23 +02:00
console.cpp
console.h
json-partial.cpp
json-partial.h
json-schema-to-grammar.cpp
json-schema-to-grammar.h
llguidance.cpp
log.cpp
log.h
ngram-cache.cpp
ngram-cache.h
regex-partial.cpp
regex-partial.h
sampling.cpp
sampling.h
speculative.cpp	server : implement universal assisted decoding (#12635)	2025-07-31 14:25:23 +02:00
speculative.h	server : implement universal assisted decoding (#12635)	2025-07-31 14:25:23 +02:00