Georgi Gerganov 12d0188c0d kv-cache : refactor + add llama_memory_state_i (#13746) ... * kv-cache : simplify the "struct llama_kv_cache" interface ggml-ci * kv-cache : revert the (n_swa + n_ubatch) change (for next PR) ggml-ci * kv-cache : some comments ggml-ci * context : fix graph reserve for multiple sequences ggml-ci * kv-cache : fix typo [no ci] * kv-cache : fix find_slot() logic for free slots ggml-ci * llama : add TODO for deprecating the defrag API in the future * kv-cache : improve find_slot() using min/max seq pos info ggml-ci * llama : handle aborts and compute errors ggml-ci * memory : extract state into llama_memory_state ggml-ci * kv-cache : add comments ggml-ci * server : update batching logic to reset n_batch on successful decode * server : upon full re-processing, remove the sequence from the cache * kv-cache : add TODO for doing split_equal when split_simple fails ggml-ci		2025-05-31 10:24:04 +03:00
..
CMakeLists.txt	cmake : add llama-cparams.cpp to build (#13832)	2025-05-27 19:08:44 +03:00
llama-adapter.cpp	llama : do not crash if there is no CPU backend (#13395)	2025-05-09 13:02:07 +02:00
llama-adapter.h	llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)	2025-03-13 12:35:44 +02:00
llama-arch.cpp	llama : add support for jina-reranker-v2 (#13900)	2025-05-29 21:42:31 +02:00
llama-arch.h	llama : add RobertaForSequenceClassification reranker support (#13875)	2025-05-29 08:15:01 +02:00
llama-batch.cpp	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-batch.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-chat.cpp	llama : one-off chat template fix for Mistral-Small-2503 (#13398)	2025-05-09 11:17:51 +02:00
llama-chat.h	llama : one-off chat template fix for Mistral-Small-2503 (#13398)	2025-05-09 11:17:51 +02:00
llama-context.cpp	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-context.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-cparams.cpp	kv-cache : rework kv_cell (#13706)	2025-05-25 16:34:36 +03:00
llama-cparams.h	kv-cache : rework kv_cell (#13706)	2025-05-25 16:34:36 +03:00
llama-grammar.cpp	server: streaming of tool calls and thoughts when --jinja is on (#12379)	2025-05-25 01:48:08 +01:00
llama-grammar.h	tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)	2025-03-05 13:05:13 +00:00
llama-graph.cpp	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-graph.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-hparams.cpp	hparams : initialize arrays (#13728)	2025-05-23 20:16:13 +03:00
llama-hparams.h	llama : add RobertaForSequenceClassification reranker support (#13875)	2025-05-29 08:15:01 +02:00
llama-impl.cpp
llama-impl.h	cleanup: fix compile warnings associated with gnu_printf (#11811)	2025-02-12 10:06:53 -04:00
llama-io.cpp	llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)	2025-03-13 12:35:44 +02:00
llama-io.h	llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)	2025-03-13 12:35:44 +02:00
llama-kv-cache.cpp	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-kv-cache.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-kv-cells.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-memory.cpp	llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)	2025-03-13 12:35:44 +02:00
llama-memory.h	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-mmap.cpp	mmap : skip resource limit checks on AIX (#12541)	2025-03-24 12:17:10 +02:00
llama-mmap.h	llama-mmap: fix missing include (#11796)	2025-02-10 20:58:18 +02:00
llama-model-loader.cpp	gguf : use ggml log system (#13571)	2025-05-15 19:13:11 +02:00
llama-model-loader.h	llama : add option to override model tensor buffers (#11397)	2025-04-02 14:52:01 +02:00
llama-model-saver.cpp	llama/ggml: add LLM training support (#10544)	2025-05-12 14:44:49 +02:00
llama-model-saver.h	llama/ggml: add LLM training support (#10544)	2025-05-12 14:44:49 +02:00
llama-model.cpp	kv-cache : refactor + add llama_memory_state_i (#13746)	2025-05-31 10:24:04 +03:00
llama-model.h	kv-cache : add SWA support (#13194)	2025-05-20 08:05:46 +03:00
llama-quant.cpp	quantize : improve tensor-type pattern matching (#13033)	2025-05-13 19:12:31 +02:00
llama-quant.h
llama-sampling.cpp	sampling : make sure samplers return at least 1 token (#13822)	2025-05-27 12:07:52 +03:00
llama-sampling.h
llama-vocab.cpp	vocab : fix ugm tokenizer precision (#13743)	2025-05-24 12:29:09 +02:00
llama-vocab.h	llama/ggml: add LLM training support (#10544)	2025-05-12 14:44:49 +02:00
llama.cpp	llama : print hint when loading a model when no backends are loaded (#13589)	2025-05-16 16:38:07 +02:00
unicode-data.cpp
unicode-data.h
unicode.cpp	repo : update links to new url (#11886)	2025-02-15 16:40:57 +02:00
unicode.h