liuwei-git 201cc11afa llama : add phi3 128K model support (#7225) ... * add phi3 128k support in convert-hf-to-gguf * add phi3 128k support in cuda * address build warnings on llama.cpp * adjust index value in cuda long rope freq factors * add long rope support in ggml cpu backend * make freq factors only depend on ctx size * remove unused rope scaling type 'su' frin gguf converter * fix flint warnings on convert-hf-to-gguf.py * set to the short freq factor when context size is small than trained context size * add one line of comments * metal : support rope freq_factors * ggml : update ggml_rope_ext API to support freq. factors * backends : add dev messages to support rope freq. factors * minor : style * tests : update to use new rope API * backends : fix pragma semicolons * minor : cleanup * llama : move rope factors from KV header to tensors * llama : remove tmp assert * cuda : fix compile warning * convert : read/write n_head_kv * llama : fix uninitialized tensors --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		2024-05-21 23:28:32 +03:00
..
baby-llama
batched	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
batched-bench	ggml : add Flash Attention (#5021)	2024-04-30 12:16:08 +03:00
batched.swift	llama : add option to render special/control tokens (#6807)	2024-04-21 18:36:45 +03:00
beam-search	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
benchmark	ggml : remove old quantization functions (#5942)	2024-03-09 15:53:59 +02:00
convert-llama2c-to-ggml	TypoFix (#7162)	2024-05-09 10:16:45 +02:00
embedding	embedding : free the batch after execution (#7297)	2024-05-15 15:01:12 +03:00
eval-callback	eval-callback : fix conversion to float (#7184)	2024-05-10 01:04:12 +02:00
export-lora
finetune	llama : add phi3 128K model support (#7225)	2024-05-21 23:28:32 +03:00
gbnf-validator	grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)	2024-04-11 19:47:34 +01:00
gguf	gguf : add option to not check tensor data (#6582)	2024-04-10 21:16:48 +03:00
gguf-split	gguf-split: add --no-tensor-first-split (#7072)	2024-05-04 18:56:22 +02:00
gritlm	gritlm : add --outdir option to hf.sh script (#6699)	2024-04-16 09:34:06 +03:00
imatrix	Fixed save_imatrix to match old behaviour for MoE (#7099)	2024-05-08 02:24:16 +02:00
infill	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
jeopardy
llama-bench	llama-bench : add pp+tg test type (#7199)	2024-05-10 18:03:54 +02:00
llama.android	cmake : update android comments (#7341)	2024-05-19 11:01:01 +03:00
llama.swiftui	llama : add option to render special/control tokens (#6807)	2024-04-21 18:36:45 +03:00
llava	ggml : tag ggml_tensor::backend as deprecated (#7290)	2024-05-15 15:08:48 +02:00
lookahead	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
lookup	Server: fix seed for multiple slots (#6835)	2024-04-24 11:08:36 +02:00
main	grammars: fix resampling logic regression (#7424)	2024-05-21 20:40:00 +01:00
main-cmake-pkg	build(cmake): simplify instructions (cmake -B build && cmake --build build ...) (#6964)	2024-04-29 17:02:45 +01:00
parallel	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
passkey	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
perplexity	perplexity: update README FP16 results [no ci] (#7413)	2024-05-20 18:15:38 +02:00
quantize	tests : fix --keep_split -> --keep-split (#7374)	2024-05-20 08:55:09 +03:00
quantize-stats	Improve usability of --model-url & related flags (#6930)	2024-04-30 00:52:50 +01:00
retrieval	examples : add "retrieval" (#6193)	2024-03-25 09:38:22 +02:00
rpc	rpc : set SO_REUSEADDR for the server socket (#7320)	2024-05-17 17:25:44 +03:00
save-load-state	llama : save and restore kv cache for single seq id (#6341)	2024-04-08 15:43:30 +03:00
server	Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)	2024-05-21 14:39:48 +02:00
simple	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
speculative	llama : support Llama 3 HF conversion (#6745)	2024-04-21 14:50:41 +03:00
sycl	docs: fix typos (#7124)	2024-05-07 18:20:33 +03:00
tokenize	BERT tokenizer fixes (#6498)	2024-04-09 13:44:08 -04:00
train-text-from-scratch	llama : add phi3 128K model support (#7225)	2024-05-21 23:28:32 +03:00
alpaca.sh
base-translate.sh
chat-13B.bat
chat-13B.sh
chat-persistent.sh
chat-vicuna.sh
chat.sh
CMakeLists.txt	ggml : add RPC backend (#6829)	2024-05-14 14:27:19 +03:00
gpt4all.sh
json-schema-pydantic-example.py	json-schema-to-grammar improvements (+ added to server) (#5978)	2024-03-21 11:50:43 +00:00
json_schema_to_grammar.py	JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)	2024-04-12 19:43:38 +01:00
llama.vim
llama2-13b.sh
llama2.sh
llm.vim
make-ggml.py
Miku.sh
pydantic-models-to-grammar-examples.py
pydantic_models_to_grammar.py
reason-act.sh
regex-to-grammar.py	JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)	2024-04-12 19:43:38 +01:00
server-embd.py	server : refactor (#5882)	2024-03-07 11:41:53 +02:00
server-llama2-13B.sh
ts-type-to-grammar.sh	JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)	2024-04-12 19:43:38 +01:00