92139b90af
* tests : add test-tokenizer-0.sh * unicode : add all unicode number ranges * starcoder : fix pre-tokenizer * tests : add test that fails with DeepSeek tokenizers * falcon : fix regex * unicode : regenerate unicode tables * refact : add tokenizer model * lint : fix * tests : disable failing tests ggml-ci * refact : add tests files ggml-ci * convert : print -> logging ggml-ci * lint : fix * unicode : digit -> number * phi-3 : update |
||
|---|---|---|
| .. | ||
| build-info.cmake | ||
| build-info.sh | ||
| check-requirements.sh | ||
| ci-run.sh | ||
| compare-commits.sh | ||
| compare-llama-bench.py | ||
| convert-gg.sh | ||
| gen-authors.sh | ||
| gen-build-info-cpp.cmake | ||
| gen-unicode-data.py | ||
| get-flags.mk | ||
| get-hellaswag.sh | ||
| get-pg.sh | ||
| get-wikitext-2.sh | ||
| get-wikitext-103.sh | ||
| get-winogrande.sh | ||
| hf.sh | ||
| install-oneapi.bat | ||
| LlamaConfig.cmake.in | ||
| pod-llama.sh | ||
| qnt-all.sh | ||
| run-all-perf.sh | ||
| run-all-ppl.sh | ||
| run-with-preset.py | ||
| server-llm.sh | ||
| sync-ggml-am.sh | ||
| sync-ggml.last | ||
| sync-ggml.sh | ||
| verify-checksum-models.py | ||
| xxd.cmake | ||