9e70cc0322
* Add test for MPT tokenization * Revert code motion * Remove unnecessary restriction in test case * Clarify logic in conversion |
||
|---|---|---|
| .. | ||
| .editorconfig | ||
| ggml-vocab-aquila.gguf | ||
| ggml-vocab-falcon.gguf | ||
| ggml-vocab-llama.gguf | ||
| ggml-vocab-mpt.gguf | ||