OSSForks/ollama
1
0
Fork 0
mirror of https://github.com/zebrajr/ollama.git synced 2025-12-06 00:19:51 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
fc5fb09f51
ollama/model
History
Devon Rifkin fc5fb09f51 model: fix boundary in bpe 
0x007e is a tilde and was getting adjusted (+0x00a2) to 0x0120 in the
encode, but then in the decode it was getting adjusted down (-0x0100) to
0x0020. The boundary for the +0x00a2 case has been adjusted to fix this

Fixes: #11966
2025-08-19 18:34:49 -07:00
..
imageproc imageproc mllama refactor (#7537) 2024-12-14 19:50:15 -08:00
input ollamarunner: Separate text and multimodal graphs 2025-05-15 13:46:20 -07:00
models update vendored llama.cpp and ggml (#11823) 2025-08-14 14:42:58 -07:00
testdata gemma2 impl 2025-03-11 14:35:08 -07:00
bytepairencoding_test.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
bytepairencoding.go model: fix boundary in bpe 2025-08-19 18:34:49 -07:00
model_test.go update vendored llama.cpp and ggml (#11823) 2025-08-14 14:42:58 -07:00
model.go update vendored llama.cpp and ggml (#11823) 2025-08-14 14:42:58 -07:00
sentencepiece_test.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
sentencepiece.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
textprocessor.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
vocabulary_test.go model: treat 'user defined' tokens as special tokens (#11077) 2025-06-16 16:03:16 -07:00
vocabulary.go model: treat 'user defined' tokens as special tokens (#11077) 2025-06-16 16:03:16 -07:00