Hugging Face's logo

Compactbot
/
ldt-10m

Text Generation
Safetensors
English
ldt
tiny
slm
small-language-model
from-scratch
10m
Model card Files
xet
 Community
15
Compactbot commited on
Commit
2a1e042
·
1 Parent(s): a198f75

Byte-level BPE tokenizer (vocab 12288) (#3)

Browse files

- Byte-level BPE tokenizer (vocab 12288) (90497419de218143f7879d37e0a50a8c8a23b5d4)

Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff