Download tests/peg-parser/simple-tokenize.h from OpenTransformer/llama.cpp-prismml: direct link, hf CLI and curl.
- Browser
- Download file 114 Bytes
-
https://huggingface.co/OpenTransformer/llama.cpp-prismml/resolve/main/tests/peg-parser/simple-tokenize.h
- Command line
-
hf download hf://OpenTransformer/llama.cpp-prismml/tests/peg-parser/simple-tokenize.h
-
curl -L -o simple-tokenize.h https://huggingface.co/OpenTransformer/llama.cpp-prismml/resolve/main/tests/peg-parser/simple-tokenize.h
114 Bytes
| std::vector<std::string> simple_tokenize(const std::string &); | |