Instructions to use parislo/OpenWebMath-tokenizer-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use parislo/OpenWebMath-tokenizer-1 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("parislo/OpenWebMath-tokenizer-1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload tokenizer
Verified signatureb801b74 -
Upload tokenizer
Verified signature200463a -
Upload tokenizer
Verified signature1cc8b36 -
Upload tokenizer
Verified signaturedf91ef0 -
Upload tokenizer
Verified signature256c433
-
Upload tokenizer
Verified signatureb5d2f99 -
Upload tokenizer
Verified signaturea70bb1f -
Upload tokenizer
Verified signature97c86b4