Commit History
-
Add sharded ONNX layout, transformers.js config, and generation config
Verified signature# Add sharded ONNX layout, transformers.js config, and generation config Hi, and thanks for publishing this one in ONNX. I tried running Maincoder-1B in a browser tab with transformers.js and it failed after about a second, before downloading a single byte of weights. Tracing it, the cause turned out to be the size of one file rather than anything about the model itself, so I put a fix together and then spent most of the time checking that none of the weights changed. Everything here is additive, which does mean it adds about 4.7 GiB to the repo. If you would rather these replaced the existing files than sat alongside them, or would prefer a different approach entirely, I am glad to rework it. ## Summary This adds files. Nothing existing is removed, renamed, moved, or overwritten. `decoder_model.onnx`, `decoder_with_past_model.onnx`, and both `.onnx_data` files keep their current names, locations, and bytes, so code written against the current README continues to work unchanged. …589c7b5
