finbase0530's picture ddalcu's picture
Duplicate from ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit
e88a534
|
Raw History Blame Contribute Delete
1.08 kB
# Modifications to MiniMax H3
These files are MODIFIED versions of the MiniMax H3 Works, redistributed under
the MiniMax H3 Community License Agreement (see LICENSE and NOTICE).
Modified by: mlx-serve (https://github.com/ddalcu/mlx-serve)
What changed:
* `transformer.safetensors` and `text_encoder.safetensors` are QUANTIZED from
the original bfloat16 releases to MLX affine 8-bit, group size 64. Gathered
embedding tables and the checkpoint's fp32 islands (patch projections, output
heads, time embedder, rope inverse frequencies) are left dense.
* `video_vae.safetensors` and `audio_vae.safetensors` are byte-for-byte copies
of the originals, unmodified.
* The tokenizer files are byte-for-byte copies from `MiniMaxAI/MiniMax-H3`
(`FL2VA/processor/`), relocated into this directory so the model is
self-contained.
* `config.json` is new, written by mlx-serve's converter to describe the
layout above. It is not from the original release.
No weights were retrained, distilled, pruned or otherwise altered beyond the
numeric quantization described above.