finbase0530's picture ddalcu's picture
Duplicate from ddalcu/MiniMax-H3-FL2VA-MLX-Serve-8bit
e88a534
|
Raw History Blame Contribute Delete
1.08 kB

Modifications to MiniMax H3

These files are MODIFIED versions of the MiniMax H3 Works, redistributed under the MiniMax H3 Community License Agreement (see LICENSE and NOTICE).

Modified by: mlx-serve (https://github.com/ddalcu/mlx-serve)

What changed:

  • transformer.safetensors and text_encoder.safetensors are QUANTIZED from the original bfloat16 releases to MLX affine 8-bit, group size 64. Gathered embedding tables and the checkpoint's fp32 islands (patch projections, output heads, time embedder, rope inverse frequencies) are left dense.
  • video_vae.safetensors and audio_vae.safetensors are byte-for-byte copies of the originals, unmodified.
  • The tokenizer files are byte-for-byte copies from MiniMaxAI/MiniMax-H3 (FL2VA/processor/), relocated into this directory so the model is self-contained.
  • config.json is new, written by mlx-serve's converter to describe the layout above. It is not from the original release.

No weights were retrained, distilled, pruned or otherwise altered beyond the numeric quantization described above.