27.4 GB

Ctrl+K

Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing)

93436d5 verified 4 months ago

.gitattributes

1.52 kB
initial commit 4 months ago
config.json

1.73 kB
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
generation_config.json

132 Bytes
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
model.safetensors

27.4 GB
xet

Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
moe_metadata.json

346 Bytes
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
prefetch_predictors.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.32 MB
xet

Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
special_tokens_map.json

7.42 kB
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
tokenizer.json

5.06 MB
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
tokenizer_config.json

99.7 kB
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago
training_log.jsonl

3.86 kB
Axom X1 MoE: Falcon H1-3B upcycled to 13.7B MoE (8 experts/layer, top-1 routing) 4 months ago