Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall
Paper • 2609.01532 • Published • 8
🤝 Open to Collab
Hanqing Zeng
zimplex
AI & ML interests
None yet
Recent Activity
authored a paper 2 days ago
Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall upvoted a paper 2 days ago
Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall published a model 10 days ago
zimplex/olmo3-7b-think-sft-eosfix-16k-3ep-hypOrganizations
authored a
paper 2 days ago
upvoted a paper 2 days ago
published a
model 10 days ago
updated a
model 10 days ago
published a
model 10 days ago
updated 2
models 10 days ago
published 5
models 26 days ago
zimplex/smolvla-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 0.5B • Updated • 4
zimplex/pi05-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 4B • Updated • 7
zimplex/pi0-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 4B • Updated • 7
zimplex/diffusion-genesis-hr-v2-train19-qpos-abs-step006250
Robotics • 0.3B • Updated • 5
zimplex/act-genesis-hr-v2-train19-qpos-abs-step080000
Robotics • 51.7M • Updated • 9
published a
dataset 26 days ago
updated a
dataset 26 days ago
updated 5
models 26 days ago
zimplex/pi05-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 4B • Updated • 7
zimplex/pi0-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 4B • Updated • 7
zimplex/diffusion-genesis-hr-v2-train19-qpos-abs-step006250
Robotics • 0.3B • Updated • 5
zimplex/smolvla-genesis-hr-v2-train19-qpos-abs-step100000
Robotics • 0.5B • Updated • 4
zimplex/act-genesis-hr-v2-train19-qpos-abs-step080000
Robotics • 51.7M • Updated • 9
updated a
dataset 29 days ago