How to use AstroHan/decision-head-qwen3.5-4b-rlcd-32k with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-4B") model = PeftModel.from_pretrained(base_model, "AstroHan/decision-head-qwen3.5-4b-rlcd-32k")
