Hugging Face's logo
Boning Cui's picture
🏗️ Building on HF

Boning Cui

Bc-AI
204 18 84
jhunxyryx's profile picture textilelabs's profile picture Quazim0t0's profile picture
·

AI & ML interests

He/Him. I like LLM's and VLM's. I work with my other friends to make stuff. We are in year 7 and we are enthusiastic about AI. We are based in Australia 🇦🇺 (QLD Btw)

Recent Activity

liked a Space about 4 hours ago
Banaxi-Tech/KV1-Demo
repliedto Banaxi-Tech's post about 13 hours ago
We're announcing KV1. Now. We're going to take some models, do a bit of continued training on them and QAT them for only a 2 bit KV cache. And because of what happened with BGA, and this is also kind of some research stuff, here's what we're going to change: We're going to always, before we release how and make any claims, release our results. We also would like (idk if we can) to have some external reviewers before releasing them, I'M talking to YOU @AtAndDev and @mithulaartigala And we're going to properly cite other research. The models we are going to release is: KV1 1.2B, based on LFM 2.5 1.2B Instruct KV1 2.6B, based on LFM 2.5 2.6B Instruct KV1 4B, based on Qwen3.5 4B. If we get enough compute, we may also train: KV1 9B And if you guys want to a ~27B model, you guys decide which, either on LFM 2.5 24B A2B, Qwen3.8 27B, or Qwen3.6 35B A3B. Our goal is to get 2 bit, at 4 bit quality. Here's an image of our current progress, KV1 is at 3 bit, not 4 bit, but it will improve!
repliedto Banaxi-Tech's post about 13 hours ago
We're announcing KV1. Now. We're going to take some models, do a bit of continued training on them and QAT them for only a 2 bit KV cache. And because of what happened with BGA, and this is also kind of some research stuff, here's what we're going to change: We're going to always, before we release how and make any claims, release our results. We also would like (idk if we can) to have some external reviewers before releasing them, I'M talking to YOU @AtAndDev and @mithulaartigala And we're going to properly cite other research. The models we are going to release is: KV1 1.2B, based on LFM 2.5 1.2B Instruct KV1 2.6B, based on LFM 2.5 2.6B Instruct KV1 4B, based on Qwen3.5 4B. If we get enough compute, we may also train: KV1 9B And if you guys want to a ~27B model, you guys decide which, either on LFM 2.5 24B A2B, Qwen3.8 27B, or Qwen3.6 35B A3B. Our goal is to get 2 bit, at 4 bit quality. Here's an image of our current progress, KV1 is at 3 bit, not 4 bit, but it will improve!
View all activity

Organizations

Gradio-Blocks-Party's profile picture Hugging Face Discord Community's profile picture None yet's profile picture Smilyai labs's profile picture XORTRON - Criminal Computing's profile picture Agents-MCP-Hackathon's profile picture Join Secret x Hugging Face's profile picture Hugging Science's profile picture MCP-1st-Birthday's profile picture Unsloth Jobs Explorers's profile picture Smilyai Mochiva Team's profile picture BananaMind Model Previewers's profile picture BananaMind AI's profile picture Grace Laboratories @ Smilyai Labs's profile picture Smilyai-labs-beta-testers's profile picture BananaMind Research Community's profile picture Small Language Model Consortium's profile picture Novi AI's profile picture basically experimental's profile picture basically AI's profile picture saicr's profile picture SAICR Join Requests's profile picture Smilyai Harbour AI Safety Team's profile picture VOID's profile picture Smilyai Project Prism's profile picture Refract AI Labs's profile picture Hugging Archive's profile picture Orion T3 Previewers's profile picture KV1 Early Access Program's profile picture Klein ML's profile picture