Topic

#model-testing

Loot, blog posts and adjacent themes connected to this topic. Follow the tag to keep it in your orbit.

#model-testing

Loot

More from this topic

Explore all loot

Run the Kimi K3 Architecture Locally with a 0.18B Test Model

#kimi-k3 #local-ai+4

A 0.18B-parameter Kimi K3 derivative that preserves the core layer types in a roughly 700 MB checkpoint for local architecture testing and development. Kimi-K3-0.18B is a tiny, MIT-licensed derivative of Moonshot AI’s 2.8T-parameter Kimi K3. It reduces the model to four layers, eight experts and 0.18B total parameters, with roughly 0.10B activated per token. The single model.safetensors checkpoint is about 0.69 GB, making the architecture accessible on ordinary development hardware. What it preserves The miniature model retains Kimi K3’s main layer types: dense and MoE feed-forward blocks, KDA linear attention, and an MLA full-attention layer. That makes it useful for testing loaders, integrations, architecture support and compression workflows without downloading or serving the full 2.8T model. Best use cases Validate Transformers compatibility and custom Kimi K3 model code Prototype inference, quantization or conversion workflows Inspect the MoE and attention implementation on limited hardware Build development tests around the Kimi K3 architecture Loading caveat The example loader requires trustremotecode=True, which executes repository-provided Python code. Review the model repository and pin a revision before running it in a sensitive environment. The model is not currently hosted by a Hugging Face inference provider.

Free

Review open

@ZachasADMIN

Open loot

Blog

#model-testing

More from this topic

Run the Kimi K3 Architecture Locally with a 0.18B Test Model

Related reads