MiniMind
Train small language models from scratch with complete PyTorch pipeline in just 2 hours
How the 7.6 was reached
- Quality of output8/10
62,855 GitHub stars, active, Apache-2.0; heavy adoption for a small-model training project, though the 64M model is naturally limited. github.com
- Ease of use6/10
Pure PyTorch code covering the full pipeline, but you need a GPU and training know-how; docs found are limited. jingyaogong.github.io
- Pricing value9/10
Free Apache-2.0 code; training a 64M model costs about $3 on a single 3090. github.com
- API and integration quality7/10
Works with vLLM, ollama, llama.cpp, SGLang, transformers, and offers an OpenAI-compatible API for Open-WebUI and Dify. jingyaogong.github.io
- Solves the problem it claims to solve8/10
Trains a small chatbot from scratch cheaply; 62,855 stars show wide adoption, though cost and time figures come from the project. github.com
7.6/10 is the mean of the 5 criteria that apply. Scored on the five-criteria rubric v1, 29 September 2026. How scoring works
Pricing
- Complete source code
- Training pipeline
- Multiple model architectures
- Documentation
Key Features
- 64M parameter ChatBot training
- Complete pipeline from tokenizer to deployment
- RLAIF algorithms (PPO, GRPO, CISPO)
- Compatible with vLLM, ollama, llama.cpp
- OpenAI API drop-in replacement
Pros & Cons
Pros
- Ultra-low cost training (~¥3)
- Pure PyTorch implementation with no black boxes
- Complete end-to-end pipeline
- Multiple deployment options
- Active development with latest RL techniques
Cons
- Requires technical expertise in ML
- Limited to small model sizes
- Documentation primarily in Chinese
- Requires GPU hardware for training
MiniMind is an excellent educational tool for learning LLM training from scratch. While limited to smaller models, it provides a complete, transparent pipeline that's perfect for understanding the fundamentals of language model development.
Try MiniMind →Added to scored.tools on
Show this score
Free for any tool, at any score. It shows the live score, so it changes when the score does. Paste this where you want it:
<a href="https://scored.tools/tools/minimind/"><img src="https://scored.tools/badge/minimind.svg" alt="MiniMind on scored.tools: 7.6/10" width="160" height="40"></a>Do you run MiniMind? Claim this page to confirm the facts, correct one or respond. It is free and never changes the score.
Competitors to MiniMind
Other tools in the coding category worth comparing.