Fitting a 27B Model Into 16 GB, and the Four Tuning Ideas That Lost
A 12.1 GB uncensored coder model on an RTX 5070 Ti, 40,960 tokens of context, and four tuning attempts that measured slower than the defaults.
A 12.1 GB uncensored coder model on an RTX 5070 Ti, 40,960 tokens of context, and four tuning attempts that measured slower than the defaults.
How I combined CachyOS, OpenCode, llama.cpp, a local 9B model, OpenRouter, MCP tools and strict Git checkpoints without turning my gaming PC into an AI-only server.