Private Local AI

Open-source AI models on hardware you own: notes on llama.cpp, Strata, Avalon, PolyStrata and Xolotl, quantization, and what self-hosted inference actually costs.