llama.cpp 0.4.0 Is a Tag, Not a GX10 Bench
ggml-org tagged llama.cpp v0.4.0 on Sep 4, 2026. Nightly on that release is b10809. ggml is bumped to v0.23.0. This is a changelog note, not a GX10 sit.
2 min read•Sep 4, 2026
Local AI. Real hardware.
> I run open-weight models on boxes I own — NVIDIA Spark, ASUS GX10, Grok, local agents — then write what worked. No brochure. Games included.
W
Explore by topic
Local AI leads: open-weight models on hardware I actually own, plus Grok, vibe coding, and the games that come out of that stack. Marketing archives stay in the hubs — they are not the front door.
Cornerstone
Local AI
Open-weight models, local inference stacks, VRAM planning, and homelab setups for running AI on your own hardware.
Open hub LeaderboardWikiBench
100-task scores for local LLMs. Weighted mean, partial credit, grouped by size.
Open hub From the labGames
Small browser games shipped from the same stack — including Moon Trail, built with a local agent.
Open hubAI Tools
In-depth reviews, comparisons, and guides for the latest AI tools reshaping how we work and create.
Open hubTech News
Breaking developments in AI, cloud computing, data centers, and the future of technology.
Open hubFeatured note
Lab noteNex AGI posted Nex-N2.5-mini under Apache 2.0. Official BF16 usedStorage is 70.24 GB of weights. Sep 9 fold: mradermacher GGUFs are real, Q2_K through Q8_0, 12.94 to 36.90 GB. All fit a GX10 as a file-size claim. Official serve is patched SGLang on 2×H100. I have not loaded it.
Read full articleLatest from the lab
Nemotron Puzzle Fits 128GB on Paper. Loader Fix Landed. Not a GX10 Sit.
Official FP8 and NVFP4 fit 128GB on disk. llama.cpp PR 28323 merged; first nightly with the expert-layer fix is b10796. I have not loaded this on the GX10. Not a sit.
3 min read•Sep 4, 2026
K2 Horizon Fits on Paper. Not a GX10 Sit.
IFM posted K2 Horizon under Apache 2.0: six sizes from 0.9B to 375B-A23B. Official under-~110 GB GGUF/FP8 siblings fit on paper. 375B FP8 does not. Not a bench. Not a GX10 load.
3 min read•Sep 3, 2026
VibeVoice ASR-Streaming Fits 128GB. That Is Not a Sit.
Microsoft posted streaming ASR weights today: 1.5B usedStorage 5.64 GB, 7B 17.35 GB. MIT. Both fit a GX10 as a file-size claim. This is not TTS, and I have not loaded it.
2 min read•Sep 2, 2026
