Engineering log of a self-hosted AI build on NVIDIA DGX Spark, run from a flat in Europe. Open weights, open source, no KYC. Fix postmortems, model choices, distribution honesty at sovgrid.org.
Public Key
npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn Profile Code
nprofile1qqszd37szh3m7ehus6arne2jyvwtavf54y6vwc50ap4zdtxqymjfapcpr3mhxue69uhkummnw3ezucnfw33k76twv4ezuum0vd5kzmqpz3mhxue69uhhyetvv9ujuerpd46hxtnfduqs6amnwvaz7tmwdaejumr0dsqs7amnwvaz7tmwdaehgu3wd4hk6qkxrqa
Show more details
Published at
2026-07-15T10:43:51Z Event JSON
{
"id": "2a2de1c056d45e8645fcf8a8948a92edfc8ea756cd3720f921583e38ee1e8216" ,
"pubkey": "26c7d015e3bf66fc86ba39e552231cbeb134a934c7628fe86a26acc026e49e87" ,
"created_at": 1784112231 ,
"kind": 0 ,
"tags": [
[
"client",
"Ditto",
"31990:781a1527055f74c1f70230f10384609b34548f8ab6a0a6caa74025827f9fdae5:ditto"
],
[
"published_at",
"1784112231"
]
],
"content": "{\"about\":\"Engineering log of a self-hosted AI build on NVIDIA DGX Spark, run from a flat in Europe. Open weights, open source, no KYC. Fix postmortems, model choices, distribution honesty at sovgrid.org.\",\"banner\":\"https://blossom.primal.net/6448c7e4ef50313bf603e7a9faf3f1bc12ce668489cdf985e6caac1f820924c5.webp\",\"display_name\":\"Sovereign Grid\",\"lud16\":\"[email protected] \",\"name\":\"sovgrid\",\"nip05\":\"[email protected] \",\"picture\":\"https://blossom.primal.net/917fe99918568a9e452c3c7fcbe095ca24ad0cfa93fe7e752dad93d4bb21738d.webp\",\"website\":\"https://sovgrid.org\",\"bot\":false}" ,
"sig": "b57760ff8be9df07a4820642662c2a1ccde8e30de3d4bf257c8c97fd1aebd8c7875f0d95933d4270ebe7efc9869504dca5ffac59a9849218ae05ec69d4738848"
}
Last Notes npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Qwen3.6-35B-A3B PrismaQuant runs at 95 tok/s on a single DGX Spark, outperforming Mistral Small 4’s 35 tok/s by 2.7x. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Regulatory frameworks including GDPR and SEC AI guidance mandate strict data control. The solution involves deploying AI infrastructure within the firm’s own perimeter. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Tailscale is suitable for finite sovereignty budgets, whereas Headscale is necessary when vendor risk is unacceptable. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Sovereign Fleet 0.6.0 is public, MIT. It runs coding-agent CLIs (goose, aider, Pi, OpenCode, Claude Code) unattended on your own machine: Landlock confines each run to its git worktree, and the repo's own tests decide what lands. On a local Qwen, goose needed 1.6 min per correct result, aider 3.0 (192 runs). npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid opencode replaces the previous local primary against the Qwen 3.6 model. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid This configuration determines when a Tor hidden service serves as the correct endpoint for a sovereign AI system. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The disclaimer states the text is a composite portrait and not a real conversation. No single named engineer said any of this. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid sovgrid documents a method for measuring agent capabilities through deterministic gates. The project answers whether specific changes improve performance on defined tasks, prioritizing concrete numbers over qualitative assessments of agent quality. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid NVFP4 is a 4-bit floating-point format with a tiny exponent field designed for inference-time activation and weight quantization on Blackwell-class hardware. This post explains the mechanics and performance characteristics of the format. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid sovgrid operated for six months with a zero sat receipt total on its V4V channels. The channel existence does not equate to dollar volume. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Sovereign AI deployment shifts liability from service providers to the healthcare organization. The CISO must now ensure infrastructure meets specific regulatory citations for data residency and processing. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid One third of inquiry sources decline the purchase. The decision tree includes six specific exclusion clauses for this hardware. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid sovgrid published the release write-up for Vozonda, the podcast app built on this grid: what it does, how to run it, where it falls short of NotebookLM, and how it was built, including the cloud agents that helped. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid A one-person operator manages the entire AI infrastructure. The system is designed to allow uninterrupted sleep while capturing critical errors. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Claude retains the lead on multi-step reasoning tasks in the 2026 capability matrix. The self-hosted GB10 stack handles two specific functions that Claude cannot execute. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Copying a configuration from these playbooks into a new environment requires verifying the workflow category first. Unverified adoption leads to performance degradation. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Content is built locally and rsynced to a VPS, resulting in an archive that exists as plain text on disk. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The hardware wallet stores the seed while the node retains channel keys. This BitBox and LND integration pattern is straightforward in principle but finicky in detail. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Rebuilding the interface as a teaching surface resolved the lack of social adoption. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The recovery procedure assumes a UPS for graceful shutdown and a separate management host. Without these prerequisites, the system cannot return to full production within the target window. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Self-hosted AI services often fail to survive unexpected reboots without manual restarts. These six unit-file patterns provide a structured approach to maintaining service continuity. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid True! @nprofile…6av2 why do you offer only credit card payment? npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Oh, didn't saw that this post is 1 year old. Anyway get your hardware Wallets folks 🤙 npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid So many iconic #Bitcoin quotes! I pick this one as it's seems to be not mentioned yet: npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Due to current demand 12% off for #coldcard user 😉 with this completely anonymous code: "arvrcnpx" on any #bitbox npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Check this out: #nevent1q…x043 npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Prompts and runbooks reside in a single Gitea instance for the sovgrid AI stack. This setup functions as the definitive source of truth for the pipeline. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The article identifies a gap in current coding leaderboards. HackerNoon uses language-based ranking. WhatLLM.org combines three specific benchmarks. Self-hosted inference on actual hardware remains untested. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Each mode requires a different fix to restore agent output. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid A specific stack recently increased its compliance score from 5/6 to 6/6 against the defined framework. The post details the operational changes required to pass the final test. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Great writeup! I just published a comparison of our cadence stack vs Emanator: https://sovgrid.org/blog/nostr-emanator-comparison/ npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The setup uses Caddy on a VPS and Cloudflare Tunnel to reach a home Spark server without opening inbound ports. This configuration offloads TLS handshakes, which take 600 milliseconds, to a CDN capable of absorbing abuse. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Free PDF + EPUB. Libertarianism explained through the lens of voluntary interaction. The political philosophy that makes no-KYC not a preference but a necessity. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid How Bitcoin enables sovereignty in an era of surveillance and capital controls. The political economy of Bitcoin, not just the technology. This is the book for anyone who cares about capital controls and why they matter for a sovereign stack. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid How Bitcoin enables sovereignty in an era of surveillance and capital controls. The political economy of Bitcoin, not just the technology. This is the book for anyone who cares about capital controls and why they matter for a sovereign stack. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Specific component pairings define the three paths. The dual RTX 5090 Threadripper Pro setup, the DGX Spark plus secondary inference box, and the refurbished workstation route represent the available options. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid New on the blog: the honest accounting of paying for frontier AI with Bitcoin. Where @npub16g4…kv4h earns its place (no-KYC, pay-per-query, drop-in OpenAI API), where it does not (forwarded frontier calls are not on-device privacy), and real credit for the private/* TEE models that run in attested enclaves. Tradeoffs over hype. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The root cause for these five disasters was a single line of code that should have been documented. Postmortem links and actual fixes are provided for each specific failure mode. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid True, but the urgency is still present. I am using an advanced AI assistant to keep my local build moving forward. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Standard demos rely on search operations. The article provides worked examples for five distinct patterns that serve post-launch requirements. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Sovereignty stopped being a thought experiment this week. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The primary challenge is identity separation at every layer when the operator is a friend with zero Linux experience. Default-local privacy and a vibe-sustaining onboarding pattern are required to survive day three. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid A May 2026 memo stated local 8B models cannot reliably perform MCP tool-use. Late May retesting confirmed the models work but the bridge layer was broken. The original diagnosis regarding the cause was incorrect. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid Qwen3.6 and Mistral Small 4 both passed the Python quality gate for the Start Here article despite fabricating hardware and benchmarks. The raw outputs required no editing before the scorer accepted them. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The author catalogs six specific behaviors, such as gating optimism and naming dependencies, across this group. These traits were identified by the operator managing the underlying iron for sovereign software. npub1ymraq90rhan0ep4688j4ygcuh6cnf2f5ca3gl6r2y6kvqfhyn6rsennzhn sovgrid The operator listened to Eleven VibeVoice samples and a Voxtral baseline. This marks the first day of the three-day VibeVoice Sample Matrix.
