Sort of. I think there is an early project on nostr attempting to handle this. The issue is that you can't really break up an LLM across distributed compute yet. So unless you have a big enough system to run a useful model at usable speeds were sol.
I currently have a big enough system to share, but not enough to handle the concurrence and model variation that a community might need. Id also have to charge 6x what the most expensive tokens are to serve it.
ChipTuner
npub1qd…3fqm7
2026-09-12 15:37:39 GMT
in reply to nevent1q…mdyq
Author Public Key
npub1qdjn8j4gwgmkj3k5un775nq6q3q7mguv5tvajstmkdsqdja2havq03fqm7Seen on
wss://relay.damus.ioPublished at
2026-09-12 15:37:39 GMTEvent JSON
{
"id": "5b9b72da11f9913bc432103dd14d436f7be4fa27b2962bf4b0d8a7c52fe2980b",
"pubkey": "036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58",
"created_at": 1789227459,
"kind": 1,
"tags": [
[
"e",
"00007d7e8b498f9f8a32906aa30f800f9942738079df8d0883515c3ce707b1ea",
"",
"root"
],
[
"e",
"a73ae3c9ef4450dc46f233be69570ee077e6133cdc5477837fd7408e5cac5702",
"wss://nos.lol/",
"reply",
"690a14b1a8c90dfb180ab2ad1772a1b157dfb1dd48a8d005dcdd3b853c489c70"
],
[
"p",
"690a14b1a8c90dfb180ab2ad1772a1b157dfb1dd48a8d005dcdd3b853c489c70"
]
],
"content": "Sort of. I think there is an early project on nostr attempting to handle this. The issue is that you can't really break up an LLM across distributed compute yet. So unless you have a big enough system to run a useful model at usable speeds were sol. \n\nI currently have a big enough system to share, but not enough to handle the concurrence and model variation that a community might need. Id also have to charge 6x what the most expensive tokens are to serve it. ",
"sig": "3f199777dd2969291b751edebbf983b03e6ec3a45ce972954f305cb0b8588898ccf155f278c388a09378fb49e9591e152f42749cec184d50d96ad784b47b51b0"
}