fusion44 on Nostr: I can run quite a few models on gpt4all on my dated amd64 system without any problem. ...
I can run quite a few models on gpt4all on my dated amd64 system without any problem. Everything above 7B is a problem though.
Can't wait until all processors include ai accelerators. Holding if until next year building my new rig.
Published at
2023-10-03 10:44:50Event JSON
{
"id": "1aeccb56c6f9805201b6d4eb6b0204724722da283381280efbe6b15f86d4104d",
"pubkey": "4f213ad64955ea2c783dfc55d3f802bf143e26a5b36aceba05f35ea935b3bc35",
"created_at": 1696322690,
"kind": 1,
"tags": [
[
"e",
"8b0e8b566f4d83ee6f6cdce4e909773a0db038371def620e1639f46367d40ebe",
"",
"reply"
],
[
"p",
"50d94fc2d8580c682b071a542f8b1e31a200b0508bab95a33bef0855df281d63"
]
],
"content": "I can run quite a few models on gpt4all on my dated amd64 system without any problem. Everything above 7B is a problem though.\n\nCan't wait until all processors include ai accelerators. Holding if until next year building my new rig.",
"sig": "16c91dc880541564c18ac17b7fa861b5fe6ff7128c0e874554142c1f0fe397cb3e468bb4c246629effa28ccac9047ebe38b037e2742b674f9fa010ee54f09f67"
}
