Daniel on Nostr: Who will be the Apple of personal AI? That's what I'm waiting for. ...
Who will be the Apple of personal AI? That's what I'm waiting for.
In 3 years, we will see LLM ASICs on a USB Stick.
This paper eliminates the need for costly matrix multiplication in LLMs claiming a 10x reduction of memory use during compute. If they can turn a 70b model into a 7b model, we are running these things on phones.
https://arxiv.org/abs/2406.02528
Published at
2024-06-10 14:38:35Event JSON
{
"id": "a0f2670c61bbf3b5d9314596b1ee8ce6f7ececdb23af64358ebc8d7f009d0eee",
"pubkey": "cc9a540660588c506af766a4ba9925fa37329bd5a8db4c875a88637f1fe18448",
"created_at": 1718023115,
"kind": 1,
"tags": [
[
"p",
"460c25e682fda7832b52d1f22d3d22b3176d972f60dcdc3212ed8c92ef85065c",
"",
"mention"
]
],
"content": "Who will be the Apple of personal AI? That's what I'm waiting for. \nnostr:nevent1qvzqqqqqqypzq3svyhng9ld8sv44950j957j9vchdktj7cxumsep9mvvjthc2pjuqy2hwumn8ghj7un9d3shjtnyv9kh2uewd9hj7qpqst32tn7lcex454jq09revqdfycvyx3sem9svz4z6s8ermsnpyq6sm29grn",
"sig": "2ac3138669c13b04d8ba8ed2e25e78e23bc5e6667e0771b7d1b998775711120bb1578df0014986021cc79cc0fbc5050e85822f9ff88f24159da32516fef62c31"
}
