I’m running an 8b parameter model on a machine with 128GB ram and an 8GB gpu.
but that’s way more than necessary
ben
npub1000…7nql
2024-06-06 16:03:48
in reply to nevent1q…gzj7
Author Public Key
npub10000000thpep7auj058803nqtymqlf3rw87lzhe6mkfeywnpxg5sjw7nqlPublished at
2024-06-06 16:03:48Event JSON
{
"id": "a6a9f54546e82d7359cba39fa4a569908f806ccccc18721608fedeee2263eef1",
"pubkey": "7bdef7bdebb8721f77927d0e77c66059360fa62371fdf15f3add93923a613229",
"created_at": 1717682628,
"kind": 1,
"tags": [
[
"e",
"edf57f585fbe2d5dfd72f2e662bea68a66d333e28a21dc7594d464f4aba0c91e",
"",
"root"
],
[
"e",
"df9c4a06cc95b559d942b482baa7e2dfbce3530a2771ab8d7050e4a768a2df6a",
"",
"reply"
],
[
"p",
"ca89cb11f1c75d5b6622268ff43d2288ea8b2cb5b9aa996ff9ff704fc904b78b"
],
[
"p",
"7bdef7bdebb8721f77927d0e77c66059360fa62371fdf15f3add93923a613229"
]
],
"content": "I’m running an 8b parameter model on a machine with 128GB ram and an 8GB gpu. \n\nbut that’s way more than necessary ",
"sig": "efae29ee60497c198bdec2101378d46ca9ca3910836dae71a50d4b5f58bf08b63a3310773af9be9c9972bfd0d1ecd97a7c28b6c1347219f9fc74e01198d266ca"
}