I'm not using Docker. I have apps in Docker that might connect to it, but I run Ollama natively.
Docker does support GPUs on the mac, which is where 99% of the performance comes form.
Jeff Triplett /
npub1ns…8ahke
2024-06-12 18:38:03
in reply to nevent1q…c3l9
Author Public Key
npub1nsp3hg75ge84dn5fttlkpxpxnj0dfl697239dtyz4js3mdw2jllqf8ahkePublished at
2024-06-12 18:38:03Event JSON
{
"id": "c51ede59b396ef1e0dc6908d5b8052fc60a9bb9d98c671f6ff79f7166d3b97e6",
"pubkey": "9c031ba3d4464f56ce895aff6098269c9ed4ff45f2a256ac82aca11db5ca97fe",
"created_at": 1718210283,
"kind": 1,
"tags": [
[
"p",
"9c031ba3d4464f56ce895aff6098269c9ed4ff45f2a256ac82aca11db5ca97fe"
],
[
"p",
"1641cf6b5f40c4d92fa3886c068731486bda92e30f507ce2aa54610ae160bef1"
],
[
"e",
"996c3a03d37dc539704c6b3a1db5b92e90e01315d221711a275462c1a476cbb6",
"",
"root"
],
[
"e",
"b1e252fff944653ad1250d18a1a67c4e7c5a582c9095646359c1196a4de1cab7",
"",
"reply"
],
[
"proxy",
"https://mastodon.social/@webology/112604629111954439",
"web"
],
[
"proxy",
"https://mastodon.social/users/webology/statuses/112604629111954439",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.social/users/webology/statuses/112604629111954439",
"pink.momostr"
]
],
"content": "I'm not using Docker. I have apps in Docker that might connect to it, but I run Ollama natively. \n\nDocker does support GPUs on the mac, which is where 99% of the performance comes form.",
"sig": "0cee9fde244ae502f0544e51fe2ad3a5ba4b4c3d55f73c7872f89a3ffdf24793428833a01b8ef71f554e24dfb70e35d8baf30aa3a0ae35f1125f1f75ad64ab59"
}