Llama3 is trainable with consumer hardware! I just fine-tuned it a bit and made Emu.
Emu has slightly better alignment than Llama3 in these domains:
- bitcoin
- health
- permaculture
- herbs
https://huggingface.co/some1nostr/Emu-70B-Llama3
I will continue trainings and alignings. Emu has worse Nostr knowledge than Ostrich, because all the training on Llama2 based models had to restart, since Llama3 is such a big leap!
someone /
npub1nlk…jm9c
2024-04-28 19:59:01
Author Public Key
npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9cPublished at
2024-04-28 19:59:01Event JSON
{
"id": "c0b8b1d3a7bab8fb4f8a9f1f7567973bee8bf3b21f2abfa0fa8789cf40926b98",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1714327141,
"kind": 1,
"tags": [],
"content": "Llama3 is trainable with consumer hardware! I just fine-tuned it a bit and made Emu. \n\nEmu has slightly better alignment than Llama3 in these domains:\n- bitcoin\n- health\n- permaculture\n- herbs\n\nhttps://huggingface.co/some1nostr/Emu-70B-Llama3\n\nI will continue trainings and alignings. Emu has worse Nostr knowledge than Ostrich, because all the training on Llama2 based models had to restart, since Llama3 is such a big leap!\n\n",
"sig": "1e2f2aa89c74cad6377ced996ad78e17b696b8a5c7d80f0730ff453cb2636958b00b8272f6c0a85a844d5d5eb748e5980c74bf13bc91db9282c738c49ef8cc4c"
}