[email protected] on Nostr: I think instruction pre-training makes a lot of sense. Intuitively it should make ...
I think instruction pre-training makes a lot of sense. Intuitively it should make convergence faster.
Although I’m surprised to see such drastic performance improvement.
Published at
2024-06-23 12:16:42Event JSON
{
"id": "65adf349f06494aa7c209e9d90573c721630c6d3c1fb175d414eb524d1b00386",
"pubkey": "90c7a400c665ac56942414e7908c0027dccabb016f41c758fe94840a9cd1af13",
"created_at": 1719137802,
"kind": 1,
"tags": [],
"content": "I think instruction pre-training makes a lot of sense. Intuitively it should make convergence faster.\nAlthough I’m surprised to see such drastic performance improvement.",
"sig": "08c57075e80f31889667c4216a5ab939b452c5aba88e4354bf0c9476284b95678d829ddc2de069ec91122563a3b364b7a58b667396812f0d6730051358d88553"
}
