Andrej Karpathy / @karpathy (RSS Feed) on Nostr: Less publicized but highly awesome aspect of GPT-4 launch was that OpenAI open ...

Less publicized but highly awesome aspect of GPT-4 launch was that OpenAI open sourced an evals framework, allowing us to crowdsource model evaluations at scale 📈. The repo is getting some very high quality PRs (rewarded with GPT-4 access).

I <3 evals; \`pip install evals\`

nitter.moomoo.me/kondrich2/status/1635687409668227072#m (https://nitter.moomoo.me/kondrich2/status/1635687409668227072#m)

https://nitter.moomoo.me/karpathy/status/1636459245184106497#m