https://writings.stephenwolfram.com/2024/08/whats-really-going-on-in-machine-learning-some-minimal-models/
"In some sense what machine learning is doing is to “mine” the computational universe for programs that do what one wants."
This is the crux of AI to me. There is a constant refrain that models are “just doing X”, where X is usually “predict the next word”, but the reality is that we have no idea what the models are doing. We only know that they access many gigabytes of memory, make billions or trillions of calculations, and after this immense amount of work, then they predict the next word.
#llm #ai
ynniv /
npub12a…x6fdh
2024-08-23 20:20:14
Author Public Key
npub12akj8hpakgzk6gygf9rzlm343nulpue3pgkx8jmvyeayh86cfrus4x6fdhPublished at
2024-08-23 20:20:14Event JSON
{
"id": "171389638df5e74a6f9d1509caea19ae4b3c27f76e954a27658cb65ba1e6f4d1",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1724437214,
"kind": 1,
"tags": [
[
"r",
"https://writings.stephenwolfram.com/2024/08/whats-really-going-on-in-machine-learning-some-minimal-models/"
],
[
"t",
"llm"
],
[
"t",
"ai"
]
],
"content": "https://writings.stephenwolfram.com/2024/08/whats-really-going-on-in-machine-learning-some-minimal-models/\n\n\"In some sense what machine learning is doing is to “mine” the computational universe for programs that do what one wants.\"\n\nThis is the crux of AI to me. There is a constant refrain that models are “just doing X”, where X is usually “predict the next word”, but the reality is that we have no idea what the models are doing. We only know that they access many gigabytes of memory, make billions or trillions of calculations, and after this immense amount of work, then they predict the next word.\n\n#llm #ai",
"sig": "d20dc3ce8b4d1ff861a284bf0b4b41763e3a697c28d0c02a8376d3c0bb6c72bc3519768241b4555af15df1cc1ba7bc8f04b5fb7549e4662a41332c61ad4e00ae"
}