juraj on Nostr: Leopold Aschenbrenner is an industry insider, who used to work for OpenAI on AI ...
Leopold Aschenbrenner is an industry insider, who used to work for OpenAI on AI alignment problems, in a team lead by now famous Ilya Sutskever. He understands what is happening in the industry and especially how fast they are going.
The essays start by “AGI by 2027 is strikingly plausible”. He explains how. It’s not only computational power increases, but algorithmic / research improvements. I like how he explains how alien these models could be, what we can understand with them and how is alignment done these days and why this exact strategy won’t work later down the line.
But there are some important parts where we differ in opinion.
https://juraj.bednar.io/en/blog-en/2024/07/14/situational-awareness-on-as-gi-a-somewhat-cypherpunk-perspective/ 
Published at
2024-07-14 23:42:09Event JSON
{
"id": "c9b755e580d9c504a0e6865790baf731595c5980ad7428059daa3d2d65eb4a39",
"pubkey": "dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6",
"created_at": 1720993329,
"kind": 1,
"tags": [
[
"imeta",
"url https://image.nostr.build/86deb8e392e5bdd5a825ab4d79cd1545669aacb6678a9da4bfb47a3615be083a.jpg",
"ox 86deb8e392e5bdd5a825ab4d79cd1545669aacb6678a9da4bfb47a3615be083a https://nostr.build",
"x 741a75ba2b6f2861660263b394da36604a141e83dd05ec0444a38bce4d627d1d",
"m image/jpeg",
"dim 1536x864",
"bh LJ7o9lV@I9s:.TMwMxxv%MRORks:",
"blurhash LJ7o9lV@I9s:.TMwMxxv%MRORks:"
]
],
"content": "Leopold Aschenbrenner is an industry insider, who used to work for OpenAI on AI alignment problems, in a team lead by now famous Ilya Sutskever. He understands what is happening in the industry and especially how fast they are going.\n\nThe essays start by “AGI by 2027 is strikingly plausible”. He explains how. It’s not only computational power increases, but algorithmic / research improvements. I like how he explains how alien these models could be, what we can understand with them and how is alignment done these days and why this exact strategy won’t work later down the line.\n\nBut there are some important parts where we differ in opinion.\n\nhttps://juraj.bednar.io/en/blog-en/2024/07/14/situational-awareness-on-as-gi-a-somewhat-cypherpunk-perspective/\n\n\n\nhttps://image.nostr.build/86deb8e392e5bdd5a825ab4d79cd1545669aacb6678a9da4bfb47a3615be083a.jpg",
"sig": "4deff7d0df06603153f04eee2565b65923f713c3496639a39252ed9ffde4fef03882dae3e4357f06c52ea1f3157c2ad61115c18e7a1501e060042e6e7178387d"
}
