Cory Doctorow on Nostr: Here's a fun AI story: a security researcher noticed that large companies' ...
Here's a fun AI story: a security researcher noticed that large companies' AI-authored source-code repeatedly referenced a nonexistent library (an AI "hallucination"), so he created a (defanged) malicious library with that name and uploaded it, and thousands of developers automatically downloaded and incorporated it as they compiled the code:
https://www.theregister.com/2024/03/28/ai_bots_hallucinate_software_packages/1/
Published at
2024-04-01 16:44:24Event JSON
{
"id": "8005aeff22b24095d1c7e7587a315a51e3c45485ff939d90edf1531f76f600fe",
"pubkey": "4b461234559a9a14049435e1dd0e483916844ceadadfd6b5da824b157953bde6",
"created_at": 1711982664,
"kind": 1,
"tags": [
[
"proxy",
"https://mamot.fr/users/pluralistic/statuses/112196495887778626",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mamot.fr/users/pluralistic/statuses/112196495887778626",
"pink.momostr"
]
],
"content": "Here's a fun AI story: a security researcher noticed that large companies' AI-authored source-code repeatedly referenced a nonexistent library (an AI \"hallucination\"), so he created a (defanged) malicious library with that name and uploaded it, and thousands of developers automatically downloaded and incorporated it as they compiled the code:\n\nhttps://www.theregister.com/2024/03/28/ai_bots_hallucinate_software_packages/\n\n1/\nhttps://static.mamot.fr/media_attachments/files/112/196/497/223/785/216/original/3f483b4c12bad21f.jpg\n",
"sig": "91bb6e7059b3871260b0e3189970c9a694ab0436cbba26f0b63510fb63b85e487f710da5128eb01d55a5b5d4f3597e9a0aa2e1de35f36fa9826f0cb1dc75ec78"
}
