2024-03-29 01:23:20
risks of nonexistent software names cited by LLMs
"AI hallucinates software packages and devs download them – even if potentially poisoned with malware
"Simply look out for libraries imagined by ML and make them real, with actual malicious code. No wait, don't do that"
Ha!
So far no evidence it's been used for malware (yet):
"... our package is not malicious it is just an example of how easy and dangerous it could be to leverage this technique"
#AI #LLM #coding