AI hallucinates software packages and devs download them – even if potentially poisoned with malware

Coding tools were the first generative AI tools in wide deployment. But they can hallucinate packages – and that can lead to troubles, according to The Register:

Several big businesses have published source code that incorporates a software package previously hallucinated by generative AI.

Not only that but someone, having spotted this reoccurring hallucination, had turned that made-up dependency into a real one, which was subsequently downloaded and installed thousands of times by developers as a result of the AI’s bad advice, we’ve learned. If the package was laced with actual malware, rather than being a benign test, the results could have been disastrous.

A well-timed hack could use a hallucination as a weapon.

Read all about that here.

Leave a comment