Scientists find ChatGPT is inaccurate when answering computer programming questions

Using ChatGPT to help you code? Be careful according to Tech Xplor:

A team of computer scientists at Purdue University has found that the popular LLM, ChatGPT, is wildly inaccurate when responding to computer programming questions. In their paper published as part of the Proceedings of the CHI Conference on Human Factors in Computing Systems, the group describes how they pulled questions from the StackOverflow website and posed them to ChatGPT and then measured its degree of accuracy when responding.

I use it for coding – and it helps. But maybe it’s more trouble than it’s worth?

Read their report here.

Leave a comment