@jonny Even people who should know better underestimate just how bad the results of those systems are: dl.acm.org/doi/10.1145/3558489

Quote: "Our results suggest that GitHub Copilot was able to generate valid code with a 91.5% success rate. In terms of code correctness, out of 164 problems, 47 (28.7%) were correctly, while 84 (51.2%) were partially correctly, and 33 (20.1%) were incorrectly generated."

More than 70% of the code generated is at least partly flawed.