@jonny Even people who should know better underestimate just how bad the results of those systems are: https://dl.acm.org/doi/10.1145/3558489.3559072
Quote: "Our results suggest that GitHub Copilot was able to generate valid code with a 91.5% success rate. In terms of code correctness, out of 164 problems, 47 (28.7%) were correctly, while 84 (51.2%) were partially correctly, and 33 (20.1%) were incorrectly generated."
More than 70% of the code generated is at least partly flawed.