Gregory's Server@carnage4life I would not be surprised if these conclusions are true, but this "study" is very flimsy. They compare total metrics across all measured codebases between 2023 and the prior years, assume that all differences are due to Copilot use, and then extrapolate conclusions. I am definitely an AI skeptic, but this is a marketing piece, not a research paper.
|
3 comments
@va2lam @carnage4life I agree, this is an area that really should be researched! Thank you for jumping in, I hope you or others get to research these questions deeper! @lafncow @carnage4life alas, the general productivity question is not one that I'm well equipped to investigate, but yes, specific properties of (generated) code are up my alley. |
@lafncow @carnage4life the research just hasn't been done yet (and should be!) The press write-up does quote a workshop paper I was involved in but that's also not strong evidence yet either.