@tymwol @ploum Exactly, I use it as a templating engine on steroid. For instance in golang things like data := []struct {...}, the loop on data, the t.Errorf etc. The danger is to let it generate false tests complacently.

@tymwol @yac @ploum

So far i've had good experience with chatgpt, even its bug fixing skills are pretty decent, but i haven't coded anything complex so far just basic api tools, userscript, wordpress themes and plugins.

@dolanor @ploum I leverage its power for mundane tests. Specially there you must be very careful and not be influenced by false tests. I usually first think of the test I would like to write, let Copilot write it, then make sure it matches what I meant. Sort of a templating engine on steroid.

@dolanor @yac @ploum I might be ok with it sketching out some tests, creating some setup GivenXCondition methods and high level tests with comments about what it thinks needs to be tested, but it's not going to know the _semantic_ details of how things inside the code under test work. Like, a method returns an object that has a certain string field defined - should that be expected to have a value given the inputs, and what should that value be? For any nontrivial code, this is the use case.

@cm @yac @ploum
... by which we're back to "nobody needs this shit. Really." No surprise.