The thing that’s interesting about this is that this isn’t trying to measure productivity but instead feelings of productivity.
In these kinds of studies, if they’re done soon after a new tool gets adopted, you find a noticeable positive sentiment: it feels productive because it’s new and you notice new things more
Usually, once the tool has been integrated and you repeat the study a couple of years down the line (which would be now-ish), you’d get a reversion to the mean: no improvement
3/n
Both of these results are usually completely orthogonal to the actual effect on productivity. You’re just measuring people’s sentiment towards the tool.
The later study usually reverts to the mean because the employee, when asked, is comparing the tool to a competitor, not the before state. As in, at that point when asked about the productivity benefit of cloud-based Word, they’re comparing it to Google Docs, not to the idea of dropping the cloud-based editor entirely
4/n