People are using « tokens used » as productivity metric ?! « Tokens used »?!?!? That’s like, the first time « lines of code created » gets beaten for the « worst metric of software engineering » 🫠
@romeu Believing that AI is bringing about a productivity revolution, management will see AI as an opportunity yes, but primarily as a necessity, and an existential threat.
@romeu They will fear that unless everyone gets on board the AI juggernaut, the organization will be disrupted by new-fangled competitors who are reaping the insane productivity benefits that they have been convinced exist.
@romeu Hence the problem to be solved will be seen as one of adoption, and the obstacle to be overcome, the friction caused by recalcitrant, stubborn, backwards dinosaurs. And tokens used is an adoption metric, albeit one that is extremely vulnerable to Goodhart's law.
@romeu The worst part is that the fear of the existential threat is not necessarily entirely unfounded, on at least two grounds. Regardless of whether or not there is any real productivity boost due to AI.
@romeu Customer management is likely to have bought into the same productivity narratives as your management, and will be looking to get a radically better deal than before. Whether or not that is possible for anyone to deliver.
@romeu And there will be no shortage of would-be competitors popping up claiming that they are in fact reaping those benefits and can deliver on those wishes. Whether or not that's true, both in the short and long term, doesn't matter: harm can be immediate.