OpenAI's statement on "governance of superintelligence" is basically "in our humble opinion you should regulate AI, but not *our* company's AI which is good, but instead only imaginary evil AI that exists only in the nightmares you have after reading too many Sci-Fi books, and the regulatory framework you choose should be this laughably guaranteed-to-fail regulatory framework which we designed here on a napkin while laughing" https://openai.com/blog/governance-of-superintelligence
Governance of superintelligence

Now is a good time to start thinking about the governance of superintelligence—future AI systems dramatically more capable than even AGI.

Like ... having been involved in major governments trying to set up coordinated action through multilateral organizations, my careful and considered response to any tech bro who says "major governments around the world could just set up [X]" is "lol, lmao"
@Pwnallthethings I think tech bros overestimate the power of governments the same reason they overestimate the power of DAOs. They’re not good at understanding or relating to people, so it’s easier to think about them using really simple models. Works for computers, not so much for people.
@Pwnallthethings It took nearly 20 years to negotiate a UN treaty of the high seas. And that’s for a problem that’s literally bounded and nobody is giving up existential military or economic advantage.