Maybe it's time to build a new, better benchmarking harness.   https://xkcd.com/927/
Standards

xkcd
@cl4es JMH has been around for a decade and has benefited from many insights and experiences. Duplicating that would take years and you’d really have to have a really good reason.
@bondolo that is sort of what I'm getting at and keep telling people, yet we have to deal with a neverending stream of bespoke benchmarks and benchmark harnesses. Often by rewriting or wrapping in JMH...
@bondolo where we might need something better than we currently have is tooling that helps us orchestrate benchmarking: download dependencies, data sets, set up complex environments (including databases). For testing and guiding optimization in the JDK plain JMH benchmarks is mostly fine, though mainly GC devs are clamoring for more bells and whistles.