Peter DesnoyersDec 21, 2022

Compiling Ceph on an older machine (20-core Ivy Bridge) I noticed that one g++ invocation had racked up 7+ minutes of CPU time. It was librbd/migration/HttpClient.cc, which has 755 lines of code.

Of course it includes 19 include files, 8 of them Boost ones, and in total expands to about 2700 files and a third of a million lines of code, so maybe it's the input file that's crazy, after all.

It all reminds me of being back in the 80s, when you went for a cup of coffee after kicking off a compile. (well, to top it off I'm in a special kind of hell because I'm debugging CMake files, and have to rebuild the whole damn thing repeatedly.)

Show threadMatt Benjamin
@pjd I've never been clear on why rbd needed to implement it's own HTTP/S3 client--RGW of course already has one that re-uses libcurl (though it might be replaced with a beast client at some point). So we could probably make that go away at some point...
Dec 21, 2022 at 11:21pmWeb
Show threadPeter DesnoyersDec 21, 2022
@monkius I never even tried to figure out how the migration logic works in RBD.
BTW I’m putting the finishing touches on a pull request for LSVD - hopefully I can get some folks to look at it after the holidays.
Funny how getting something to pass the correctness and performance tests at the same time is so much harder…