I agree that the three buttons don’t make a huge difference, but I also don’t think users will swap between compact and card view often enough to warrant a permanent fixture on the top of the screen.

I personally would place it in settings under Appearance.