Because knowledge is power and most people don’t like giving whomever power over them for no reason. Also, it shouldn’t matter why privacy is important to people, the fact that it is should suffice to protect it.