I had a family member who had a kidney stone start drinking their tap water a lot so they wouldn’t get another one. Their tap (well) water had so much calcium that they ended up getting another kidney stone from drinking too much water.
It doesn’t work like this, though. High calcium alone won’t give you kidney stones. They ended up with another kidney stone because they either had a genetic predisposition or because they didn’t end the habit that caused their kidney stone.