The goal of your offset is not to be zero. Actually, in a perfectly ideal world that would be impossible because it would result in your nozzle touching and dragging along the surface on the first layer. Your actual final Z offset figure will be arbitrary based on the vagarities of your particular machine including the total overall length of the nozzle and thickness of the build plate, etc.

The actual goal is to achieve an accurate first layer which results in a thickness of 0.2mm or whatever your first layer’s height is, with minimal inaccuracy. You have to set the offset of the nozzle from the plate via Z axis adjustment such that there is a (literally) paper-thin gap between the tip of the nozzle and the plate. That doesn’t mean just setting it to zero. If setting it to zero actually worked, there would not actually be any reason to calibrate it…

You definitely want to drop your z offset a little bit lower than you would with a smooth plate. The goal is to squish some of that plastic down into the texture of the bed for some extra grip. I always take mine about -0.07 from the auto z offset