Here's a picture of the gap that can develop when the contacts are pressed down, into the "hole". Doesn't seem like much, but it's enough for some of the pogo pins not to touch their pads.