If the divots are a different color plastic then they have a different weight than the rest of the die as they contain different amounts of carbon black, camel white etc.
True, but that difference is insignificant compared to no material at all. Plus if you were REALLY anal, things could be done to exactly match the density.