Frankly, I think that little of a variance doesn't really matter, especially if you are shooting from an unsupported position.
However, if one is in for very competitive bench rest shooting, I would weigh everything: the balls, the powder charges, heck, even the patches.
But, what do I know? Heck, I think by now I have forgotten most everything I ever did know.