I dare say, if'n you're shooting offhand you will never notice a difference, if there is a variation in weight.
On the other hand, if you are shooting from a solid rest, and shooting for the best score that has ever been shot, then you might as well weigh them. Otherwise, it is just something you do to amuse yourself.
Being a lazy sort, the only thing I have ever cast was whatever I could not find swaged ball for, like .678, .715, .820 and .980. The other sizes I shot were .530 and .610 and those were readily available as swaged ball.
Did I ever weigh them? Yeah, a long time ago. But like I said, all I was shooting was standing, so who cares if it is off a couple of grains or so. It surely has not made a bit of difference to my scores.