Is this something that happens to everyone? Im into week 5 and mine are the same size still hopefully they'll stay that way, is it the ball SACK that shrinks or the actual balls?