Alcohol is not good for testosterone levels. Wondering if I drink too much? What affects alcohol? the pituitary gland? Lowering lh and fsh? or is it the testicles that stop working ?. primary or secondary hypogonadism.?Or is it the rising estrogen which in turn affects the sbhg levels which in turn lowers free testosterone?