No you don't have to take the plastic off and as long as you give it a vent then the bottle should be fine. 200 degrees isn't really hot enough to do much of anything to the rubber either.