There are androgens and estrogens both in semen, but I don't think in large amounts. There have been theories that increased amounts of unprotected sex result in increased sex drive in women, and I think the hypothesis was that it was due to intravaginal T absorption, although I don't know if any of that ever been proven. Even if it does work that way there is the question of whether the amount of T in semen is increased if one takes exogenous T - I have no idea about that. Why I am responding when I know so little?
I guess I am pointing out that it is at least biologically plausible.
Remember there was a study that was in the news a few years ago where they concluded that women whose partners didn't use condoms had less depression and even fewer suicide attempts? The vaginal mucosa does absorb things pretty readily - so maybe what you are noticing is a real effect. Wouldn't it be interesting if men on TRT had the side effect of increasing their partner's sex drive (or just whether men with higher sex drives stimulated more sexual interest in their partners?). Anyway, let us know if the acne clears up.