Yes, I had similar situations, sorry pal but in my opinion its completely normal to occasionally have one of those problems. Remember the brain is our biggest sex organ and a lot of it is still a mystery.
For me all of this kind of situations happened with new partners, and this was all in my 20's and 30's when not in TRT. With some partners I never had problem. With some although I might wanted it badly couldn't perform correctly, dont know if any hormones or chemistry was involved or whatever.
At the end I chose for wife one with which that never got this problem
I wouldn't worry too much about it, although its easier said than done eheh...