Okay let's say we define male human as follows:
Human with penis and the male gonads (i.e. testicles)
And we define female human as follows:
Human with vagina and the female gonads (i.e. ovaries)
A human with a penis and a beard and a deep voice is definitely a male irrespective of what's in his sack.
A human with a vagina and breasts and smooth legs is definitely a female irrespective of what's in her abdomen.
I think that you are irrational to place more importance in the internals than the externals. 99% of us never see the internals apart from surgeons and Mexican cartel members.