opposite sex
opposite sex {n. phr.}
The sex different from the one being discussed or mentioned.
Fred came out and said he was gay, having never had any interest in the opposite sex.
Categories:
Source: A Dictionary of American Idioms