On a more general perspective, orthogonal simply means "unrelated".
That's where it came from:
"In mathematics, two vectors are orthogonal if they are perpendicular, i.e., they form a right angle. The word comes from the Greek ὀρθός (orthos), meaning "straight", and γωνία (gonia), meaning "angle"."
And all other meanings are derived from that.
Think of a cartesian coordinate systems as an example: the axis are orthogonal. They describe two distinct dimensions.