It is not sex per se - your identification with the body is the impediment in your spiritual growth.