It could be that people have contradictory desires. It could be that society enforces contradictory norms. It could be that sex is actually complicated. It could be that some parts of traditional sexual morality were attempts to help negotiate these facts--it could be that love and sex do belong together in some important way. It could be that any attempt to get absolutely consistency here would be false and repressive.