To me it means that interest in items other than pornography might also spoil a relationship the same way you mentioned.

Example: I am not going to hide my Ian Fleming books because I met a girl who doesn't like James Bond.

Or my Anal Cunt albums because she hates stupid grindcore music.

And so on.