There should definitely be the option to choose it. I am somewhat annoyed that to see my guild mates they have to be non PvP flagged, not in my party or raid.