I do have to say that my first couple of conventions (all local in Chicago) were a bit intimidating exactly because I didn't know anybody in fandom. Now that I do (which I did in part by getting on programming) they are fun.

Slightly off-topic - some cons are more club-like than others. I attended Minicon and was consistently introduced as "the guest." It felt at times like I was showing up at a family reunion.