I'd like to echo what Dreador said. For me, it's a balance between all things. During college, I kept a pretty decent GPA, while hardcore raiding most of the time, but I also had a social life and went out most weekends. The one thing I didn't manage well while still playing WoW was my health. I hate "faster" foods and never exercised except for the random extremely casual ultimate frisbee game maybe once a week. I gained a lot of weight over 7 years of playing wow because of it, but I definitely had a booming social life as well.
And actually, now that I've quit and am focusing more on my health, I think I have less of a social life than I did when I was playing wow because I'm a little more relucant to drink a lot or go out to eat, especially on a week night, lol.
But ya, basically those people were super jelly and you were kinda troll-baited. You've got the long and short of it covered. There are still some people that even though there's no raids on weekends, will be on PvPing and truly DON'T have a life, but I think a lot of high end raiders really do have actual lives.
"If the world is something you accept rather than interpret, then you're susceptible to the influence of charismatic idiots." -Neil deGrasee Tyson
Twitter @Aggathon || @Tankspot || Twitch.Tv/Aggathon