That seemed like an insult, ... I guess it was. Even after that, I thought he maybe put it badly and he didn't mean to be sending out these go-away vibes. But it turns out he put it exactly right.
Many 'hard' scientists regard the term 'social science' as an oxymoron. Science means hypotheses you can test, and prove or disprove. Social science is little more than observation putting on airs.