There is something inherently valuable about being a misfit. It's not to say that every person who has artistic talent was a social outcast, but there is definitely a value for identifying yourself differently and being proud that you are different.
With any kind of artistic thing, it's a muscle, like any athlete, and the moment you're not doing it, you lose all confidence. That's why I'm terrible with down time.