Where does guilt and punishment lie, and are we not more...

Where does guilt and punishment lie, and are we not more expressive over remorse or guilt when other people see the badness in us?