I don't think you would dispute that if I asked you to...

I don't think you would dispute that if I asked you to describe what you were wearing it would be a different description from mine. So it strikes me as not a big deal that memoir is subjective. It's that it has to be honest in its retelling of facts or tell you that it's not.