My guess is that he remembers some of me, some of us...

My guess is that he remembers some of me, some of us together, and the rest rolled off him like topsoil in a flash flood.