Vertigo, it was thought at the time, could only be caused by a disease of the cerebellum. He observed this kind of patient for years and saw absolutely no symptoms of brain disease.
If the temperature of the water was really responsible, then water at exactly body temperature should cause neither nystagmus nor vertigo.