Higher borrowing costs and rising prices have made home purchasing less affordable for many buyers and caused speculators to pull back.