With the current deployment of VOIP systems, you're not seeing nearly the risk of spam that you saw very quickly with the rise and popularity of e-mail.
Technology has improved incrementally in the last year, but spam volumes remain at all-time highs by most measures.