If both factions, or neither, shall abuse you, you will...

If both factions, or neither, shall abuse you, you will probably be about right. Beware of being assailed by one and praised by the other.