Even now, admidst all the desolation and punishment for their sins, His love and mercy continue. They aren't cast off forever. He will bring them back and give them many gifts. And if anyone tries to get His beloved's land or gifts while they are away, watch out.
Though He can't stand the disobedience and wants to destroy it, His heart of love cannot give them up.
His mercy is unending. His justice, forever. He may punish for a time. Maybe even appear to have cast them off. But He is still with them. It is not forever. He will heal and restore them again. Love cannot give them up.
Because that's what love does.