Having alerts reorder without a visual indication can be confusing. This shouldn't be anything too obtrusive or heavy, maybe just some sort of subtle slide down/up to make it clearer to the user what is happening.