Currently we need to explicity call InvalidateLayout everytime an item is added or removed from HoverListView. This shouldn't be the case as views framework should implicitly handle all layout changes on child view removal/addition.