Getting rid of this annoying hover feature is simple but Microsoft are not very good at explaining how to do this so this is how:
Right click in the search box and choose 'Search > Open on hover.' Uncheck that item.
Now this window will only open when you click the image at the right of the search box.
Not want the search highlights at all? Then uncheck the 'Show search highlights.'