If you suddenly swap in a new searcher in between pages then the documents assigned to each page could shift, causing the user to see duplicate results across pages, or, to miss some results. This erodes your user's trust which is pretty much the kiss of death for any search application.
Erik Hatcher, Otis Gospodnetic, Michael McCandless
Lucene in Action
Manning Publications (2009)