Former ministers asked to vacate house