Top Congress ministers 'want to quit and work for party'