Israel's social affairs minister Isaac Herzog on Monday became the first labour minister to quit the government after party leader Ehud Barak said he was leaving to form a new faction.