Afghan President Hamid Karzai left Kabul on Tuesday for Kazakhstan to deliver a speech at a summit of Central Asian nations and hold talks with other regional powers, his office said.