Kalam was ready to swear Sonia as PM in 2004