PM defies calls for rollback of FDI in retail