Congress changed line even after PM speech