LDF lost fresh votes, says Jayarajan