Crime, taxes may force many Britons to leave