Shettar loses ministers on home turf