Refugees, asylum seekers, victims of human trafficking and domestic violence are among those who have lost coverage.