A crowd gathered Thursday in Merrimack to protest rumored plans for a federal immigration facility in the town.