Town officials say Deer Farm violated town zoning rules by hosting a large men’s religious retreat in August without required approval.