A council says the risk posed by mass gatherings is “too great” so it has had to scrap the event.