Locals fear that a noisy minority of anti-vaxxers is pushing Byron Bay to the brink of social division and economic collapse.