Madison is asked to plan a big gala to benefit the Fifth Avenue concert hall, but turns it down because it sounds like too much work