Silly one, heat exchanger on its way out?
Ours made a high pitch noise when firing up and then would stop, assume that the small hole or whatever it was, closed up once warm, however you could hear the noise inside and outside the house which is what pointed to it as it was amplified by the flue outside.