in the light of further information (eg, you don't say what bullhorns you bought) it appears you bought the wrong items = incompatible.
The barrel of the brakes should slide into the bars whose internal diameter should allow a fit. Machining is not recommended IMO, a gentle filing of any inside chamfer is allowable.