We have to be careful here. We can't allow coaches to dictate who will officiate the game (once it has started) and who won't. It goes without saying that this can be abused.
The Referee has to take control here. He is the one that directs the official off the field, not the coach. Given this set of circumstances as they were presented (assuming accurate), yes, I would have told the guy to leave.
In other situations -- and its happened with an official getting into it with a fan -- the admin has come to the official and told them to leave. The Referee still has the discretion, however, in most situations like that, the game should be suspended and the entire crew leave -- especially when it is less clear what the official did or that the official did something wrong.
