My officaiting experience is in baseball, but I have changed over the years as well. When I was young and stupid, I tossed coaches left and right, for the slightest infraction. I had a chip on my shoulder, and was out to prove who was in charge.
Now that I'm old (and still stupid), I ignore the vast majority of what they say. I haven't tossed a coach in years. Part of it is that I don't think I have to prove who is in charge any more. Part of it is I am more respected now that I have been around for years. But a big part of it is I just don't care what they say. They're not hollering at me, they are hollering at whoever is the umpire that day.
If he denigrates the other team or says something profane that the world can hear, they he has to go. If I do reach my limit, a simple, "Coach, that's enough" usually puts an end to it. In bad cases, I have been known to call time, pull out the roster card, and call him out as if there is a lineup issue. While we are together and no one else can hear, I let him know he has reached his limit, and I will not listen to another word. That is a one way conversation, and no one in the park knows I just laid down the law, they think we were discussing the card in my hand. He saves face, I make my point, and we usually finish without another problem.