Whether they have the authority to do it or not, I see a parent tossed a couple of times a year, in my area. The ump gives them a warning to shut up and if they don't, bye bye. I have never seen a guy argue that the ump doesn't have the authority. I guess if they are dumb enough to be yelling they are dumb enough to think that they can be tossed.