I don't know if the guy is a pervert or not, but if he doesn't know better than to do what he did, he has no business being an umpire around girls.
I don't know why, but some people think it's okay to touch unfamiliar people in the course of normal conversation, even with the best of intentions. It's not okay. Some people have trauma histories, some people are sensory defensive, and some people simply don't like to be touched by people they don't know well.