If your pitchers are being expected to field their position, or play IF as an alternate position, they should be getting IF practice work. Ground balls and overhand throws are fundamentals of the game, for every position. Generally speaking, I don't see an issue with working in a bullpen session before or after team fielding practice.