In my opinion whip, era are good measures then look at k's and type of hits. As mentioned 3 pitches and three outs is hard to beat. When comparing pitchers on the same team I also look at E's committed. If the same defense commits more errors behind one pitcher then another is because they are having BB's hit at them.