After a heated debate about the Eyre signing, I decided to take a closer look at the available free agent relievers.
If I were going to sign a relief pitcher, he would have had to prove that he is:
1. Good
2. Reliable
3. Not in decline
Other factors to consider would be whether he was lefty or righty and his age.
GoodRelievers are notoriously difficult to evaluate. Forget ERA, Wins and Losses. Saves and holds are very dependent on when the pitcher was used. Strikeouts per 9 and Walks per 9 is pretty good. WHIP is pretty good. I decided to use OPS Against. OPS is probably the best single measure of offensive ability, so using it in reverse should give a pretty good indication of a pitcher's ability to get batters out. It doesn't explicitly include strikeouts, but walks are figured into the on-base percentage portion.
ReliableThe pitcher had to have been healthy and effective enough to have pitched in the past three years. I drew an arbitrary cutoff at 30 IP a year. If a pitcher threw less than 30 innings, I consider him not pitching that year.
Not in declineThe pitcher has to either be pretty consistent from year to year, or getting better. I'm not going to quibble over a few points on the OPS Against.
As a litmus test for my approach, Billy Wagner should be at the top (or very close) in all my measurements. He is generally considered to be the best available relief pitcher, so these measurements should reflect that.
I went through the 75 available relief pitcher free agents and pulled their OPS Against for the past 3 seasons. I threw out any years they didn't have at least 30 IP.
This is a table of the pitchers with 3 years of stats, sorted by Average OPS Against. So I wasn't unduly influenced, I didn't include Eyre's stats until I had my formulas and criteria set up.
OPS Against
-------------------------------
Player 2003 2004 2005 Avg WtAvg Diff
Wagner, B .499 .518 .494 .504 .503 .001
Gordon, T .588 .520 .602 .570 .572 -.002
Ryan, B.J. .615 .549 .571 .578 .571 .007
Farnswrth, K .580 .769 .542 .630 .624 .006
Eyre, Scott .697 .699 .569 .655 .634 .021
Urbina, U .637 .659 .672 .656 .662 -.006
Tavarez, J .614 .620 .754 .663 .686 -.023
Hasegawa, S .620 .744 .658 .674 .680 -.006
Looper, B .686 .647 .756 .696 .708 -.012
Stanton, M .666 .657 .774 .699 .717 -.018
.
The WtAvg column is a Weighted Average giving more weight to more recent years. It is calculated like this:
((2003 OPSA)+(2004 OPSA x 2)+(2005 OPSA x 3))/6
The Diff column is the Average minus the Weighted Average. I used it as a rough guideline as to how the pitcher was trending over the past 3 years. Numbers near zero indicate consistency, positive numbers indicate getting better, and negative numbers indicate getting worse.
As you can see, Wagner is far and away the best relief pitcher free agent. Eyre is the fifth best, and has the best trending of the top 10.
I was a little surprised to see Kyle Farnsworth in the fourth slot, but he did have a really good 2003 and 2005.
I wouldn't use this list as my sole criteria for evaluating talent, but it does give a good objective indication of who should be looked at more closely.
When all 10 of these guys are signed, it will be interesting to go back and see if their contract values follow a similar ranking. Then we'll be able to better answer the question "Did the Cubs overpay for Eyre?"
Here's the full list of available relievers:
OPS Against
-------------------------------
Player 2003 2004 2005 Avg WtAvg Diff
Wagner, B .499 .518 .494 .504 .503 .001
Wunsch, K .511 .511 NA NA
Reyes, Al .547 .547 NA NA
Mantei, Matt .568 .568 NA NA
Gordon, Tom .588 .520 .602 .570 .572 -.002
Ryan, B.J. .615 .549 .571 .578 .571 .007
Howry, Bob .651 .512 .582 NA NA
Hoffman, T .606 .619 .613 NA NA
Dotel, O .552 .707 .630 NA NA
Farnswrth, K .580 .769 .542 .630 .624 .006
Seanez, Rudy .675 .629 .652 NA NA
Eyre, Scott .697 .699 .569 .655 .634 .021
Urbina, U .637 .659 .672 .656 .662 -.006
Tavarez, J .614 .620 .754 .663 .686 -.023
Carrara, G .602 .726 .664 NA NA
Hasegawa, S .620 .744 .658 .674 .680 -.006
Carrasco, H .789 .579 .684 NA NA
Nelson, Jeff .679 .690 .685 NA NA
Springer, R .686 .686 NA NA
Bottalico, R .614 .767 .691 NA NA
Santana, J .696 .696 NA NA
Looper, B .686 .647 .756 .696 .708 -.012
Stanton, M .666 .657 .774 .699 .717 -.018
Mecir, Jim .772 .677 .650 .700 .679 .020
Hammond, C .704 .732 .689 .708 .706 .003
Osuna, A .767 .654 .711 NA NA
Miceli, D .721 .701 .711 NA NA
Rincon, R .674 .691 .782 .716 .734 -.018
Weber, Ben .716 .716 NA NA
Alfonseca, A .771 .665 .718 NA NA
Martin, Tom .625 .816 .721 NA NA
Quantrill, P .561 .771 .838 .723 .770 -.046
Jones, Todd .890 .736 .553 .726 .670 .056
Eischen, J .776 .677 .727 NA NA
Myers, Mike .772 .791 .634 .732 .709 .023
Meadows, B .724 .687 .786 .732 .743 -.010
Worrell, Tim .637 .720 .850 .736 .771 -.036
Takatsu, S .548 .926 .737 NA NA
Baldwin, J .739 .739 NA NA
Remlinger, M .683 .671 .863 .739 .769 -.030
Brocail, Doug .699 .780 .740 NA NA
Eldred, Cal .743 .779 .699 .740 .733 .007
Rodriguez, F .733 .733 .766 .744 .750 -.005
Christiansen .723 .766 .745 NA NA
Embree, Alan .664 .694 .888 .749 .786 -.037
Telemaco, A .705 .794 .750 NA NA
Heredia, F .684 .818 .751 NA NA
Grimsley, J .818 .685 .752 NA NA
Wickman, Bob .810 .706 .758 NA NA
Dessens, E .809 .800 .679 .763 .741 .022
Sullivan, S .658 .870 .764 NA NA
Hernandez, R .845 .842 .627 .771 .735 .036
Mendoza, R .933 .611 .772 NA NA
Ligtenberg, K.733 .839 .786 NA NA
Mesa, Jose .823 .757 .785 .788 .782 .006
Halama, John .765 .793 .812 .790 .798 -.008
Reed, Steve .755 .751 .872 .793 .812 -.020
White, Gabe .730 .884 .807 NA NA
Wasdin, John .906 .721 .814 NA NA
Yabu, Keiichi .814 .814 NA NA
Reyes, Dennys .777 .855 .816 NA NA
Mulholland, T.844 .847 .764 .818 .805 .013
Herges, Matt .603 .890 .972 .822 .883 -.061
Kinney, Matt .783 .879 .831 NA NA
White, Rick .845 .880 .771 .832 .820 .012
Groom, Buddy .857 .803 .837 .832 .829 .003
Ginter, Matt .775 .917 .846 NA NA
Graves, D .869 .8011.004 .891 .914 -.023
Powell, Jay .916 .916 NA NA
Cooper, Brian
Karsay, Steve
Kida, Masao
Creek, Doug
Darensbourg, Vic
Thompson, Justin
Booker, Chris
.