Sunday, December 4, 2011

Remove the Human "Eye Test" from the Bowl Championship Series and You Get a Very Different Result







The BCS formula is made up of three parts and breaks down as follows:
1.    Harris Interactive Poll: (115 voters × 25 pts. = 2875 total possible) Each voter ranks teams 1 through 25, and then the #1 team on that ballot receives 25 points, the #2 team receives 24 points, and so forth until the #25 team receives 1 point. Each team’s total number of points is then divided by 2875 to reach the Harris Poll Percentage.

2.    USA Today Poll: (59 voters × 25 pts. = 1475 total possible) The same process described for the Harris Poll is the process used to reach the USA Today Poll Percentage. The only difference is that each team’s total number of points is divided by 1475.

3.    Six Computers Ranking Providers are used—Anderson & Hester, Richard Billingsley, Colley Matrix, Kenneth Massey, Jeff Sagarin, and Peter Wolfe: After each team’s highest and lowest computer rankings are dropped, the middle four rankings (each having 25 pts. possible) are added and divided by 100 to reach the Computer Rankings Percentage.

4.    The BCS Standings are then reached by averaging the percentages from 1–3 above.

You can read an adequate, though inaccurate, BCS explanation on ESPN.com or a more lengthy description on Wikipedia.

Most significant in the final BCS Standings is that the computers and the human voters agreed on the ranking of only three teams in the top twenty-five: LSU, Arkansas, and Nebraska. I highlighted these three teams in the list below. Yet the two separate human polls agreed with each other on the rankings of all twenty-five teams.

I also highlighted the teams that ended up with a lower ranking in the Final BCS Standings based solely on the “eye test,” or the human voters. Those teams are Oklahoma State, Kansas State, Oklahoma, Baylor, Georgia, TCU, Houston, Texas, and Auburn. By contrast, the teams that are not highlighted ended up with an inflated ranking in the Final BCS Standings because of the same human-voter eye test. It is interesting to see some of the very divergent differences in the rankings.

Final Computer Rankings:
1.                LSU (13-0)
2.                Oklahoma State (11-1)
3.                Alabama (11-1)
4.                Kansas State (10-2)
5.                Stanford (11-1)
5.                Arkansas (10-2)
7.                Oklahoma (9-3)
8.                Oregon (11-2)
9.                Boise State (11-1)
10.           South Carolina (10-2)
11.           Baylor (9-3)
12.           Georgia (10-3)
13.           Virginia Tech (11-2)
14.           Wisconsin (11-2)
15.           Michigan (10-2)
16.           Clemson (10-3)
17.           TCU (10-2)
18.           Houston (12-1)
19.           Texas (7-5)
19.           Nebraska (9-3)
21.           Auburn (7-5)
21.           Michigan State (10-3)
23.           Penn State (9-3)
24.           Southern Miss. (11-2)
25.           West Virginia (9-3)

Clearly any ranking system will have its problems of “fairness.” But a computer ranking system is objective—or at least it purports to be objective. Yet it quickly becomes evident that all the highlighted teams are either Big XII (or future Big XII in the case of TCU) or SEC teams, with the sole exception being Houston, which dropped one spot in the Final BCS Standings. The computers favor these two conferences over the rest, particularly the Big XII. But why?

While I’m not as familiar with the SEC, the Big XII is an extremely difficult conference to compete in (but from the way this season has played out, I’m sure the same is true for the SEC). Oklahoma State’s one loss, Kansas State’s two losses, Oklahoma’s and Baylor’s three losses each, Texas’s five losses, and even one of TCU’s two losses all came at the hands of Big XII teams.

The same holds true for the five Big XII teams that did not finish in the top twenty-five. All six of Iowa State’s losses, all seven of Texas Tech’s losses, and nine of Kansas’s ten losses were to Big XII teams. And although both teams are headed to the SEC next season, Texas A&M and Missouri each suffered five of six and four of five losses a piece to Big XII teams.


What does this mean? 

First, the Big XII’s non-conference record this season was an amazing 27-3. The three losses were to Georgia Tech (will play Utah in the Hyundai Sun Bowl), #6 Arkansas (will play #8 Kansas State in the AT&T Cotton Bowl), and Arizona State (will play #7 Boise State in the MAACO Bowl Las Vegas). 

Second, the Big XII tends to “shoot itself in the foot” when it comes to having any standout team that clearly dominates the rest of the conference. That’s how Oklahoma—holding the #1 ranking preseason through week 5—lost at home to an unranked Texas Tech team having a bad season (5-7 overall). That’s how Oklahoma State—starting at #9 preseason and moving to #3 by week 9— lost in Ames to an unranked Iowa State team (6-6 overall) in double overtime.

In the end, was Oklahoma State's loss to Iowa State worse” than Alabama's loss to LSU? Or were Oklahoma State's wins better than Alabama's wins? The Computer Rankings Percentage clearly indicates that the answer to these questions should be, no, yes.” The human voters were closely divided, but the “eye test” answered these same questions, yes, no.

In addition to the travesty that Oklahoma State will not get a shot at the National Championship is the fact that #8 Kansas State and #7 Boise State were both passed over for at-large bids. And #18 TCU was clearly prevented from moving up to #16 to receive its Automatic non-AQ bid. For their part, at least the human polls put TCU at #15. But the problem was still in the fact that the human polls put two, three-loss teams and Michigan ahead, thus preventing a TCU appearance in the BCS.

And how about the finagling that somehow moved an idle Michigan team from #16 the week before to #13 in the final standings? In order for a team to qualify for an at-large bid it must finish the season in the top fourteen and have at least nine wins. The ESPN commentators were all shocked on Nov. 27, when they saw that Michigan was #16. What kind of message did the commentators intend to send the voters? 
Michigan is supposed to get an at-large bid, so make sure that Michigan gets moved up at least two spots next Sunday. 
TCU ended its season 10-2, played its final game on Dec. 3, and was the Mountain West Conference Champion. Michigan also finished 10-2, played its final game on Nov. 26, but did not even win its division, let alone its conference. And how was each team rewarded for its efforts? TCU remained at #18, two spots shy of an Automatic Non-AQ bid, while Michigan leaped ahead to #13, grabbing an at-large bid to play against #11 Virginia Tech, another at-large bid, in the Sugar Bowl.

How did this Michigan magic happen? It's rather simple, really. 

Number 10 Oklahoma (CPUs: #5, USA: #11, Harris: #10) lost the de facto Big XII Championship Game to #3 Oklahoma State. 

Number 13 Michigan State (CPUs: #16, USA: #9, Harris: #11) lost the inaugural Big 10 Championship Game to #15 Wisconsin. 

And #14 Georgia (CPUs: #14, USA: #14, Harris: #12) lost the SEC Championship Game to #1 LSU.

Michigan State was already ranked higher in the human polls than it should have been, so it was easy for both human polls to drop Michigan State minimally to #13 (USA: -4 spots, Harris: -2 spots) and allow the Computers to do the dirty work of dropping Michigan State to #21 (CPUs: -5 spots), leaving Michigan State at #17 in the BCS. Michigan State dropped four spots because it played in the Big 10 Conference Championship Game against the #15 team and lost. 

Georgia, too, was easy. The human polls knew what to do and both somehow put Georgia at #18 (USA: -4 spots, Harris: -6 spots). As to the Computers, they actually moved Georgia up to #12 (CPUs: +2), leaving Georgia at #16 in the BCS. Georgia dropped two spots because it played in the SEC Conference Championship Game against the #1 team and lost.

Oklahoma, however, was not as easy to move behind the idling Michigan team as were the other two teams. This is because the Computers take into account strength of schedule and reject the “eye test” altogether. The Computers only dropped Oklahoma to #7 (CPUs: -2). Yet both the human polls somehow felt the need to drop Oklahoma to #19 (USA: -8, Harris: -9). This move by the human voters was by far the most ludicrous part of the Final BCS Standings. But tinkering with the system worked, and it left Oklahoma at #14 in the BCS. Oklahoma dropped four spots because it played in the Big XII de facto Conference Championship Game against the #3 team and lost.

What is the takeaway message? Both human polls ranking each of the top twenty-five teams in the exact same order as each other is no mere coincidence. Take the human “eye test” out of College Football Rankings. While one eye might be watching the games, the other eye is always watching the money.

Final Harris Poll Rankings, Dec. 4, 2011
Final USA Today Poll Rankings,
Dec. 4, 2011


Final BCS Standings, Dec. 4, 2011


Addendum to Self-Fulfilling Prophesy Post





Update: 12/3/2011 at 12:42am MT

Final Score: Oklahoma State 44, Oklahoma 10

Oklahoma State is very deserving of the win. My argument is that the media's love fest with Alabama and LSU had more to do with this completely uneven, blowout game than did Oklahoma State's superiority or Oklahoma's inferiority.

I have received a few questions so I will clarify my position.

Q1: Why would OU lose out on BCS bowl money, on purpose, for the sake of a conference that hasn’t done them any favors this season?
A1: It was my understanding that the remaining members of the Big 12 recently agreed to sign over their individual Tier 1 and Tier 2 television revenue to trust, allowing greater profit sharing across the board. Bowl Game Revenue and Football Championship Event Revenue are already divided equally among the members (after the team who plays in the bowl is allowed reimbursement for expenses). The following are the relevant sections from the Big 12 Conference Handbook:
§ 2.3 Revenue Distribution.  [T]he revenue distribution policy for the Conference shall be as provided in this Section 2.
§ 2.4 Bowl Game Revenue.  All revenue from Member Institutions participating in football bowl games shall be divided equally among all Member Institutions, after predetermined expense allowances have been deducted. The formula set forth as Appendix [IV] shall be used to calculate the predetermined expense allowances and is incorporated herein by reference as through fully set forth.
§ 2.5 Football Championship Event Revenue.  All net revenue pursuant to the Conference football championship game and related activities will be divided equally among the Member Institutions.
Appendix IV
Bowl Game Policies
Expense Formula:
The following institutional expense allowances will be provided for bowl participants:
Tier I:  Bowl Championship Series
National Championship Game
Expenses .................................................. $1,630,000
Travel .............................................$300/one-way mi
All other Bowl Championship Series Games
Expenses .................................................. $1,610,000
Travel .............................................$300/one-way mi
Tier II: Cotton, Alamo, Insight, Holiday, Pinstripe
Expenses .................................................... 1,000,000
Travel .............................................$300/one-way mi
Tier III: Texas, TicketCity, Military (or substitute bowl)
Expenses ..................................................... $680,000
Travel .............................................$300/one-way mi
Participating Member Institutions retain any “incidental” revenue provided by a bowl, including the value of complimentary sleeping rooms (e.g., transportation, meals, etc.) on top of the expense allowance for such bowl.  Member Institutions participating in a bowl game are not responsible for the Conference’s guaranteed purchase of tickets to the bowl; however, they will be permitted to retain one-half (1/2) of the revenue from the sale of tickets in excess of one-half (1/2) of the Conference guarantee.

Q2: So you think that OU threw the game?
A2: I am not saying that OU went into the game with the express purpose of playing poorly and letting OSU win (i.e., “throwing the game”). I’m saying that the Sports Media created a self-fulfilling prophesy (explained satisfactorily on Wikipedia), which was the main reason that this game was not a closely competitive matchup like it should have been. Both teams were extremely influenced by the psychological ramifications of the event, which significantly changed their behavior (compared to all other games they have played this season). OSU got a huge psychological boost from the media effectively saying that the whole nation would be forced to watch a rematch if OSU did not win big. And Oklahoma took a major psychological hit by knowing that beating OSU would mean an SEC rematch for the National Championship.

Saturday, December 3, 2011

A Self-Fulfilling Prophesy: Oklahoma's Loss is the Big XII's Win





I originally posted this comment in response to David Ubben’s Nov. 14th Big-12 Blog post, Oklahoma State last road block to rematch. I am now convinced that my logic holds true. Oklahoma is currently trailing Oklahoma State, 41–3. This is not the Oklahoma team that I have been watching all season. This is not the Oklahoma team that has beat Oklahoma State for the last eight years. There is a greater incentive for Oklahoma to lose rather than to win this game.

Ubben,

If your logic holds true—that Oklahoma State is the last road block to a rematch—then what incentive is there for the Sooners to even try to beat the Cowboys? Is there not more of an incentive to let Oklahoma State win at Bedlam if, no matter what, Oklahoma is not a second-to-“last roadblock to a rematch”? Surely that can't be the case. Brad Edwards, the BCS “guru,” says that Oklahoma’s loss to Texas Tech is all but impossible to overcome. But are you really convinced that Oklahoma State is the only roadblock to there being a rematch between LSU and Alabama in the National Championship Game? It seems like a futile game to be played between a number 2 team (then-Oklahoma State) and a number 5 team (then-Oklahoma) if Oklahoma knocking off Oklahoma State would not put Oklahoma in the National Championship Game. But Oklahoma State beating Oklahoma would surely put Oklahoma State in the NCG. 

Oregon beat a #4 team and a #18 team. Alabama has not beaten a single top 10 team but rather has beaten teams ranked #23, #14, and #12. LSU beat a #3 team and a #2 team (plus #25, #16, #17 and #20). OSU beat a #8 team (plus #22 and #14). Oklahoma beat teams ranked #5, #8, and #11 (plus it plays #22 Baylor on Saturday). 

When Oklahoma plays Oklahoma State (assuming Oregon, Alabama, and Oklahoma win out their next two games) logic would indicate that—having beat #22 Baylor— a win over #2 Oklahoma State would launch Oklahoma ahead of 2 spots. That kind of win over Oklahoma State has to be worth more than Alabama merely managing not to lose to (somehow, #24) Auburn. Or Oregon managing not to lose to Oregon State. 

Otherwise, Oklahoma is better off letting Oklahoma State win—just to ensure that no rematches take place. OSU playing in the NCG is better for the Big XII than neither OU nor OSU playing in the NCG.

The entire Sports Media is seeing a self-fulfilling prophesy. I don’t know how many articles I have read over the past three weeks that all seemed to say, “Unless Oklahoma State has a HUGE win over Oklahoma, there will be an LSU–Alabama rematch.” Well, Sports Media, Oklahoma heard you loud and clear. While Oklahoma State is a fantastic team (and well deserving of the win tonight) Oklahoma is definitely not this bad of a team. Oklahoma is taking one for the Big XII—ensuring that the Sports Media’s love fest with the SEC does not come to fruition.  

-----------------------------------------

Update: 12/3/2011 at 12:38am MT

Final Score: Oklahoma State 44, Oklahoma 10

Oklahoma State is very deserving of the win. My argument is that the media's love fest with Alabama and LSU had more to do with this completely uneven, blowout game than did Oklahoma State's superiority or Oklahoma's inferiority.

I have received a few questions so I will clarify my position.

Q1: Why would OU lose out on BCS bowl money, on purpose, for the sake of a conference that hasn’t done them any favors this season?
A1: It was my understanding that the remaining members of the Big 12 recently agreed to sign over their individual Tier 1 and Tier 2 television revenue to trust, allowing greater profit sharing across the board. Bowl Game Revenue and Football Championship Event Revenue are already divided equally among the members (after the team who plays in the bowl is allowed reimbursement for expenses). The following are the relevant sections from the Big 12 Conference Handbook:
§ 2.3 Revenue Distribution.  [T]he revenue distribution policy for the Conference shall be as provided in this Section 2.
§ 2.4 Bowl Game Revenue.  All revenue from Member Institutions participating in football bowl games shall be divided equally among all Member Institutions, after predetermined expense allowances have been deducted. The formula set forth as Appendix [IV] shall be used to calculate the predetermined expense allowances and is incorporated herein by reference as through fully set forth.
§ 2.5 Football Championship Event Revenue.  All net revenue pursuant to the Conference football championship game and related activities will be divided equally among the Member Institutions.
Appendix IV
Bowl Game Policies
Expense Formula:
The following institutional expense allowances will be provided for bowl participants:
Tier I:  Bowl Championship Series
National Championship Game
Expenses .................................................. $1,630,000
Travel .............................................$300/one-way mi
All other Bowl Championship Series Games
Expenses .................................................. $1,610,000
Travel .............................................$300/one-way mi
Tier II: Cotton, Alamo, Insight, Holiday, Pinstripe
Expenses .................................................... 1,000,000
Travel .............................................$300/one-way mi
Tier III: Texas, TicketCity, Military (or substitute bowl)
Expenses ..................................................... $680,000
Travel .............................................$300/one-way mi
Participating Member Institutions retain any “incidental” revenue provided by a bowl, including the value of complimentary sleeping rooms (e.g., transportation, meals, etc.) on top of the expense allowance for such bowl.  Member Institutions participating in a bowl game are not responsible for the Conference’s guaranteed purchase of tickets to the bowl; however, they will be permitted to retain one-half (1/2) of the revenue from the sale of tickets in excess of one-half (1/2) of the Conference guarantee.

Q2: So you think that OU threw the game?
A2: I am not saying that OU went into the game with the express purpose of playing poorly and letting OSU win (i.e., “throwing the game”). I’m saying that the Sports Media created a self-fulfilling prophesy (explained satisfactorily on Wikipedia), which was the main reason that this game was not a closely competitive matchup like it should have been. Both teams were extremely influenced by the psychological ramifications of the event, which significantly changed their behavior (compared to all other games they have played this season). OSU got a huge psychological boost from the media effectively saying that the whole nation would be forced to watch a rematch if OSU did not win big. And Oklahoma took a major psychological hit by knowing that beating OSU would mean an SEC rematch for the National Championship.