The Case for Resume Ranking: A Diatribe Against BlogPoll Favoritism
The initial 2007 BlogPoll ballots are being submitted even as we speak. The BlogPoll was invented, and is administered, by MGoBlog's Brian Cook, who has turned it into one of the most respected institutions in the intercollegiate athletics blogosphere.
Consequently, we who have the privilege of voting in the BlogPoll take that responsibility seriously---not because we have any illusions about its impact, but because we believe what is worth doing is worth doing well---and those voters who cast their ballots carelessly (such as, for instance, someone who drops a team in the standings because he believes that team lost a game it actually won) are subject to being ridiculed by their peers.
I therefore found it heartening when I read this:
That sentiment comes from Mike of Black Shoe Diaries, whose life has included recent positive developments that no doubt help him to keep college football in its proper perspective.

I'm just getting started, but there will be an Edmund Burke reference before I'm done. Also, there will be Calvin Coolidge and Jennifer Love Hewitt references, as well, so you'll want to stick around for those, too.
Writes Mike:
While the theoretical head-to-head matchup method is vastly popular, you are making assumptions that the favorite team will win every time disregarding the potential for upsets. You are ranking each team based on your perception of their performance and stature. But upsets change our perception of each team. If Purdue beats Michigan we suddenly realize Purdue must be better than we thought and/or Michigan must not be as good as we thought.
Because of this, Mike concludes sensibly that he will be using the resume ranking approach this season, to which I also subscribe. His point about teams being favored, however, is one that warrants closer consideration and ought to give us pause.
When a college football fan uses the term "favored," of course, he is not referring to the expected outcome of an obvious mismatch; Florida is not "favored" to beat Western Kentucky because there is no realistic scenario under which the Gators conceivably could lose their season opener against the Hilltoppers.

However, the over/under on the number of times the poor sap wearing this suit in Gainesville, Fla., in an open-air stadium for three and a half hours of daylight on Labor Day weekend passes slap out from the heat is four.
Rather, "favored" is a gambling term. It refers to the betting line set by the Las Vegas oddsmakers regarding the outcome and margin of victory of an upcoming contest. I note this neither as an endorsement nor a condemnation of wagering, but only to call attention to the source and the underlying motivation behind the selection of favorites and underdogs.
Oddsmakers design betting lines in order to generate significant wagering on both sides of the line, so as to ensure that the bookies clean up, irrespective of which team wins or by how much. Betting lines move over the course of the week leading up to a game because the wagering is too one-sided and the bookmakers want the betting to be more evenly distributed.
These facts matter because they disabuse us of the misconception that a betting line has predictive value, or even that it represents a prediction. If the most knowledgeable oddsmaker in Las Vegas announces that Team A is favored by three points over Team B, he is not predicting that Team A will beat Team B by a field goal on Saturday. (This is more clearly illustrated by the frequency with which teams are favored by, say, "two and a half points." Such a line is designed to avoid a "push," but, obviously, it could not represent the actual margin of victory of the contest, unless you're using the metric system or something.)
Darn you, N.F.L. Europe, with your metric four-and-a-half-point field goals!
When a bookie says Team A is favored by three points, he isn't saying Team A will win by three points; he's saying that he thinks roughly half of his gamblers will think Team A will win by more than three points and the other half will think Team A will win by fewer than three points or will lose outright.
If the oddsmaker has estimated the inclinations of his bettors incorrectly, he will adjust the line accordingly. (As USA Today's rather simplistic odds primer puts it, with emphasis added: "Player injuries and wagers are among the top influences on line movement.") In other words, a bookie's goal is to have 50 per cent of the folks who put their money where their mouths are disagree with him.
Mike is right that picking favorites is no way to rank teams because upsets occur, but there is a deeper problem related to the very concept of the "favorite." In any contest expected to be competitive---in other words, in any game likely to have a meaningful effect on the rankings---a narrow favorite is, by definition, the team the oddsmaker expected would be deemed less likely to win by that much (or even win at all) by half of the folks who put money on the game. That is hardly a ringing endorsement of a favorite's expectation of victory, especially when we consider the high rate of inaccuracy even among the best bookies and shrewdest gamblers.
Point spreads neither have nor are intended to have predictive value. Much like Stewart Mandel's assessment of the national prominence of particular teams, betting lines are based upon oddsmakers' perceptions of other people's perceptions. Even though bookies, unlike Stewart Mandel, are not fools, neither are they savants intent on influencing pollsters' evaluations of particular teams. They just want there to be enough bettors both ways for the house to be assured of victory.
The house always wins. Unless you get George Clooney involved in the heist, of course.
Whether you put money on college football games is your business. (For the record, I don't, both because I am lousy at predicting the outcomes of college football games and because I am familiar with Paragraph 163(G) of the Social Principles contained in Part IV of The Book of Discipline of the United Methodist Church.)
When casting a college football poll ballot, though, a voter (be he a coach, a journalist, or a weblogger) should give consideration to several criteria . . . but the point spread ain't one of 'em. The favorite in a competitive contest is the team that the guy setting the line hopes half the bettors won't pick.
As an astute commenter at Mike's site noted, pollsters are forced to "use the theoretical head to head matchup"---as Brian puts it, "[a]t all times it should be an approximate ranking [of] who would beat who[m] on a neutral field this year"---until enough games have been played to give anything like enough data to draw reasonable conclusions. Mike's commenter, PSU Mudder, continues:
That is a succinct way of stating precisely the correct position. (Not having been blessed with concision, I regard it as a strength in others.)

Suffice it to say that no one ever lost by betting that I could be persuaded to utter at least three words.
At this point, it's all guesswork, so prospective assessments of the my-dad-could-beat-up-your-dad-and-the-Partridge-Family-would-win-a-fight-with-the-Brady-Bunch playground variety are all we have upon which to rely. This leaves folks like me in the position of sending e-mails to in-laws, old pals, and Sunday Morning Quarterback asking if I am completely crazy, thereby eliciting responses such as this one, which arrived in my in-box from a longtime friend whom I have known since he was nine at 9:45 on Wednesday evening accompanied by a mild adult language advisory:
You know what I think.
I think Florida (I hate Florida) would kick UCLA's ass.
I think Florida would roll up Michigan and smoke them.
I think Florida would spank Louisville.
I tremble in fear of Florida to an unnatural, unhealthy, undignified degree. But I don't think it's unwarranted.
And I don't think we are the 14th best team in the nation (though I don't disagree with your ranking.) We're either the 3rd or the 50th, I just don't know which.
Also, Arizona is setting you up. I don't know if you specifically are the intended target of their campaign of unduly raised expectation. My guess is that the season ticket holders and Pac 10 media are the bogeys of this get-their-hopes-up assault. I just don't want to see you become collateral damage.
Also, for no reason having anything to do with knowledge or analysis, I think Clemson is going to blow this year. Not under-perform-but-then-finish-strong. Totally blow.
Also, I'm ready for the Cal thing to be over. I'm not saying it is over or is going to be. But I'm ready for it to be.
That analysis could prove thoroughly prescient or absolutely baseless, but no one yet knows which for sure. Once we get into the meat of the season, though, facile evaluations of underdogs and favorites will have seen their utility dissolve into futility. When we arrive at that juncture, Mike is right that we should cast our ballots based not upon what we think might happen next Saturday, but on what we know happened on the preceding Saturdays.
Call it the Jennifer Love Hewitt theory of poll voting: "I Know What You Did This Autumn."
Until enough facts are known for reasonable conclusions to be drawn, though, those denizens of Bulldog Nation and visitors from other schools who form the Dawg Sports reader community may feel free to treat me as your BlogPoll representative. Some of you already have shared your views upon my ballot, which I appreciate and encourage, with the understanding that I subscribe to the view of representation enunciated by Edmund Burke 194 years to the day before I was born (and 233 years to the day before this year's Georgia-Troy game):
My worthy colleague says, his will ought to be subservient to yours. If that be all, the thing is innocent. If government were a matter of will upon any side, yours, without question, ought to be superior. But government and legislation are matters of reason and judgment, and not of inclination; and what sort of reason is that, in which the determination precedes the discussion; in which one set of men deliberate, and another decide; and where those who form the conclusion are perhaps three hundred miles distant from those who hear the arguments?
To deliver an opinion, is the right of all men; that of constituents is a weighty and respectable opinion, which a representative ought always to rejoice to hear; and which he ought always most seriously to consider. But authoritative instructions; mandates issued, which the member is bound blindly and implicitly to obey, to vote, and to argue for, though contrary to the clearest conviction of his judgment and conscience,--these are things utterly unknown to the laws of this land, and which arise from a fundamental mistake of the whole order and tenor of our constitution.
Parliament is not a congress of ambassadors from different and hostile interests; which interests each must maintain, as an agent and advocate, against other agents and advocates; but parliament is a deliberative assembly of one nation, with one interest, that of the whole; where, not local purposes, not local prejudices, ought to guide, but the general good, resulting from the general reason of the whole. You choose a member indeed; but when you have chosen him, he is not member of Bristol, but he is a member of parliament. If the local constituent should have an interest, or should form an hasty opinion, evidently opposite to the real good of the rest of the community, the member for that place ought to be as far, as any other, from any endeavour to give it effect. I beg pardon for saying so much on this subject. I have been unwillingly drawn into it; but I shall ever use a respectful frankness of communication with you. Your faithful friend, your devoted servant, I shall be to the end of my life: a flatterer you do not wish for.
Such are the weighty considerations pressing upon the minds of those BlogPoll voters sufficiently refined in their thinking to recognize the linkage between college football and self-government.
Is it football season yet?
Go 'Dawgs!
0 recs |
7 comments
Comments
Big Red Rules
by Kanu on
Aug 18, 2007 12:31 AM EDT
reply
actions
0 recs
Jennifer Love Hewitt?
by Todd on
Aug 18, 2007 9:46 AM EDT
reply
actions
0 recs
I'll be honest with you:
In any case, Jennifer Love Hewitt is more closely identified with the "Last Summer" franchise, seeing as how she was in both movies, so I decided to go with her.
To each his own, I suppose.
by T Kyle King on
Aug 18, 2007 9:51 AM EDT
reply
actions
0 recs
Which way to Mecca?
As I understand it, if one were to rely solely on resume ranking, then the initial ballot would consist of a 119 way tie for first, last, and only place. This seems radically agnostic as have access to a large set of information about teams (depth, experience, coaching, etc...) prior to the first kickoff.
Following the bayesian approach to probability the set of information you have prior to the season is called your priors. In every day language this is what you expect prior to observing anything happen. Each week, as games are played you gather information, and use this new information to update you prior expectations. Call these your posteriors (but not because that is what got kicked the previous week). Slowly over the course of the season this process will reveal erroneous assumptions and beliefs resulting in a better ranking.
However, as I understand it, you are attempting to work from a blank slate and use only the new and relatively small amount of information you obtain each week to form your ranking.
For simplicity sake assume a 10 game season. How much information will you have after the first week's games are complete? If you only care about head to head contests you will have 10% of the information. And if you care about performance versus common opponents, you will have even less than that.
If you represent the set of information you have geometrically, a resume ranker would start at a tiny point, and slowly expand that point into a larger sphere by the end of the season.
If I understand the methodology, a resume ranking would not be very interesting early in the season, but would become more useful as the season progressed.
The usefulness of various ranking methodologies could be compared by measuring deltas between the initial and final rankings.
And I really wish I could draw a venn diagram in this comment box.
by 34hawk on
Aug 18, 2007 12:44 PM EDT
reply
actions
0 recs
See that can of worms?
But.
The whole process of issuing rankings is farcical as a way of trying to determine which 2 teams should be in a national championship game. So much effort is spent trying to come up with a justifiable array of teams that I think we miss the bigger picture. How is it that a sport riddled with statistics, a glut of data, and a structure that no longer produces the glorious ambiguity of a tie, descends into questions of who "deserves" a ranking?
I understand the arguments against rationalizing college football out of the era of power conferences formed when the train was the primary mode of long distance travel, whether those arguments are logistical or traditional in nature. However, the absence of a series of nation-wide, tiered leagues means that there's no way to pick championship contenders purely on the basis of results. Correspondingly I can't take the rigor of the process that seriously.
In some regards, for me this is almost the reverse of the Burke quote that you cited above: as a matter of individual conscience, so to speak, I think the whole ranking / poll process is downright silly, a satin sash of rationality placed over a stained frock that was never designed to present the desired result. But as a matter of my support for my team, you can be sure I'll be paying attention to the rankings, especially as the season progresses.
* I'm thinking specifically of the Wisconsin fans I saw in southern California for the 1994 Rose Bowl against UCLA. I remember being on the beach at Laguna Beach for a stroll with the aged parents, and being stunned at all these enormous blond loonies in their shorts - I mean, it couldn't have been more than 65 degrees. Many years later I went to a wedding in Madison in early October and started to understand their reaction. T'wasn't cold yet, but it certainly wasn't warm.
by DC Trojan on
Aug 18, 2007 9:17 PM EDT
reply
actions
0 recs
holy crap
A glut of data - what exactly does a glut of data do for us? Perhaps it could serve to get someone a grant, just like those studies that tell us we should be drinking red wine for our heart, but then two months later tell us we shouldn't drink red wine because of alzheimer's (or some such thing, you get the point).
The whole ranking thing is downright silly and I look forward to joining in the silliness. What I'm continually amazed by is this need to make it a rational process instead of just enjoying it for what it is.
BTW, I notice your Amazon ads pull up thongs on this page. My site never pulls up thongs. Does that mean my site is dull?
http://www.cornnation.com
by cornnation on
Aug 19, 2007 12:53 PM EDT
reply
actions
0 recs
Glut of data
I don't think that a glut of data gets you much in this case. What I do find ironic is that a sport in which so much importance is placed on data, is still stuck in a championship structure that can't be resolved entirely with data... or to keep it more simple, wins and losses.
by DC Trojan on
Aug 20, 2007 10:37 AM EDT
up
reply
actions
0 recs








