Black Shoe Diaries: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
Around SBN: Spencer Hall's Sports Meme Power Rankings

On Polls and Such

Earlier this week I put out my preseason blogpoll ballot for the world to see. It got some criticism and I respect that and thank you all for it. I never really thought about what goes into making a poll until last year when I participated in the blogpoll for the first time.

Polls are complicated. Try putting one together sometime. Coming up with a top five is pretty easy. After that it's not hard coming up with a list of ten schools to plug into the 6-15 slots, but ranking them in order can be mind bending. Positions 16-20 usually aren't hard. You can find good teams that have a few losses and are just a few players away from being great to plug in there. Slots 21-25 are agonizing to rank. By this time you're swamped with a sea of 20 or so teams that aren't bad but just don't impress you that much. Picking the top five out of that group is a crap shoot. Luckily nobody usually cares about the teams ranked that low to notice who you put in there.

Brian is pretty selective in who he allows in the blogpoll, so I take my vote pretty seriously. I probably put more thought into it than the average blogpoll voter, and I'm sure I put more thought into it that the coaches and AP writers put in their ballots.

Although it will never happen I guess I'm striving for the perfect ballot. I'm an engineer, so I tend to put everything into equations when I pick them apart.

SEC > ACC. Therefore #2 in SEC > #2 in ACC

Loss to unranked team = -8 in rankings

Win over unranked team = 0

Win over top five team = +5 in rankings

Loss to top five team = -4 in rankings

If you struggle against an unranked team and you are a top 10 team then -2 spots

If you struggle against an unranked team and you are not a top 10 team then 0 spots

This seems to be the collective thought process of the polls, but does not necessarily reflect the though process of each individual voter.

There are a few different ways you can look at the teams when putting together a ballot. You can judge teams based on the theoretical head-to-head matchup method. Basically, who would win if Team A played Team B? The problem is you can't always answer that question because Team A does not always play Team B on the field. All you're asking yourself is who would be favored to win? We all know that upsets happen every week so this is far from a perfect way to judge the college football landscape. Every year we see the lineages where Team A beat Team B who beat Team C who beat Florida and that's why the St. Marys School for the Blind is the #1 team in the country. This makes a mockery of the polling system, and rightfully so.

While the theoretical head-to-head matchup method is vastly popular, you are making assumptions that the favorite team will win every time disregarding the potential for upsets. You are ranking each team based on your perception of their performance and stature. But upsets change our perception of each team. If Purdue beats Michigan we suddenly realize Purdue must be better than we thought and/or Michigan must not be as good as we thought. So another way to rank teams is based on the resume method.

The resume method takes each team's real performance into account and nothing more. It bases a teams position in the poll on who they have beaten, not who they could beat. Of course the resume method has some flaws. It leads to major swings in the ballot in the early going of the season. Last year after Tennessee knocked off Cal in week one they rightfully would have been bumped to the top of the poll since they had the most impressive win in the young season. They had the best resume. Cal would have been banished from the top 25 altogether. This sounds crazy based on the currect AP and Coaches' Poll practice, but it's the other extreme to the theoretical head-to-head method. It discounts preconceived notions and perceptions to judge a team solely on its performance on the field. By mid to late season one would expect the wild swings to slow down as the top 25 picture comes into focus.

The resume method is the one I intend to utilize this year in putting together my blogpoll ballots. So you're going to see some wild swings. I may get a few wack ballot and Mr. Manic Depressive awards, but that's ok. I'm prepared for it and the ridicule that comes with it.

Please give me some feedback in the comments. What method would you use to rank teams? What do you like/dislike about the polls? I'm willing to take suggestions and I would like my ballot to be a collective effort of the BSD community. Each week I plan to post my ballot for discussion before I submit it. So please pick them apart.

0 recs  |  Comment 7 comments

Story-email Email Printer Print

Comments

Display:

Use both
I think you need to use both methods and switch the emphasis as the season wears on. For instance, before the season startes you can only use the theoretical head to head matchup. Then, as games are played and more info becomes available, slowly shift to resume. By week 7 or 8, you can use resume exclusively. But above all, use the rule of reason. Step back, take a look, and ask "Does this make sense?"

by PSU Mudder on Aug 17, 2007 1:50 PM EDT reply actions   0 recs

Polls
This is why even bothering to rank before a month into the season is nothing more than throwing names around.
Even worse, by starting what ends up being a surprisingly great team at #23, or even unranked, makes it almost impossible for them to climb to the top.
I know it makes for good discussions, arguments, etc., but until the season's got some mileage on it the rankings are simply gossip fodder

by Pete the Streak on Aug 17, 2007 4:42 PM EDT reply actions   0 recs

Agreed
That's why I will not be afraid to raise or drop teams 20 spots in first few weeks of the polls. I would think by week six things should settle down and I'll have a good idea where everyone should go.
Mike
Black Shoe Diaries

Hail to the Lion!

by BSD on Aug 17, 2007 7:25 PM EDT up reply actions   0 recs

Resume
Looking at actual achievements on the field is the only real way to do this, otherwise you sound like some idiot ESPN pundit screaming "I know Michigan would beat Florida!".  I'm going to start my post-week one ballot as a mixture of projections for the season and actual wins, and then hopefully by the middle of October have enough data to go strictly on resume alone.

I just can't respect ballots based on "Team A would beat Team B, so therefore they are ahead" because of things like match-ups, upsets and nobody really having any idea beyond simple guesswork.

Is it sad I almost wish the BCS - using modified equations like the great one you posted above - put more emphasis on computers than human polls at this point?

http://www.rakesofmallow.com

by CW on Aug 18, 2007 11:28 AM EDT reply actions   0 recs

Like using the RPI?
You don't want that, because it would force you to realize that 3 big east teams were in the top 10 of the nation last year, but only 2 big11 teams made it.  Wait! That can't be!  Let's go back to the popularity contest!

http://www.vaporia.com/sports/collegefootballrpi.html

by WakeUp on Aug 18, 2007 10:05 PM EDT reply actions   0 recs

the more
you know about statistics the more you begin to realize that RPI's are flawed as well.

Let's face it - everyone is trying to make rationality out of chaos - which is pretty silly if you ask me. None of this will ever completely make sense, even if we had a bunch of androids playing the game.

Keep in mind that there is nothing to keep you from coming up with your own Top 25 list and posting it here or anywhere else and having it critiqued.

Go Big Red Nebraska!
http://www.cornnation.com

by cornnation on Aug 19, 2007 7:43 AM EDT up reply actions   0 recs

Football playing robots!
Somebody call FOX, quick.

by PSU Nick on Aug 20, 2007 10:33 AM EDT up reply actions   0 recs

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation blog about the Penn State Nittany Lions.
Start posting about the Nittany Lions »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Amish2_small
Michigan State photoshop thread
Cairo_small
HATE WEEK: Michigan State!
Lenny_small
What time is it?
Lenny_small
MMM FREAKING BOP
Small
Playcalling - Beating the Dead Horse

Recent FanPosts

Talorbattlewallpaper2_1__small
Blame it on the ball?
Small
Pictures of High School Senior Girls, and some other stuff!!
Syracuse_small
Everyone take a deep breath!
Lenny_small
No comment
Shooter_small
Luck be a Lady Lion
Psu_small
Basketball Open Thread
Lenny_small
THURSDAY NIGHT OPEN THREAD AND OTTERS AND KITTIES AND STUFF
1018081638_small
Rainy Day Bullet Points
10367_small
Basketball open Thread?
Joepa_rival_small
Rose may not be Froze

+ New FanPost All FanPosts >

SPONSORS


Managers

Lioneye_edited_small BSD

Editors

Reporter_small Kevin HD

Image_small Run Up The Score

Official Partner of CBS Sports