As you may have noticed, Wisconsin inhabits the #2 spot in my ratings this morning despite having lost five of its first 17 games, including a home game to Iowa and a lopsided loss to Michigan in the past week alone. <\/p>\n
This is an issue that is not going to go away this season. Even in a worst-case scenario for the Badgers, they are going to be highly ranked on this web site the rest of the season. This bothers many people and in order to manage the increasing number of inquiries into the matter, I have established what the tech geeks call a \u201cFAQ document\u201d for handy reference. What follows is that document. Please share with all parties you deem relevant to the matter.<\/p>\n
Q: Why do you think Wisconsin is #2?<\/b><\/p>\n
A: I actually don\u2019t think this. Please stop assuming that I, Ken Pomeroy, personally believe every team is properly ranked. No system can do this. Even if you<\/i> somehow had the time to rank all 345 teams, by the time you were done with this exercise, you would find some things that you didn\u2019t agree with in the rankings you had just made. For fun, spend some time just try ranking the top 50. Through some miracle, if you\u2019re happy with the position of each team when you\u2019re done, just let the results of games come in for the next 2-3 days and then see if you\u2019re still happy. <\/p>\n
The bottom line is that is impossible to rank 345 teams that will make any particular individual happy. There are always going to be some outliers in a system. Wisconsin is perhaps the biggest outlier ever in my system. And it\u2019s only going to get worse, because they are going to lose more games and not drop very far because most of the teams they play the rest of the season are very good. But to get back to the question, I don\u2019t believe they\u2019re the second-best team in the country. Something like #20 sounds about right.<\/p>\n
Q: Who has Wisconsin beaten to deserve to be #2?<\/b><\/p>\n
A: As a reminder, the ratings are not meant to have any relation to the polls. (The first paragraph on the ratings explanation page<\/a> is worth reading if you haven\u2019t seen it before.) I don\u2019t care who \u201cdeserves\u201d to be #2. The #2 team in my system should be the second-best in the country. It is theoretically possible to be the second-best team in the nation without having beaten anyone of prominence. <\/p>\n As an example, in 2010, Duke went 1-3 against teams ranked better than 20th in my system during the regular season. Then in the tournament they went 5-0 against such teams! It was crazy, but not completely surprising. The point is, for predictive purposes, simply looking at who a team has beaten or lost to is short-sighted. Obviously this methodology has not worked well in predicting the Badgers\u2019 recent performance. Duly noted. In bulk, though, simply rating teams by the quality of their wins and losses is not going to make for a good predictive system.<\/p>\n Q: The fact that Wisconsin is #2 invalidates all of your work.<\/b> (More of a comment, really.)<\/p>\n I disagree. Let\u2019s say you are very good at performing some task. For the next 345 times you perform this task, I will judge you based on your worst effort. I don\u2019t think you would feel like this is a fair way to measure your ability to perform the task. Because it isn\u2019t.<\/p>\n If you are going to trash the entire system based on the biggest outlier over the last six years, I suspect you had no desire to use the system in the first place. Either that, or your team is ranked lower than you think it should be.<\/p>\n Q. When are you going to fix this?<\/b><\/p>\n First off, I\u2019m not sure it can be fixed. I mean, sure I can fix it so Wisconsin is ranked more reasonably. I could add some code to my algorithm like this\u2026<\/p>\n But that really isn\u2019t a good way to solve the problem. Needless to say, I\u2019d like<\/i> to fix it. However, fixing Wisconsin can result in messing things up for others. Plus, there are a lot of other ratings systems already doing cool things, and I\u2019m not in the game of copying others\u2019 work, so that doesn\u2019t leave a lot on the table for me to pursue. That doesn\u2019t mean improvements aren\u2019t possible, but regardless of what I come up with, I can promise you there will still be teams that you feel are mis-rated. <\/p>\n For instance, one of the most respected ratings systems in the nerd world is the LRMC ratings<\/a>. They had Wisconsin fifth before yesterday\u2019s games. Last year, heading into the tournament, they had Belmont fourth<\/a>, and their system outperforms mine! The Sagarin predictor<\/a>, also deservedly respected, had Wisconsin second heading into yesterday\u2019s games. <\/p>\n If you would simply remove Wisconsin from the planet, the ratings on my page would look fine to me. I guess you could ignore the entire system based on the worst outlier, but I don\u2019t think that makes a lot of sense. There\u2019s still some insight gained from the teams that differ from the polls. (See: Saint Louis, New Mexico, UConn, Mississippi State, among others.) <\/p>\n Q: Your work is flawed.<\/b> (Not really a Q, either, I guess, but I get this all the time.)<\/p>\n A: Ugh, I hate it when people say this. Of course it\u2019s flawed. The thing is, your knowledge is flawed, too. If you are ignoring potentially useful tools because of a single issue, then your judgment is flawed as well. And I\u2019m guessing you\u2019ve never tracked the quality of your knowledge so you don\u2019t even know how flawed it is. If you’re like most people, you think you’re knowledge is great because you remember the predictions you made that worked out and you forget about the ones that didn\u2019t. It\u2019s human nature<\/a>. <\/p>\n The difference between your flawed knowledge and my flawed system is that I am tracking the results of my system so you can identify all of the flaws for yourself. Ten years from now, you\u2019ll be able to look at my site and see that Wisconsin was like 21-13 at the end of the 2012 season and ranked #5. Whereas the time you made some crazy prediction that didn\u2019t pan out is quickly forgotten. <\/p>\n I would say there’s still enough value in the work here to provide a useful reality check on your own knowledge. Used together, your flawed knowledge and my flawed tools can be more powerful than used separately.<\/p>\n Q: Anything else we need to know?<\/b><\/p>\n A: Well, since you asked, you might as well know that Ohio State will almost surely be the #1 team the rest of the season. Also, they will probably finish with more losses than Kentucky or UNC or Syracuse, because they will play a tougher collection of teams the rest of the season. Just to reiterate, if you are looking for a ranking of teams by wins and losses, a la the AP poll or the RPI, then you\u2019ll be more fulfilled consulting the AP poll or RPI for your ranking needs as the season continues. (Sagarin and Massey actually have better systems for this purpose, though.) However, I believe you will be less enlightened by ignoring the work of predictive systems. <\/p>\n Note also, that this does not mean I think Ohio State is the best team in the country, nor do I expect you to think that! (Although right now, I actually do believe the Buckeyes are the best, but I may change my mind as upcoming events warrant.) I didn\u2019t think Duke was the best team two years ago, even after the tournament. But by the time the season ended, it was hard to argue they weren\u2019t one of the best teams in the country, and were significantly underrated by the folks who take a resume approach to evaluating teams at the expense of all other information. And basically, I don\u2019t think the Wisconsin situation invalidates the predictive methods used on this site, except in cases involving Wisconsin.<\/p>\n","protected":false},"excerpt":{"rendered":" As you may have noticed, Wisconsin inhabits the #2 spot in my ratings this morning despite having lost five of its first 17 games, including a home game to Iowa and a lopsided loss to Michigan in the past week alone. This is an issue that is not going to go away this season. Even […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/posts\/458"}],"collection":[{"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/comments?post=458"}],"version-history":[{"count":0,"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/posts\/458\/revisions"}],"wp:attachment":[{"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/media?parent=458"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/categories?post=458"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kenpom.com\/blog\/wp-json\/wp\/v2\/tags?post=458"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}if Wisconsin:\n\tdo something to fix Wisconsin\nelse:\n\tdo normal calculations\n<\/pre>\n