The Only Colors: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
New Blog: Along The Olentangy for Ohio State Fans!

Provoked Thoughts

This is not so much a blog post as it is an extended comment to these three thought-provoking posts from the three keenest tempo-free analysts in the blogosphere known universe.  Before we proceed, I'd encourage you to right-click on each of the three hyperlinks in that green phrase to open the posts in new tabs, read the three posts in their entirely, and then come back here.

[Sips on coffee while waiting for readers to return.]

OK, you're done?  In contemplating the broad question of how exactly tempo-free efficiency measures can/should be used for in evaluating college basketball teams, I've had two thoughts bouncing around in my head.  These thoughts may (or may not) have some utility to other observers, so I'll throw them out there for your consideration.

Thought #1: Tempo-free stats are more useful for telling us why a team is good (or bad) than they are for telling us whether a team is good (or bad).

As of Thursday, the top ten teams in the KenPom rankings were Duke, Kansas, Syracuse, BYU, Purdue, West Virginia, Kentucky, Ohio State, Kansas State, and Texas.  While most commentators would no doubt rearrange the order those ten teams are listed in, there's not an entry on that list that seems dramatically out of place.  (Texas is only ranked #21 in the current AP poll, but that's because poll voters tend to overweight recent performance.)

Similarly, Mr. Gasaway's most recent conference-only efficiency numbers identify Duke, Kansas, West Virginia/Syracuse, Ohio State/Wisconsin/Purdue, Cal, and Kentucky as the top teams in the six respective BCS conferences.  Again, nary a shocker on the list.

Tempo-free statistics can provide a guide to which teams may be slightly over- or underrated relative to conventional wisdom, but if they didn't exist, college basketball fans would not struggle to figure out which teams are the good ones.  (I'm pretty sure I'm subconsciously plagarizing that assertion--probably from Mr. Gasaway.)

What the numbers can tell us in a more counterintuitive fashion is what exactly it is that makes the good teams good.  This year's figures, for example, demonstrate that:

  • Despite Bob Huggins' reputation as a coach who specializes in teaching defense, West Virginia is excelling more because they score efficiently than because they stop their opponents from doing so.
  • While they may play a fast, exciting brand of basketball, Texas' recent struggles have been more a function of offensive problems than defensive letdowns.
  • Wisconsin (KenPom's #11 team) plays methodically, but their method has been somewhat more effective on offense than on defense.  (You knew that one, right?)

So that's my first thought: We should pay less attention to the order in which the tempo-free numbers rank basketball teams and more attention to the specific reasons the teams find themselves in their respective ranking positions.

Thought #2: It's still about wins and losses, baby.

My first point notwithstanding, tempo-free numbers, because they account for margin of victory, have a predictive value (as do Sagarin's PREDICTOR ratings, even though they're not technically tempo-free).  They tell us which teams have played fairly well but come up short in close games.

That's a useful tool for purposes of looking ahead at a team's prospects down the road, but once the buzzer sounds at the end of the game, a team has either won or it's lost.  It's a binary world.  I'm wading into the realm of subjective philosophy here, but I think that when you look back at a team's performance (for, say, purposes of determining NCAA Tournament suitability/seeding), you have to err on the side of rewarding teams that came out on the right side of contests with narrow score differentials.

Does that mean some teams will be punished for what boils down to bad luck?  It certainly does.  But luck is part of the game--and part of what makes competition (and, dare I say, life) so thrilling.

As a committed fan of a particular college basketball team, I'd much rather see our Spartans go 14-4 in Big Ten play by winning a half dozen close close games (still a possibility!) than finish 12-6 having blown out the vast majority of the 12 opponents they beat but lost 6 close games.  Tempo-free analysis will tell me the 12-6 team is fundamentally better than its record says it is (and vice versa for the 14-4 team), but it doesn't change the results in the scorebook.

Tempo-free efficiencies measures can tell us something about the future, but they can't change the past--and success can only concretely lie in the past.

I've perhaps stated the second part of my thinking on this matter in too stark of terms.  I don't have any problem if the gentlemen on the NCAA Selection Committee choose to take a gander at the KenPom ratings as they deliberate.  (My favorite computer ratings are the merged Sagarin Ratings, which do a nice job of blending a binary-outcome-based perspective with a point-differential-is-king perspective.)  If nothing else, the computer ratings are probably the best way to judge strength of schedule--which most definitely should be accounted for by the selection committee.

But I think we tempo-free adherents should recognize that our efficiency measures are ultimately a means for analysis, and not an end unto themselves.  (Note that this sentence successfully defeats a straw man argument, as I don't think any basketball observer, no matter how statistically-inclined, would argue that teams should be judged solely on cumulative point differential. Hey, I warned you these were just thoughts bouncing around in my head.)

Two cents deposited.

0 recs  |  Comment 7 comments |

Story-email Email Printer Print

Comments

Display:

I'm only going to deposit one cent

Since I have no quibble with Thought 2. If you imagine a distribution of teams based on the mythical substance “quality” (that we all want to be able to measure), then it’s probably pretty normal: a bell curve with a lot of teams clustered in the middle and progressively fewer teams as you move to the edges. We definitely don’t need tempo-free stats to find the teams more than, say, one standard deviation from the mean. But we do, I would argue, need them to find the teams that are good closer to the middle. Kansas and Duke and Kentucky don’t need our help, but a really good Old Dominion team (whom many may only have seen losing to an equally strong Northern Iowa team on the road last Friday) might. But the work that needs to be done there is probably less than the work that needs to be done to explain the “why” of quality and to replace “unicorn” stats (rebound margin, points in the paint, etc.) with stats that actually measure the components of winning. Once that effort is further along, the other may follow as well.

by Con-T on Feb 26, 2010 3:24 PM CST via mobile reply actions  

Agreed on #2 for sure

YOU PLAY TO WIN THE GAME! [/Herm Edwards]

Stats can predict how likely you are to win future games, but all that matters is winning. And there are factors to winning that aren’t accurately captured by stats (or at least can’t be incorporated into simple models without ugly ad-hockery) – Illinois two years ago is a perfect example of the wrong side of this, sitting in the top 40 in Pomeroy’s rankings with a losing record! Putting them in the tournament as one of the top 34 at-large teams would have been a travesty, but pure tempo-free stats would have suggested just that.

(Side note: I have a suspicion that “luck” in Pomeroy’s system is strongly correlated with free throw shooting; it certainly was for Illinois two years ago, as several of their close losses featured abominable shooting from the line – notably, Pruitt bricking four potential game-winning free throws in the final seconds of regulation and the first OT against Indiana. But I digress.)

Now, RPI has some equally egregious flaws. One of the biggest is the perceived difference between playing a team in the high 100s and a true “RPI anchor”-type in the high 200s or even 300s. For a tournament-level team, there should be no real difference (the difference is between a 98% chance of a win and a 99+% chance). Yet a team that plays #50 and #300 is going to be viewed as having an easier schedule than one who plays #110 and #200, despite being about twice as likely to lose a game. This is one big advantage of the Bradley-Terry method (which I posted earlier in the season, and may revisit around Bracket Day): ratings are determined by matching your “expected wins” based on your rating and your opponents’ to your actual win count. If you’re near the top, your ranking won’t be much different whether your sacrificial lamb was Florida Atlantic or Bryant, because you’re probably looking at a 99% chance versus 99.99%.

(To be fair, RPI isn’t alone in this flaw. Colley’s rankings have a similar problem: On his site, it lets you add hypothetical results and see the resulting rankings. I added a win for first-place Kansas over last-place Bryant, and it dropped Kansas to third and moved Bryant ahead of Alcorn State.)

Efficiency/scoring margin isn’t a particularly good measure by itself of which teams have achieved enough to deserve a tournament berth. Neither is the RPI, though. A mixed system like Sagarin’s is one possible answer, but I think it would be better (and certainly more plausible, with the NCAA’s aversion to anything that could be in the least construed as cause for running up the score) to stick to a pure W/L rating system (though one without the RPI’s flaws) as a starting point, tempered by awareness of close results one way or the other, mitigating circumstances such as injuries, and so on.

by SpartanDan on Feb 26, 2010 7:21 PM CST reply actions  

Latest Pomeroy take on this question

Eminently sensible.

Really boils down to how you weight the various factors. I say weight win-loss record more heavily.

Fight for The Only Colors: Green and White!

by KJ@theonlycolors on Feb 27, 2010 7:04 AM CST reply actions  

Very Cool

TOC linked on the Kenpom blog. I agree about the weight of wins and losses. I also agree with Pomeroy in the case of Purdue, where the win-loss outcome could be the same, but MOV would lead you to draw very different conclusions from the two scenarios.

by Con-T on Feb 27, 2010 7:56 AM CST up reply actions  

I think tempo free stats should be a consideration, but not the consideration

Win-loss record is important. I think Con-T is right that, whatever the criteria you use, the top teams will be obvious. It’s where you are picking the last few at large teams that you really need objective measures for who is better, and in those cases I think tempo free stats help inform things, by helping you identify which among those teams is better.

I’m not that concerned about it though, as those final at-large teams rarely make a deep tournament run, and the “more deserving” team that was left out as a consequence probably wouldn’t have gotten much further than the team that beat them out. Basically, whenever you make an argument that team x really deserved to be in over team y, the distinctions are so fine, and the teams involved so mediocre, that neither is probably going very far. Sure, some fans of the left-out team have hurt feelings, and ideally the best or most deserving teams should make the tournament, but in reality the selection of those last few at large teams has no bearing on who wins the tournament.

That said, tempo free stats help you pick the most deserving 34 teams, but using only them and ignoring win-loss record would be a mistake – results in actual games matter, and are an important criteria in judging which teams should make the cut. Throwing out win-loss record would be just as egregious as throwing out tempo-free rankings entirely. All available information should be used to measure teams against one another.

by TheCrestedHelm on Feb 27, 2010 9:15 AM CST reply actions  

I do think Pomeroy has a good point with regard to seeding

If everyone thinks team X from a non-BCS conference is better than the 9-7 4 seed they face in the first round, then team X should be ranked higher. It seems like teams from the non-BCS conferences always get punished in the seeding rather than in the getting left out of the tournament all together. To the extent that tempo free stats can help correct that problem they should be used.

by TheCrestedHelm on Feb 27, 2010 2:21 PM CST reply actions  

Comments For This Post Are Closed


User Tools

A Michigan State basketball and football blog community
Start posting about the Spartans »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

FanPosts

Community blog posts and discussion.

Recent FanPosts

Small
Recruiting data
Adorno5_small
Mike Shaw and 2011 Basketball Recruiting Loose Ends
State_small
Recruiting Tidbits
Small
Donavon Clark!
Small
Personal expectations when an MSU football schedule is announced.
Delvonduck_small
UM's NCAA Allegations, As Told Through "The Office"
Small
Big Ten Divisions
Small
Recruit #14 Jack Allen
Small
South Carolina-MSU is part of ESPN's 24 hour hoops marathon
State_small
Positional Revisionism and MSU Basketball

+ New FanPost All FanPosts >

SBNation.com Recent Stories

Big Ten commissioner Jim Delany speaks in Lincoln, Neb., Friday, June 11, 2010, in front of a Big Ten and a Nebraska backdrop. Nebraska made it official Friday and applied for membership in the Big Ten Conference, a potentially crippling blow to the Big 12 and the biggest move yet in an off season overhaul that will leave college sports looking much different by this time next year.(AP Photo/Nati Harnik) +5 updates

Big Ten Announces Conference Divisions For 2011

FILE - In this Sept. 24, 2009 photo, South Carolina's head coach Steve Spurrier stands with his quarterback Stephen Garcia (5) before the start of their NCAA college football game against Mississippi at Williams Brice Stadium in Columbia, S.C.    A year ago, first-time postseason starter Stephen Garcia got chewed out by South Carolina coach Steve Spurrier for playing video games the night before the Outback Bowl game. These days, Garcia putting all his focus where it counts most _ on the Gamecocks.  (AP Photo/Mary Ann Chastain, File)

College Football Kickoff: 2010 Season Gets Underway With Southern Mississippi At South Carolina

Pittsburgh running back Dion Lewis (28) runs with the ball during the second quarter of an NCAA college football game against Rutgers Friday, Oct. 16, 2009, in Piscataway, N.J.  Lewis ran for 180 yards and two touchdowns and Pittsburgh ended four years of frustration against Rutgers with a 24-17 victory on Friday night. (AP Photo/Mel Evans) +1 updates

College Football Kickoff: Utah Plays Host To No. 15 Pittsburgh Thursday Night

More from SBNation.com >


Managers

Onlycolors-md_small KJ@theonlycolors

Sbnation2_small Pete Rossman

Woodward_small LVS

Contributors

Square_sun_small Steve Hendershot

Adorno5_small intrpdtrvlr

Oldspartan_small Rob Visconti