Study of N.B.A. Sees Racial Bias in Calling Fouls

Message Bookmarked
Bookmark Removed
Study of N.B.A. Sees Racial Bias in Calling Fouls

By ALAN SCHWARZ
Published: May 2, 2007

An academic study of the National Basketball Association, whose playoffs continue tonight, suggests that a racial bias found in other parts of American society has existed on the basketball court as well.

A coming paper by a University of Pennsylvania professor and a Cornell University graduate student says that, during the 13 seasons from 1991 through 2004, white referees called fouls at a greater rate against black players than against white players.

Justin Wolfers, an assistant professor of business and public policy at the Wharton School, and Joseph Price, a Cornell graduate student in economics, found a corresponding bias in which black officials called fouls more frequently against white players, though that tendency was not as strong. They went on to claim that the different rates at which fouls are called “is large enough that the probability of a team winning is noticeably affected by the racial composition of the refereeing crew assigned to the game.”

N.B.A. Commissioner David Stern said in a telephone interview that the league saw a draft copy of the paper last year, and was moved to do its own study this March using its own database of foul calls, which specifies which official called which foul.

“We think our cut at the data is more powerful, more robust, and demonstrates that there is no bias,” Mr. Stern said.

Three independent experts asked by The Times to examine the Wolfers-Price paper and materials released by the N.B.A. said they considered the Wolfers-Price argument far more sound. The N.B.A. denied a request for its underlying data, even with names of officials and players removed, because it feared that the league’s confidentiality agreement with referees could be violated if the identities were determined through box scores.

The paper by Mr. Wolfers and Mr. Price has yet to undergo formal peer review before publication in an economic journal, but several prominent academic economists said it would contribute to the growing literature regarding subconscious racism in the workplace and elsewhere, such as in searches by the police.

The three experts who examined the Wolfers-Price paper and the N.B.A.’s materials were Ian Ayres of Yale Law School, the author of “Pervasive Prejudice?” and an expert in testing for how subtle racial bias, also known as implicit association, appears in interactions ranging from the setting of bail amounts to the tipping of taxi drivers; David Berri of California State University-Bakersfield, the author of “The Wages of Wins,” which analyzes sports issues using statistics; and Larry Katz of Harvard University, the senior editor of the Quarterly Journal of Economics.

“I would be more surprised if it didn’t exist,” Mr. Ayres said of an implicit association bias in the N.B.A. “There’s a growing consensus that a large proportion of racialized decisions is not driven by any conscious race discrimination, but that it is often just driven by unconscious, or subconscious, attitudes. When you force people to make snap decisions, they often can’t keep themselves from subconsciously treating blacks different than whites, men different from women.”

Mr. Berri added: “It’s not about basketball — it’s about what happens in the world. This is just the nature of decision-making, and when you have an evaluation team that’s so different from those being evaluated. Given that your league is mostly African-American, maybe you should have more African-American referees — for the same reason that you don’t want mostly white police forces in primarily black neighborhoods.”

To investigate whether such bias has existed in sports, Mr. Wolfers and Mr. Price examined data from publicly available box scores. They accounted for factors like the players’ positions, playing time and All-Star status; each group’s time on the court (black players played 83 percent of minutes, while 68 percent of officials were white); calls at home games and on the road; and other relevant data.

But they said they continued to find the same phenomenon: that players who were similar in all ways except skin color drew foul calls at a rate difference of up to 4 ½ percent depending on the racial composition of an N.B.A. game’s three-person referee crew.

Mark Cuban, the owner of the Dallas Mavericks and a vocal critic of his league’s officiating, said in a telephone interview after reading the paper: “We’re all human. We all have our own prejudice. That’s the point of doing statistical analysis. It bears it out in this application, as in a thousand others.”

Asked if he had ever suspected any racial bias among officials before reading the study, Mr. Cuban said, “No comment.”

Two veteran players who are African-American, Mike James of the Minnesota Timberwolves and Alan Henderson of the Philadelphia 76ers, each said that they did not think black or white officials had treated them differently.

“If that’s going on, then it’s something that needs to be dealt with,” James said. “But I’ve never seen it.”

Two African-American coaches, Doc Rivers of the Boston Celtics and Maurice Cheeks of the Philadelphia 76ers, declined to comment on the paper’s claims. Rod Thorn, the president of the New Jersey Nets and formerly the N.B.A.’s executive vice president for basketball operations, said: “I don’t believe it. I think officials get the vast majority of calls right. They don’t get them all right. The vast majority of our players are black.”

Mr. Wolfers and Mr. Price spend 41 pages accounting for such population disparities and more than a dozen other complicating factors.

For the 1991-92 through 2003-4 seasons, the authors analyzed every player’s box-score performance — minutes played, rebounds, shots made and missed, fouls and the like — in the context of the racial composition of the three-person crew refereeing that game. (The N.B.A. did not release its record of calls by specific officials to either Mr. Wolfers, Mr. Price or The Times, claiming it is kept for referee training purposes only.)

Mr. Wolfers said that he and Mr. Price classified each N.B.A. player and referee as either black or not black by assessing photographs and speaking with an anonymous former referee, and then using that information to predict how an official would view the player. About a dozen players could reasonably be placed in either category, but Mr. Wolfers said the classification of those players did not materially change the study’s findings.

During the 13-season period studied, black players played 83 percent of the minutes on the floor. With 68 percent of officials being white, three-person crews were either entirely white (30 percent of the time), had two white officials (47 percent), had two black officials (20 percent) or were entirely black (3 percent).

Mr. Stern said that the race of referees had never been considered when assembling crews for games.

With their database of almost 600,000 foul calls, Mr. Wolfers and Mr. Price used a common statistical technique called multivariable regression analysis, which can identify correlations between different variables. The economists accounted for a wide range of factors: that centers, who tend to draw more fouls, were disproportionately white; that veteran players and All-Stars tended to draw foul calls at different rates than rookies and non-stars; whether the players were at home or on the road, as officials can be influenced by crowd noise; particular coaches on the sidelines; the players’ assertiveness on the court, as defined by their established rates of assists, steals, turnovers and other statistics; and more subtle factors like how some substitute players enter games specifically to commit fouls.

Mr. Wolfers and Mr. Price examined whether otherwise similar black and white players had fouls-per-minute rates that varied with the racial makeup of the refereeing crew.

“Across all of these specifications,” they write, “we find that black players receive around 0.12-0.20 more fouls per 48 minutes played (an increase of 2 ½-4 ½ percent) when the number of white referees officiating a game increases from zero to three.”

Mr. Wolfers and Mr. Price also report a statistically significant correlation with decreases in points, rebounds and assists, and a rise in turnovers, when players performed before primarily opposite-race officials.

“Player-performance appears to deteriorate at every margin when officiated by a larger fraction of opposite-race referees,” they write. The paper later notes no change in free-throw percentage. “We emphasize this result because this is the one on-court behavior that we expect to be unaffected by referee behavior.”

Mr. Wolfers and Mr. Price claim that these changes are enough to affect game outcomes. Their results suggested that for each additional black starter a team had, relative to its opponent, a team’s chance of winning would decline from a theoretical 50 percent to 49 percent and so on, a concept mirrored by the game evidence: the team with the greater share of playing time by black players during those 13 years won 48.6 percent of games — a difference of about two victories in an 82-game season.

“Basically, it suggests that if you spray-painted one of your starters white, you’d win a few more games,” Mr. Wolfers said.

The N.B.A.’s reciprocal study was conducted by the Segal Company, the actuarial consulting firm which designed the in-house data-collection system the league uses to identify patterns for referee-training purposes, to test for evidence of bias. The league’s study was less formal and detailed than an academic paper, included foul calls for only two and a half seasons (from November 2004 through January 2007), and did not consider differences among players by position, veteran status and the like. But it did have the clear advantage of specifying which of the three referees blew his whistle on each foul.

The N.B.A. study reported no significant differences in how often white and black referees collectively called fouls on white and black players. Mr. Stern said he was therefore convinced “that there’s no demonstration of any bias here — based upon more robust and more data that was available to us because we keep that data.”

Added Joel Litvin, the league’s president for basketball operations, “I think the analysis that we did can stand on its own, so I don’t think our view of some of the things in Wolfers’s paper and some questions we have actually matter as much as the analysis we did.”

Mr. Litvin explained the N.B.A.’s refusal to release its underlying data for independent examination by saying: “Even our teams don’t know the data we collect as to a particular referee’s call tendencies on certain types of calls. There are good reasons for this. It’s proprietary. It’s personnel data at the end of the day.”

The percentage of black officials in the N.B.A. has increased in the past several years, to 38 percent of 60 officials this season from 34 percent of 58 officials two years ago. Mr. Stern and Mr. Litvin said that the rise was coincidental because the league does not consider race in the hiring process.

Mr. Wolfers and Mr. Price are scheduled to present their paper at the annual meetings of the Society of Labor Economists on Friday and the American Law and Economics Association on Sunday. They will then submit it to the National Bureau of Economic Research and for formal peer review before consideration by an economic journal.

Both men cautioned that the racial discrimination they claim to have found should be interpreted in the context of bias found in other parts of American society.

“There’s bias on the basketball court,” Mr. Wolfers said, “but less than when you’re trying to hail a cab at midnight.”

Pat Borzi contributed reporting from Minneapolis and John Eligon from East Rutherford, N.J.

deej, Wednesday, 2 May 2007 15:49 (seventeen years ago) link

This "study" is bullshit. NEXT!

mrcs, Wednesday, 2 May 2007 23:10 (seventeen years ago) link

Okay. I agree with my colleague here. Let's just discount this as bullshit and move on. NAXT!

SRSco, Wednesday, 2 May 2007 23:16 (seventeen years ago) link

how is this bullshit? it sounds like they were pretty thorough in accounting for other factors that might have caused this, and still kept seeing it. and the fact that they can point to a measurable, significant decrease in black players' stats as the officiating crew becomes more white seems kinda damning.

bernard snowy, Thursday, 3 May 2007 12:01 (seventeen years ago) link

It's interesting but I still think you've got a discussion point at best until you know what officials are making what calls.

call all destroyer, Thursday, 3 May 2007 12:40 (seventeen years ago) link

well unfortunately the NBA flatly refuses to release that information, so...

bernard snowy, Thursday, 3 May 2007 14:09 (seventeen years ago) link

john hollinger enjoys numbers too - what he said is this:

Closer look at ref study
by: John Hollinger
posted: Wednesday, May 2, 2007 | Feedback | Print Entry

The basketball world is buzzing today over an academic study on racial discrimination by NBA referees, which states that the racial composition of a three-man officiating crew can have an impact on a game's outcome.
In particular, the study states that the difference between how white referees treat black players and how they treat white players is "large enough that the probability of a team winning is noticeably affected by the racial composition of the refereeing crew."

Predictably, the NBA has launched a PR offensive defending its officials' work and saying its own study, which looked at individual refs who made a call rather than the results of a three-man crew, showed no bias by the officials.

But the bigger point that everyone is missing is that, in fact, the academic study showed remarkably little bias as well. Maybe I'm a cynic here, but I had expected there would be some level of bias by both black and white officials -- refs are human too, after all, and when they step on the court they unwittingly bring their life experiences and values with them.

Yet the effect is almost totally insignificant. The study reports that a black player will rack up approximately 0.16 added fouls per 48 minutes with an all-white officiating crew, as compared to an all-black one.

In other words, if he plays 3,190 minutes in a season -- the league-leading total posted by LeBron James this year -- he would pick up 11 extra fouls. Eleven.

Even that scenario depends on the difference between all-black and all-white crews, which isn't realistic -- in reality most games will be officiated by a mixed crew (32 percent of the league's officials are black), so the effect will be much smaller. Thus, the difference between a black player and white player of similar skills and abilities might be something like six or seven fouls all season, out of the 200 or more that most players accumulate in a season. That's if you lead the league in minutes, mind you -- it would be much less for anyone else.

So when the authors talk about a noticeable impact on results, I guess it depends on what they mean by "noticeable." The authors chose to play up the fact that a bias was found, but to me it's even more of a story that it was found to be so small.

That said, I'm sure the league is unhappy about the study and the implications, and obviously we'd like to see the difference become zero. But let's not lose sight of the microscopic impact we're talking about. Thus, don't expect Gregg Popovich to walk on the court tonight, see three white refs and decide Beno Udrih and Matt Bonner will get the bulk of the minutes.

While we're talking about this study, one other item in it drew my attention: the finding that during the 13-year study period, teams with the greater share of playing time by black players won 48.6 percent of games. The authors seemed to imply some kind of mild institutional racism against black players by this result.

In fact, there's a much more obvious explanation -- the league imported a bunch of talent from Europe during the study period, almost all of it white, and the poorly run teams were the last ones to figure out there were good players on other continents. Thus, by default they ended up with more black players on their rosters.

Look back on the drafts of the mid-to-late '90s and you'll see what I mean. Players like Peja Stojakovic, Zydrunas Ilgauskas, Manu Ginobili, Dirk Nowitzki and Andrei Kirilenko were all basically stolen in the draft by smart, forward-thinking teams. That their teams won more games than average is an effect of their superior front offices, not the officiating.

Finally, let's get to the really juicy stuff -- I was a little disappointed the study didn't look at technical fouls and ejections. If there were a pattern of bias, wouldn't we expect it to come out most often when emotions already were running high? Based on some recent high-profile events involving white referees and black players (Crawford vs. Duncan, Salvatore vs. Davis, etc.) I can't be the only one who wishes this had been part of the study.

jhøshea, Thursday, 3 May 2007 14:22 (seventeen years ago) link

"Say it ain't so, Joe!"

Mark G, Thursday, 3 May 2007 14:24 (seventeen years ago) link

"specific part of society not exempt from society, film at 11"

Tracer Hand, Thursday, 3 May 2007 15:05 (seventeen years ago) link

"well if it actually IS black players who foul more it's not racist to point that out!!"

Tracer Hand, Thursday, 3 May 2007 15:06 (seventeen years ago) link

wait crackers not playing any d could be a clue!

jhøshea, Thursday, 3 May 2007 15:07 (seventeen years ago) link

This is why bowling is the only true sport.

M.V., Thursday, 3 May 2007 15:44 (seventeen years ago) link

This just in: automatic foot-over-the-line detectors found to be racist, automatic ball returner attempts to crush minority

Will M., Thursday, 3 May 2007 15:49 (seventeen years ago) link

1) Look at the make up of the NBA, dog.
2) Look at what players have a tendency to misbhave.
3) NEXT!

mrcs, Thursday, 3 May 2007 17:06 (seventeen years ago) link

But they're saying that white officials call more black players' fouls and than black referees do. I think. What confuses me is the control group here... especially because they say that black officials are less racist to white players than white officials are to black players...

“Across all of these specifications,” they write, “we find that black players receive around 0.12-0.20 more fouls per 48 minutes played (an increase of 2 ½-4 ½ percent) when the number of white referees officiating a game increases from zero to three.” 


How can they be sure that this isn't reverse racism from the referees whose race isn't mentioned? What I think I am trying to say is that, from that article, at least, it shows a trend, but doesn't explain the trend. Players COULD be playing rougher when there are white refs. The black refs could be more lax on what constitutes a foul. It jsut seems like there's a weird jump from inference to conclusion there.

Will M., Thursday, 3 May 2007 17:20 (seventeen years ago) link

Will, I think the only circumstance that would undermine their conclusion would be if black players and referees both had a more conservative idea of what constituted a foul, like you say. (Possible, but the idea of two separate race-based basketball foul-cultures sounds somewhat less likely than it just being the same perceptions of aggression and control that are everywhere else in society.)

nabisco, Thursday, 3 May 2007 17:29 (seventeen years ago) link

I think the numbers speak for themselves, and what they say to me is that the amount of bias might be detectable, but it is quite small and might be accounted for by factors that could not be studied, such as the number of fouls that were not called. That one jumps to mind, but there would be many others.

I have a mild suspicion that the people who conducted this study have a greater interest in interpreting their numbers as being conclusive than in saying that their study was inconclusive. Who wants to vest that much time into a study and do that much work in order to achieve nothing of value?

Aimless, Thursday, 3 May 2007 17:32 (seventeen years ago) link

OTM Aimless. I meant to try and point out that they weren't looknig at fouls that /weren't/ called, but I am miserable at actually getting my points across.

Will M., Thursday, 3 May 2007 18:00 (seventeen years ago) link

How would uncalled fouls affect their methodology at all?

nabisco, Thursday, 3 May 2007 18:16 (seventeen years ago) link

they are saying black players are getting called for more fouls
if this was due to bias, white players MUST be committing just as many fouls or the study is BS.

so: how do they determine what a "foul" is if no one called it?
do they account for the fact that perhaps more black players tend to play the front court positions that are more likely to be in fouling situations? (not sure if this is true)
there are so many MORE black players that the sample size is not equal on both sides.
and what about the phantom foul dirk committed on d wade in the finals last year!

ryan, Thursday, 3 May 2007 18:27 (seventeen years ago) link

i mean, take stockton and malone, both dirty as hell, but i promise you malone got called for a ton more fouls strictly by nature of his position as a forward.

ryan, Thursday, 3 May 2007 18:30 (seventeen years ago) link

Although presumably the NBA does training along these lines, the one last bit of control the study would need to do, would be showing the entire NBA refereeing crew a series of events and then having them indicate whether or not something was a foul. The point being to determine, as suggested above, whether there are any racial differences among refs on what consitutes a foul. (Although as I type this I realize it would be difficult if not impossible to remove racial bias there, because they'd still be seeing players of whatever race.)

mitya, Thursday, 3 May 2007 18:32 (seventeen years ago) link

i'm sure they took those issues into account dude. did you read the methodology?

deej, Thursday, 3 May 2007 18:32 (seventeen years ago) link

xp

deej, Thursday, 3 May 2007 18:32 (seventeen years ago) link

1) i think we;ve determined this study is bs
2) yeah rite
3) time to move on. NEXT!

4) david stern is a pussy

mrcs, Thursday, 3 May 2007 18:34 (seventeen years ago) link

btw, shouldn't the headline here be "Study of N.B.A. Sees Racial Bias in Foul-Calling" or is there no difference between the two?

gabbneb, Thursday, 3 May 2007 18:35 (seventeen years ago) link

oh ok deej.

but honestly the sample size seems like a big problem. how do you compare white and black when they are so disproportionate?

ryan, Thursday, 3 May 2007 18:41 (seventeen years ago) link

Okay, let's cover a few things.

1) Did this come from Cornell University or Cornell West?
2) Zzzzzzzzzzzzzzing.
3) I mean, come on.
4) Ya rite.
4) Why doesn't Stern grow some balls and just balk at this bullshit and yell "NEXT!"
5) NEXT!

SRSco, Thursday, 3 May 2007 18:42 (seventeen years ago) link

or "racial bias in officiating," even?

zzzz to roger spock or whatever

gabbneb, Thursday, 3 May 2007 18:43 (seventeen years ago) link

they are saying black players are getting called for more fouls
if this was due to bias, white players MUST be committing just as many fouls or the study is BS.


No, no, a thousand times no, you're COMPLETELY misunderstanding the methodology, the conclusions, and the basic logic.

Their primary conclusion is that across the NBA as a whole -- and accounting for factors like position played and All-Star status -- black players will get called for fouls more when there are white referees. (And, on much smaller level, white players will get called for fouls more when there are black referees -- which, by the way, runs against the conclusion what black players/refs just have different foul standards.) Whether white players commit as many fouls has absolutely nothing to do with this conclusion! There could be no white players involved in a game at all, and -- according to these results -- white referees would still call fouls at a higher rate than their black colleagues would.

I mean, your logic in that quote is just warped up and weird, it doesn't follow AT ALL -- that would only be a reasonable response if this study said "black players get more foul calls, so that MUST be bias." It doesn't say that: it says foul calls for the same league players vary significantly depending on the race of the OFFICIAL versus the race of the player.

nabisco, Thursday, 3 May 2007 18:46 (seventeen years ago) link

Okay I just re-read this. This is the kind of shit that gets you tenure @ Wharton and an ECONOMICS degree @ Cornell now days? This looks more like some sociology bullshit out of Berkeley. NEXT!

SRSco, Thursday, 3 May 2007 18:47 (seventeen years ago) link

cut it out

deej, Thursday, 3 May 2007 18:50 (seventeen years ago) link

Maybe white refs are just more vigilant?

mrcs, Thursday, 3 May 2007 18:52 (seventeen years ago) link

no i understand that nabisco, i scanned the study too fast.

however--i think if the study doesnt have some objective way to measure OBJECTIVELY how many fouls a black or white player ACTUALLY commits and THEN is able to measure this against how many fouls were actually called, then the literally infinite circumstances that surround every game, player, and ref would drown out any CONCLUSIVE point about race and foul calling. (not that we cant still make some leaps...)

ryan, Thursday, 3 May 2007 18:56 (seventeen years ago) link

I mean, from the get-go there: they are NOT just saying "black players are getting called for more fouls!" They are saying "black players are more likely to get called for fouls when officials are white" (and vice versa), and that this correlation holds for EACH STEP in the racial makeup of a three-person officiating team!

xpost hahaha all the "NEXTing" would be more believable if the people doing it displayed even a rudimentary understanding of the statistical analysis going on here

(P.S. lots of Ian Ayres's previous work -- like Pervasive Prejudice really is about ECONOMIC instances of bias; the main thing I remember is a study of car loan terms that showed significant racial bias unrelated to actual credit qualifications)

(P.P.S. I really don't understand why it's in anyone's interest to NEXT this kind of thing away, when it's been more or less infinitely demonstrated in the US that people are just those few percentage points more inclined to subconsciously/consciously think a little worse of black people -- this is just plain true, and thankfully not as huge of a bias as it once was, but I can't imagine why anyone would want to shush it away rather than just saying "yes that's UNIVERSALLY RECOGNIZED but we're making progress, hopefully, and with luck it'll lessen with time.")

xpost -- mrcs PLEASE actually think about the content of the study instead of just casting around here: if there's a corresponding finding that black refs might be more likely to call fouls on white players, wouldn't that suggest that it's not just a matter of white refs being more vigilant?

nabisco, Thursday, 3 May 2007 18:56 (seventeen years ago) link

otm nabisco, i was starting to wonder if people had actually rtfa'd.

Will M., Thursday, 3 May 2007 19:00 (seventeen years ago) link

xpost Grr okay Ryan I'm arguing less here for this study and more for the entire enterprise of statistical analysis. You're right, there is no way to have divine objective knowledge of what is or is not a foul. But that is why the NBA hired officials to make those judgments. A study like this is not attempting to hold that officiating up against a divine "correct" officiating. It is attempting to track the decisions made by those officials and figure out if they're consistent, or if there are non-foul-related factors that are influencing them. Their statistical analysis would seem to suggest that something non-foul-related -- the race of the player vs. the race of the official -- makes a significant difference in foul-calling! This is the way analyses of statistical bias work.

nabisco, Thursday, 3 May 2007 19:01 (seventeen years ago) link

i guess im calling into question the validity of statistic analysis period in drawing conclusions.....the problem with this stuff is that it largely finds what it seeks out to find.

why not conclude: Black players commit more fouls when white refs are watching!! why NOT? why not but the weight of the analysis on the player? i dont see any logical reason why not to. school me (honestly). i am dumb about this stuff.

ryan, Thursday, 3 May 2007 19:02 (seventeen years ago) link

Mr. Jobs implores you to move on.

NEXT!

http://wiredblogs.typepad.com/photos/uncategorized/xmlatomlifeblog29830jpeg_705.jpg

SRSco, Thursday, 3 May 2007 19:02 (seventeen years ago) link

x-post! i agree it does SUGGEST there is bias at work. i take back my earlier statements.

ryan, Thursday, 3 May 2007 19:03 (seventeen years ago) link

1) OK, asshole, the fact that I don't agree with the validity of the study or your opinion of it does not mean I do not understand the content of the study.
2) You don't know me or what the hell I think about black people, or white people for that matter.
3) I was just saying this study is silly. HOW IS THIS STUDY RELATED TO ECONOMICS OR BUSINESS??? I don't care about the rest of Ian's work, I'm asking about this study.
4) NEXT

mrcs, Thursday, 3 May 2007 19:03 (seventeen years ago) link

i "like" how this dude always talks to himself when he's bored

gabbneb, Thursday, 3 May 2007 19:05 (seventeen years ago) link

"always?"

mrcs, Thursday, 3 May 2007 19:06 (seventeen years ago) link

part of the problem (and im a good example if this upthread) is that people arent exactly educated enough about how these studies work to be able to have an informed opinion about them.

Barkley on the radio yesterday: "I bet black refs call more fouls on black players too!"

ryan, Thursday, 3 May 2007 19:07 (seventeen years ago) link

typo upthread. i meant to say: why do they assume the players as a constant? can the study be read to tell us something about PLAYERS instead?

ryan, Thursday, 3 May 2007 19:10 (seventeen years ago) link

Haha I actually started to reply to those four points before realizing they're the kind of thing that's too mixed-up to even bother trying to pull apart and explain.

Ryan, the problem is that people assume the analysis means something other than just what it says -- the bare facts/trends it uncovers -- and then start trying to deal with that stuff based on their own personal experience / perceptions, rather than, you know, looking for factors the analysis hasn't properly taken into account. What's funny about this is that people like MRCS jump on exactly the obvious factors that the whole study was constructed to take into account -- or the Barkley would say "I bet black refs call more fouls on black players too," when in fact the SOLE THING this analysis would seem to show is that that's not the case.

xpost from what I can tell, "players" as a group are taken as a constant because the analysis is taking the entire league over a VERY large number of games. (There may be other methodological things they're doing on this front, too -- this surely isn't my field, I wouldn't know.) Even assuming they haven't dealt with that, I think it'd be a BIG stretch to imagine that a league's worth of players have a complex tendency to commit more fouls precisely in the sightlines of officials of the opposite race, perfectly matching every possible racial composition of the three-person officiating group -- as opposed to refs just calling fouls based on the same minor bias that pervades every other piece of official decision-making in this country, like, ever.

nabisco, Thursday, 3 May 2007 19:18 (seventeen years ago) link

Why is no one decrying the lack of any peer-review of this study?

dan m, Thursday, 3 May 2007 19:20 (seventeen years ago) link

1) OK, I see what's happening here
2) I got your goat pretty good, dog
3) Let's just agree to disagree
4) Why be all smug?

mrcs, Thursday, 3 May 2007 19:21 (seventeen years ago) link

Oh, and why was I talking about Ayres and economics? He's at Yale Law. I'm still not sure what MRCS's issue is with the fact that economists tend to do lots of statistical analyses of giant data sets about decision-making and behavior, but he'd appear to not know much about anything at all, so whatever.

nabisco, Thursday, 3 May 2007 19:22 (seventeen years ago) link

Smug is my thing.

nabisco, Thursday, 3 May 2007 19:22 (seventeen years ago) link

i am a dedicated NBA watcher, im white, and to be honest I have noticed that certain PLAYERS tend to get called for a lot of fouls. (and as a Houstonian i have to complain that Yao Ming gets too many fouls called on him and can NEVER get a call his way when he is fouled--bias right? the rockets have even complained to the league about it. same goes for a lot of big players, they dont get calls because they're BIG)

the who, what, and why of when a foul is called or not is REALLY complex, and often, in the NBA, seemingly random. depends on the tone of the game, for instance, are they "letting them play"? there is SO much involved that is not determinable by any statistic. maybe in some way this makes it an IDEAL yardstick for measuring bias since it is SO subjective.

i still feel there is not ENOUGH white players in the NBA to get too worked up about this study.

ryan, Thursday, 3 May 2007 19:32 (seventeen years ago) link

nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts
nabisco seems to weild a lot of power around this parts

ghost rider, Thursday, 3 May 2007 19:34 (seventeen years ago) link

Define "thinks along the same lines."

xpost Ryan: it doesn't matter if certain players get called a lot more. If this were merely the case, they would get called more EQUALLY by black refs and white refs! It would not change what they're trying to say.

xpost ghost i'll "weild" you

Will M., Thursday, 3 May 2007 19:35 (seventeen years ago) link

depends on the tone of the game, for instance, are they "letting them play"?

yeah that's another good point...refs seem to get in certain grooves or, moods I guess, shit can be really varied in terms of how shit is getting called...sometimes they just grind the fucking game's pace into the ground, other times it's way looser

M@tt He1ges0n, Thursday, 3 May 2007 19:35 (seventeen years ago) link

Wow, sonned by an ilx posse in an internet beefs! A typo OH NOES!
Being called out for not making sense on a message board. WHAOH!

Kick up your feet and relax, gentlemen. You've done well.

mrcs, Thursday, 3 May 2007 19:37 (seventeen years ago) link

xposts

The power of reading, I guess. The takedown they are waiting for, MRCS, is that I'm not white, though you're welcome to claim I suffer from East-African Guilt or something.

Will, the "calling more" versus "calling less" thing is actually irrelevant to the findings themselves -- the trend would just be that race makes a difference in officiating and game outcome. The stretch comes when someone has to encapsulate those findings in a sentence, and says "white refs call more fouls on black players." I mean, notice the quotes from the researchers actually used here. They say the foul difference

is large enough that the probability of a team winning is noticeably affected by the racial composition of the refereeing crew assigned to the game.


And then Ayres speaks GENERALLY and very inconclusively about the implications:

“I would be more surprised if it didn’t exist,” Mr. Ayres said of an implicit association bias in the N.B.A. “There’s a growing consensus that a large proportion of racialized decisions is not driven by any conscious race discrimination, but that it is often just driven by unconscious, or subconscious, attitudes. When you force people to make snap decisions, they often can’t keep themselves from subconsciously treating blacks different than whites, men different from women.”


That's not data findings, that's Ayres saying he would be MORE SURPRISED to find that the result wasn't the same kind of mild bias that turns up in every other examination of this stuff. As for the findings themselves, the only real claim is that in a league with lots of black players and lots of white officials, there is a racial element to foul-calling that affects game outcome.

xpost -- Just again explaining methodology more than arguing for the study, but: "They accounted for factors like the players’ positions, playing time and All-Star status; each group’s time on the court (black players played 83 percent of minutes, while 68 percent of officials were white); calls at home games and on the road; and other relevant data." -- I'm assuming the "All-Star status" in there is meant to account for one aspect of "reputation."

nabisco, Thursday, 3 May 2007 19:42 (seventeen years ago) link

So have I been taken down yet?

mrcs, Thursday, 3 May 2007 19:45 (seventeen years ago) link

I mean, honestly, I want to be clear that I'm no statistician and couldn't care less about basketball -- I just started experiencing some annoyance on this thread over people trying to write off the research without even beginning to halfway read the article or think carefully about the analysis or the potential conclusions.

nabisco, Thursday, 3 May 2007 19:46 (seventeen years ago) link

mrcs, do you like lindsay lohan

ghost rider, Thursday, 3 May 2007 19:47 (seventeen years ago) link

would be nice to see individual ref profiles. their race, when did they start, etc....

if you brought in a ref from 20 years ago (when the game was more "white") both teams would foul out in 5 minutes and traveling would get called on every possession, etc.

x-post: yeah Will. but i guess i want to know if it is the case that certain players get called more and whether that can be traced back to racial bias or not.

ryan, Thursday, 3 May 2007 19:48 (seventeen years ago) link

zing, ghost rider

mrcs, Thursday, 3 May 2007 19:49 (seventeen years ago) link

lol "weild"

lol "adequite"

i get what he's saying here. lol how topical and current.

NEXT!

SRSco, Thursday, 3 May 2007 19:51 (seventeen years ago) link

Who sonned who? I am so lost.

This is basically the conversation as I've seen it:

"Observation on article"
"Uhh that's not what the article says did you read the whole thing?"
"FUCK YOU ELITIST"

Will M., Thursday, 3 May 2007 19:54 (seventeen years ago) link

this thread is reaching "b-but evolution is just a theory!"-like levels of willful ignorance

bernard snowy, Thursday, 3 May 2007 20:00 (seventeen years ago) link

But bernard... ants can't grow in peanut butter!

Will M., Thursday, 3 May 2007 20:01 (seventeen years ago) link

man, Chuck Missler is gonna be steamed when he finds out that Pasteur existed

bernard snowy, Thursday, 3 May 2007 20:07 (seventeen years ago) link

Actually, I should admit to having another interest here. The study's finding -- roughly 4% bias -- is not the kind of flagrant bias you'd actually notice while watching a game: this is the kind of minor pattern in calls that only comes into view when you crunch the numbers for hundreds and hundreds of games.

And so while it's totally great and smart to be skeptical of any analysis, and question its methods and its logic, I'm a little miffed by the desire to just knee-jerk write this off. I mean, it's not the kind of thing you dispute just based on watching games on TV -- you'd have to be a fucking robot to be checking the race of the officials and noticing 4% differences in their calls! And given that it's more or less common knowledge that mild 4%-type biases exists in basically everything -- I mean, we've ALL seen 80 million studies and hidden-camera demonstrations on how people with the same resumes / credit scores / etc. get treated differently -- I can't figure out why there'd be this shrieky desire to pick apart or write off a study finding mild evidence of it somewhere else.

nabisco, Thursday, 3 May 2007 20:10 (seventeen years ago) link

Another thought occurs to me. Say, for argument's sake, that the league wished to implement a remedy for this bias.

If the NBA's remedy was to hire refs in proportion to the racial identity of the players in the league, then wouldn't that institutionalize the bias of black refs against white players, and introduce a permanent second-class status for white players? It seems fairly clear to me that it would.

What sort of remedy could be "fair" when a small amount of bias seems to be universal among refs? After all, you need to have refs, but this study proves all refs are slightly biased, so how do you have refs and still avoid a universal trait among refs?

Aimless, Thursday, 3 May 2007 20:33 (seventeen years ago) link

bernard snowy, will m, ghost rider, well done. it takes a lot to sling zingers at someone for making 4 outlandish bullet points on this study. one being "ya rite" and another being "NEXT!"

nabisco, look, i am inclined to write off this study. i think it's fairly meaningless. that's my right. i don't think there is racial bias involved in basketball officiating. if there is, it's probably statistically negligible, and i don't think you can realistically draw a parallel between questionable refereeing and questionable hiring, loaning, etc.

mrcs, Thursday, 3 May 2007 20:35 (seventeen years ago) link

someone making 4 outlandish bullet points is a perfect reason to zing them

dan m, Thursday, 3 May 2007 20:39 (seventeen years ago) link

nabisco, look, i am inclined to write off [things i don't agree with]. i think it's fairly meaningless [because i disagree]. that's my right. i don't think there is racial bias involved in basketball officiating [because what i want to believe contradicts an actual study]. if there is, it's probably statistically negligible, [so i will dismiss this study because its fact-based research contradicts my opinion-based research] and i don't think you can realistically draw a parallel between questionable refereeing and questionable hiring, loaning, etc. [because we all know racism only matters in those arenas]

deej, Thursday, 3 May 2007 20:42 (seventeen years ago) link

4% is mighty small. given a certain margin of error (which i imagine must be huge given the sample problems) it probably falls close to statistically meaningless.

ryan, Thursday, 3 May 2007 20:45 (seventeen years ago) link

i agree that its 'small' but you're rong about everything else

deej, Thursday, 3 May 2007 20:46 (seventeen years ago) link

so rong.

mrcs, Thursday, 3 May 2007 20:46 (seventeen years ago) link

you're leaving? thank god

deej, Thursday, 3 May 2007 20:47 (seventeen years ago) link

why deej? just curious. does 4% strike you as real evident bias, even factoring in a margin of error?

ryan, Thursday, 3 May 2007 20:48 (seventeen years ago) link

Wait! Wait! I figured out a remedy that would really, truly neutralize the effects of universal racial bias among referees. It's so simple and obvious I'm dumbstruck it didn't just jump up and bite me on the ass.

All you need to do is segregate the league into two leagues, with a white league and a black league, and segregate the referees, too. It wouldn't matter if the black league's refs were all white or all black, so long as both players and refs were of a uniform racial identity. There would, of course, be some messy loose ends, like Yao Ming, but this seems the most workable solution to this problem.

Uh, right, fellas?

Aimless, Thursday, 3 May 2007 20:52 (seventeen years ago) link

why deej? just curious. does 4% strike you as real evident bias, even factoring in a margin of error?

-- ryan, Thursday, May 3, 2007 3:48 PM (3 minutes ago)

The extrapolate how it has an effect on the games themselves! It makes an impact.

I don't know how you're getting this margin of error, or if you're just assuming it based on other margins of error you've heard in the past

deej, Thursday, 3 May 2007 20:53 (seventeen years ago) link

Interesting point though, how many games were decided by a SCORING difference of 4% or less? ie. 111-107 for one team or the other. Maybe 4% means more thna we're giving it credit for, especially in a game where the scores are so... I want to say granular. Is that the right word? I mean, 4% would almost never make a difference in soccer because of all the 1-0 scores and such, but when points get into the hundreds, and often games are won by a couple of points, IMPORTANT games too. There was some game recently. I forget. I only noticed the score peripherally.

Will M., Thursday, 3 May 2007 20:56 (seventeen years ago) link

i am! i assume there IS one tho, there has to be.

on an individual game id say a 4% bias in officiating would be close to zero.

32 fouls in the LA-PHX game last night (and TWO players fouled out, one white!)...so 4% of 32?

ryan, Thursday, 3 May 2007 20:59 (seventeen years ago) link

The idea that this 4% difference would favor one team by 4% is wrong, since the bias is along racial lines and not along team affiliation. If one team had five whites on the floor, and the other has five blacks, and the officiaiting crew were all white, then this would consitute the the case where a team would incur the full 4% penalty for the bias of the refs. Never happens that way.

Aimless, Thursday, 3 May 2007 21:01 (seventeen years ago) link

oh i guess i should only count the fouls on the black players, huh. minus 6 at least, thanks to Luke Walton fouling out.

plus you gotta think that on average most teams have the same number of black players so in terms of advantage in the actual games it's a wash...

x-post! right Aimless! i just realized that.

ryan, Thursday, 3 May 2007 21:03 (seventeen years ago) link

i'm not saying a huge proportion of game results are in the balance or anything, just that it seems awfully hasty to dismiss a study so quickly when its clear that racial bias has a not-negligible impact

deej, Thursday, 3 May 2007 21:05 (seventeen years ago) link

i thought it was a poorly thought out study at first, i admitted i was wrong. im not sure about what conclusions to draw from it. and im still uncertain what value it has other than generating a media hubbub.

ryan, Thursday, 3 May 2007 21:07 (seventeen years ago) link

I don't give it anything beyond a neat application of data to unanswered (unasked, too) questions for the sheer wonk-ness of it. I like it when people say, "HAY GUYS LOOK AT MY NUMBERS LET ME SHOW YOU THEM" and the numbers actually... kind of show something.

Will M., Thursday, 3 May 2007 21:18 (seventeen years ago) link

I don't even care if I can't tell what it's showing.

Will M., Thursday, 3 May 2007 21:18 (seventeen years ago) link

Sorry, more pointless management stuff:

a) The article up top quotes a finding that this stuff has an impact on game results -- not really surprising, given that basketball fouls are penalized by giving free throws. (Also be careful of thinking of this stuff on a game-by-game or foul-by-foul basis: the effects here are over the run of a season.)

b) In the social sciences, the term "statistically insignificant" has a very specific mathematical definition, based on your methods and you findings. You do not get to publish if your results are "statistically meaningless," because you will not HAVE any notable results. I know you mean those words in an everyday non-statistical way, but I'm just saying: statistical significance and margins of error are what these studies spend their whole lifespans taking into account. And even in the lay sense, yes, 4% is surely significant!

c) I know that obviously you guys are just thinking through the implications of these findings, and what could theoretically be done about them, which is cool, but you know: there's no reason to read this study as a complaint asking for any kind of "remedy," right? Or anyway it's just flat information at this point, and I doubt anyone involved with the NBA will really call for anyone to make major policy changes over it.

nabisco, Thursday, 3 May 2007 21:22 (seventeen years ago) link

nabisco OTM.

Lostandfound, Friday, 4 May 2007 06:34 (seventeen years ago) link

the ideal troll is humorous not only to himself but to those in on the joke

the unideal troll is just a cock who should be permabanned

which one is mrcs

deeznuts, Friday, 4 May 2007 06:43 (seventeen years ago) link

4% is mighty small. given a certain margin of error (which i imagine must be huge given the sample problems) it probably falls close to statistically meaningless.


Yeah fuckit the score might really be 100 - 104 but I screwed up and wrote it down as 103 - 101, who really cares right? Probably statistically meaningless

badg, Friday, 4 May 2007 07:03 (seventeen years ago) link

would black refs be more inclined to see this as racist?
http://static.zooomr.com/images/2d1f0fe2fbed0f29dadc77cbba68e00527f952f5.jpg

gershy, Friday, 4 May 2007 07:17 (seventeen years ago) link

i would weild all this parts

Tracer Hand, Friday, 4 May 2007 11:17 (seventeen years ago) link

the barkley quote is funny

Tracer Hand, Friday, 4 May 2007 11:18 (seventeen years ago) link

“Basically, it suggests that if you spray-painted one of your starters white, you’d win a few more games,” Mr. Wolfers said.

Note he recommends white-facing rather than signing white players.

onimo, Friday, 4 May 2007 12:05 (seventeen years ago) link

badg, points are not analogous to fouls. plus the 4% of fouls called on black players are presumably called equal for black players on both teams. it has about zero effect, over the long haul, over who wins or loses games.

ryan, Friday, 4 May 2007 16:00 (seventeen years ago) link

what would also be interesting: who is committing fouls on who?

are black players more likely to get called for fouling a white player?

ryan, Friday, 4 May 2007 16:12 (seventeen years ago) link

You get fouls called in your favour, you go to the free throw line, you score points. To suggest there's no relationship between points and fouls called is wrong. My point above was that a 4% difference in fouls called, depending on the makeup of the team & umpires, could easily amount to a few points difference. Which would affect the outcome of a lot of games.

badg, Saturday, 5 May 2007 09:45 (seventeen years ago) link

yeesh fools. black refs have blind eye for the bros.

toxaemia, Saturday, 5 May 2007 11:19 (seventeen years ago) link

http://images.speurders.nl/images/72/7292/729209_1_detail.jpg

toxaemia, Saturday, 5 May 2007 11:23 (seventeen years ago) link


You must be logged in to post. Please either login here, or if you are not registered, you may register here.