Elliot Temple | Permalink | Messages (0)

Bad Study Claims Lawyers are Racist

Written in Black & White

Exploring Confirmation Bias in Racialized Perceptions of Writing Skills
This is a paper about bias which claims lawyers are racist. But they don't know what bias is:
CONFIRMATION BIAS: A mental shortcut – a bias – engaged by the brain that makes one actively seek information, interpretation and memory to only observe and absorb that which affirms established beliefs while missing data that contradicts established beliefs.
Some mental shortcuts, like some shortcuts while driving, are good ideas. They can be time savers. This is a stupid definition of what a "bias" is.

Some mental shortcuts work, and are valuable. Others don't. It's important to try to figure out which are which. And an unbiased person can make a mistake evaluating whether a particular mental shortcut works well.

Shortcuts don't make one do anything. They are options but can't control you.

The idea of a bias making someone do something makes more sense than a shortcut controlling a person, but is still mistaken. One way to see it's mistaken is to consider that sometimes a person recognizes he's biased and doesn't obey the bias.

The dictionary doesn't know what a bias is either:
a tendency to believe that some people, ideas, etc., are better than others that usually results in treating some people unfairly
Is the belief rational? This definition doesn't care.

I believe Objectivism is better than most rivals one might compare it with. But some anti-Objectivists believe I treat them unfairly in discussion by not conceding that Ayn Rand is a monster.

Recognizing something is superior isn't automatically bias. Some things are superior. Bias has to do with irrationality: e.g. believing something is superior for bad reasons you are unwilling to reconsider.
The partners were originally given 4 weeks to complete the editing and rating, but we had to extend deadline to 7 weeks in order to obtain more responses.
The study changed the rules midway in order to reach different conclusions than it would have if it followed the original plan.
we deliberately inserted 22 different errors
Maybe the response rate was worse than expected because people weren't thrilled about editing an essay containing 22 deliberate errors. I wonder how realistic the errors were, and why they didn't use a real research memo. Using an artificial memo adds an extra source of error: it could be poorly designed.
Name: Thomas Meyer

Seniority: 3rd Year Associate
Alma Mater: NYU Law School
Race/Ethnicity: African American
Half the participants saw the same headings except with "Caucasian" instead of "African American". I see a danger here that people would find it strange to be told the Race/Ethnicity of the author of what they are reading, and therefore act differently than in regular life.

One possibility is some people saw this was a transparent attempt at a racism study and gave a reply to manipulate the results according to their political preference. Others might decide not to participate when they see this. It's important the participants don't know it's a racism study, but this is a big clue.

An even bigger issue here is there was no control group which received memos with no Race/Ethnicity heading. Wouldn't a control group be a good idea?
There was no significant correlation between a partner’s race/ethnicity and the differentiated patterns of errors found between the two memos. There was also no significant correlation between a partner’s gender and the differentiated patterns of errors found between the two memos.
What about the partner's political party? His age? Or a million other things.

Why are race/ethnicity and gender the two things they looked at? It's plausible that one major US political party is more racist than the other one. And it's plausible that old people are more racist than young people.
In order to create a study where we could control for enough variables to truly see the impact of confirmation bias, we did not study the potential variances that can be caused due to the intersection of race/ethnicity, gender, generational differences and other such salient identities.
How does ignoring the age of participants make the study better controlled?
The exact same memo, averaged a 3.2/5.0 rating under our hypothetical “African American” Thomas Meyer and a 4.1/5.0 rating under hypothetical “Caucasian” Thomas Meyer.
This is their main point: they claim lawyers are racist.
We undertook this study with the hypothesis that unconscious confirmation bias in a supervising lawyer’s assessment of legal writing would result in a more negative rating if that writing was submitted by an African American lawyer in comparison to the same submission by a Caucasian lawyer.
What about conscious bias? They explicitly said the race. A participant could consciously notice.
When expecting to find fewer errors, we find fewer errors. When expecting to find more errors, we find more errors. That is unconscious confirmation bias. Our evaluators unconsciously found more of the errors in the “African American” Thomas Meyer’s memo, but the final rating process was a conscious and unbiased analysis based on the number of errors found.
This is a story which isn't contradicted by their study. Many other stories also aren't contradicted by the study. Why are they concluding this particular story? For example, the evaluators could have had conscious bias. Saying it's unconscious bias is just making up a story about what happened.

Other things could be going on. Maybe the writing style of the memo was culturally white. Then the people told it had it had a white author would just read it and nothing special happens. But the people told it had a black author might notice the clash between the white style and the black author claim. This could get them to wake up and pay more attention because there was something unexpected or surprising or interesting about the memo. They could then have found more errors simply because they were more awake while reading.
When partners say that they are evaluating assignments without bias
Wait, were they asked if they were racist? Wouldn't that give away what kind of study it was? Or was that only done afterwards? Why wasn't the procedure explained?

In any case, wouldn't you expect a lot of conscious racists to lie? So people claiming they aren't racist doesn't differentiate between conscious and unconscious racists very well.

Conclusion

The paper is too light on details, and has too many errors, to make a big deal out of. If racism is a big problem, it shouldn't be that hard to do a high quality study to show it. I would expect that already to have been done, given the intense interest in this topic.

So, people claiming racism is a big problem: where is that high quality study? Link me to it or tell me why it hasn't been done yet.

Addendum

At the end of the paper there is some extra stuff like brags about how the people doing the study are biased. They get paid to teach people to be less racist. Their study is marketing for their services. Is that sad or is it amusing? I don't know. I want to point out one more error:
EXAMPLE: In one law firm where we found that minority summer associates were consistently being evaluated more negatively than their majority counterparts, we created an interruption mechanism to infuse the subjective with objective. We worked with the firm to create an Assignment Committee, comprised of 3 partners through whom certain assignments were distributed to the summer associates and through whom the summer associates submitted work back to the partners who needed the work done. When the work was evaluated, the partners evaluating the work did not know which associate had completed the work. The assignments for this process were chosen judiciously, and there was a lot of work done to ensure buy-in from all partners. At the end of the summer, every associate had at least 2 assignments that had been graded blindly. The firm then examined how the blind evaluations compared with the rest of the associate’s evaluations and found that the blind evaluations were generally more positive for minorities and women and less positive for majority men.
It could be that people give better evaluations to their friends. And it could be that of the new employees, white men have the best social skills, due to different upbringings. So they make friends with the people doing the evaluating the best, and then get the best evaluations when it's not blind. But when there's blind evaluations, the social skills are irrelevant.

This is merely a story I made up. The point is it's possible. What happened in the example could involve racism by lawyers, or not. That the study authors only think about how their material is compatible with racism happening, but don't consider and discuss the non-racist explanations that account for it, shows their own selective attention, which they would call "bias".

[I wrote this post in one hour.]

Elliot Temple | Permalink | Messages (6)

The Parable of the Vases

Ann Coulter tweeted a bunch of praise for A Review of Hive Mind: How Your Nation’s IQ Matters So Much More Than Your Own today. She told people to buy the book. And she indicated her agreement with the "parable of the vases" .

I disagree with the parable. Here it is:
The parable begins with a simplifying assumption. This is that it takes exactly two workers to make a vase: one to blow it from molten glass and another to pack it for delivery. Now suppose that two workers, A1 and A2, are highly skilled—if they are assigned to either task they are guaranteed not to break the vase. Suppose two other workers, B1 and B2, are less skilled—specifically, for either task each has a 50% probability of breaking the vase.

Now suppose you are worker A1. If you team up with A2, you produce a vase every attempt. However, if you team up with B1 or B2, then only 50% of your attempts will produce a vase. Thus, your productivity is higher when you team up with A2 than with one of the B workers. Something similar happens with the B workers. They are more productive when they are paired with an A worker than with a fellow B worker.

So far, everything I’ve said is probably pretty intuitive. But here’s what’s not so intuitive. Suppose you’re the manager of the vase company and you want to produce as many vases as possible. Are you better off by (i) pairing A1 with A2 and B1 with B2, or (ii) pairing A1 with one of the B workers and A2 with the other B worker?

If you do the math, it’s clear that the first strategy works best. Here, the team with two A workers produces a vase with 100% probability, and the team with the two B workers produces a vase with 25% probability. Thus, in expectation, the company produces 1.25 vases per time period. With the second strategy, both teams produce a vase with 50% probability. Thus, in expectation, the company produces only one vase per time period.

The example illustrates how workers’ productivity is often interdependent—specifically, how your own productivity increases when your co-workers are skilled.
This is a dirty math trick (using the prestige and authority of math to trick people about a non-math issue) and the author doesn't explain what's going on. The different results are due to different amounts of idle vase-packing labor. In one scenario, A2 sits around doing nothing half the time (a loss of .5). In the other, B2 sits around doing nothing half the time (a loss of .25). A2 sitting idle is a bigger loss. That's all it is. Both potential pairings have a total of 1.5 value. They come out to 1 or 1.25 simply based on whether .25 or .5 value is sitting idle.

This can easily be fixed by hiring more appropriate labor ratios. If you have vase packers sitting idle, hire more vase blowers. You basically want two B workers doing vase blowing for each vase packer, not 1-to-1. They will on average produce one vase per vase-blowing cycle for the packer to work on. Then everything works out OK and, basically, you get the expected results: that 50% efficient workers are worth half as much as 100% efficient workers. (That's ignoring cost of materials, transaction costs to hire more people, needing a bigger factory to fit more workers, etc. When you factor all that stuff in, then yes one 100% efficient worker is better than 2 50% efficient workers. That's not what this parable is about, though).

(This is all on the assumption that people are simply assigned one job and stick to it, and that A1 and B1 do the vase blowing and A2 and B2 do the vase packing. If the packers would simply do some extra blowing when there's nothing to pack, that would also solve the problem and ruin the parable in the same way that hiring more blowers than packers would ruin the intended result.)

It's not efficient workers working with inefficient workers that's wasteful in general. It's people sitting around doing nothing that's wasteful. The parable hides people having time spent idle which is where the entire mathematical difference is coming from.

The book reviewer is very impressed with his bad parable:
To illustrate the latter effect, Jones’s constructs an example, which I call “the parable of the vases.” In a moment I’ll explain the details of the example, but first let me briefly discuss its importance. The example has significantly affected my thinking, and it is one of the highlights of the book. I do not think it is an exaggeration to say that the parable ranks as one of the all-time great examples in economics. Although it is not quite as insightful and important as Ronald Coase’s crops-near-the-train-track example (which illustrates the efficiency of property rights), I believe it is approximately as insightful and important as: (i) Adam Smith’s pin-factory example (which illustrates the benefits of division of labor) and (ii) Friedrich Hayek’s example of an entrepreneur knowing about an unused ship (which illustrates the value of particular, versus general, knowledge).
This kind of bragging about something that's wrong and misleading is not very notable. What was notable to me was that Ann Coulter was fooled and thought it was a good point.
The example generates an even more remarkable implication. It says that, if you are a manager of a company (or the central planner of an entire economy), then your optimal strategy is to clump your best workers together on the same project rather than spreading them out amongst your less-able workers.
I actually do agree with something like this conclusion, although I don't consider it remarkable at all. But the parable of the vases is a bad argument. A good argument covering part of this issue is The Mythical Man-Month.

I'd add that this point about mixing workers applies to peers. Putting a better worker in a leadership and management role interacting with inferior workers does make sense.

So I propose that instead of bringing in lots of low skill workers here, we should encourage a few top quality Americans to emmigrate and be leaders that run the governments and major businesses of other countries.

Elliot Temple | Permalink | Messages (13)

Daring Fireball Misquotes Yankees

Apple blog Daring Fireball posted bad scholarship today:
YANKEES PRESIDENT CALLS COMCAST ‘GUTLESS’

DSLreports:
“It’s a typical gutless act by a cable carrier seeking to promote its own self-interest,” Levine told the NY Daily News. “This amounts to nothing more than a money grab. Comcast, who said it had an agreement in principle with YES, is saving millions of dollars now by not airing YES in the offseason.”
Calling one of Comcast's acts gutless is not calling Comcast gutless.

This kind of sloppiness with the facts is inexcusable. I know it's not the most serious, scholarly blog in the first place, but that's no excuse for misquoting people. And it's a news site which gets access to some Apple press conference invites and review units of new products, so it should at least not post things which are blatantly, factually false.

The false Daring Fireball title is a truncated version of the linked article's title which has the same mistake. So DSL Reports also messed up too, but that's no excuse.

I contacted Daring Fireball about the error and will update this post if it's fixed or there's a response.

Elliot Temple | Permalink | Message (1)

STD Scholarship

Scholarship for STD risks and test accuracy is extremely bad. The information on this topic is awful.

One paper on HSV IgG (herpes, many cases of which are called "cold sores") testing stood out to me because it had a good section:
Summary of Test
1. Prepare 1:51 dilutions of Calibrator(s), Controls and samples in the test set Diluent. Mix well.
2. Place 100 μl of the dilutions in the Coated Wells; reserve one well for the reagent blank.
3. Incubate at room temperature for 30 ± 5 minutes.
4. Drain wells thoroughly. Wash wells 4 times with Wash Solution and drain.
5. Place 2 drops (or 100 μl) of Conjugate in wells.
6. Incubate at room temperature for 30 ± 5 minutes.
7. Drain wells thoroughly. Wash wells 4 times with Wash Solution and drain.
8. Place 2 drops (or 100 μl) of Substrate in wells.
9. Incubate at room temperature for 30 ± 5 minutes.
10. Stop the enzyme reaction with 2 drops (or 100 μl) of Stop Reagent.
11. Read absorbance at 405 nm against reagent blank.
It's great to specify details like washing 4 times and the 5 minute error margins on incubation times.

This is much better than most "scientific" papers I've seen which do not give repeatable procedures for doing the experiment with this sort of detail. I think maybe it's because herpes testing is actually repeated a lot (to test many different people), whereas most scientific experiments are only done once or a few times.

No excuses though. All science should meet this sort of standard or higher. (Honestly it's really not that hard or amazing. This shouldn't be unusual.)

But later the paper says something awful:
A negative serological test does not exclude the possibility of past infection. Following primary HSV infection, antibody may fall to undetectable levels and then be boosted by later clinical infection with the same, or heterologous virus type. Such an occurrence may lead to incorrect interpretations of seroconversion and primary infection, or negative antibody status. [my emphasis]
Heterologous is a prestigious word meaning, basically, it's a different strain of the virus.

So they are saying something may later be boosted by infection with the same virus or a different virus. Why would you say it could be either the same or different? And why present that like it's a fancy, complex point requiring sophisticated and hard-to-read language? They are using fancy words like "heterologous" but I think they didn't really think through what they are actually trying to say. The content is confused and confusing.

And the comma after "the same" is incorrect grammar. They're trying to write in a fancy way but are getting the basics wrong. This is written to impress and intimidate people, not to communicate.

The authors are more interested in sounding like smart medical researches than actually communicating effectively.

This reminds me of a Richard Feynman story:
There was a sociologist who had written a paper for us all to read – something he had written ahead of time. I started to read the damn thing, and my eyes were coming out: I couldn’t make head nor tail of it! I figured it was because I hadn’t read any of the books on that list. I have this uneasy feeling of “I’m not adequate,” until finally I said to myself, “I’m gonna stop, and read one sentence slowly, so I can figure out what the hell it means.”

So I stopped – at random – and read the next sentence very carefully. I can’t remember it precisely, but it was very close to this: “The individual member of the social community often receives his information via visual, symbolic channels.” I went back and forth over it, and translated. You know what it means? “People read.”
Another interesting part of the paper was the data that around 70% of adults have herpes (and another roughly 15% test ambiguous, and 15% negative). This is in line with other sources I've seen. The result is that most STD testing skips herpes (unless there's a visible lesion), even though it's a common STD! Many doctors discourage blood tests for herpes. Some clinics or government run healthcare services don't do herpes blood testing at all, or refuse it to most people. People sort of act like herpes is too common to worry about, so just don't make any effort to avoid infection. No doubt this attitude contributes to so many people having herpes. (You may want to consider getting a herpes test. Herpes is contagious some of the time even if you have no visible sores.)

On a related note, many people who "get tested" for STDs don't even pay attention to which STDs they've been tested for. Lots of people are promiscuous without giving much thought to what STDs exist, what tests exist, how good the tests are, how long things take to show up on the tests with what accuracy, etc. (People are also extremely reckless about believing their partners' claims about safety. People lie to their spouses about their sexual activities, so believing someone you're hooking up with – who has to say how safe s/he is to get laid – is pretty foolish.)

Many people also think if they use a condom that is "safe sex" and they don't really have to worry about anything. This is stupid and dangerous. Using condoms doesn't make you immune or take away the value of thinking about what you're doing, researching STDs, etc. (I think one of the reasons STD information is so bad is that no one cares. People don't try to research this stuff in any kind of reasonable way. At most they just find some doctor saying don't worry about something, or assume percentages over 90 are high, and go back to their social life. For example, lots of people seem to think 97% is a high and safe accuracy for an HIV test. I'm not even joking. For fucking HIV, 97% is not something to treat as plenty safe!)

Elliot Temple | Permalink | Messages (0)

Bad iPad Screen Size Scholarship

Displaymate.com has a lengthy article which appears to look at iPads in great detail. It presents itself as a rigorous comparison which a large amount of work was put into. It gives the impression that they dealt with all the details, carefully, so you don't have to. And it presents factual information which you are intended to believe is true.

An example statement they make is,
we examine in-depth the LCD displays on the Apple iPad mini 4, the iPad Air 2, and iPad Pro based on objective Lab measurement data and criteria.
Lab measurements! They sure put a lot of work into getting everything right. Didn't they?

But people suck at dealing with details. They may well have tried hard, but they have presented false information as if it were a fact. Here's the relevant part of their fact chart:



What caught my attention was the claim that iPad Air 2 is 7.8 inches tall while iPad Pro is 7.7 inches wide. I remembered Apple saying the Air's height and Pro's width matched during a presentation about new multitasking features. (As I remember it, Apple basically said you can fit a whole iPad Air on the pro screen and then have an area left over to the side for a second app.)

So I thought, huh, Apple fudged it. I thought they'd present an exact match here, but actually it's just pretty close.

But then I noticed the number of pixels does exactly match. The Air is 2048 pixels tall. The pro is 2048 pixels wide.

And the Pixels Per Inch exactly matches too at 264.

But if you have the same number of pixels, and the same number of pixels per inch, then the number of inches should also match. The chart contradicts itself.

So how many inches is it? Assuming the pixels and pixels per inch are correct then it's: 2048/264.0 = 7.757575 repeating.

So the actual value is between the 7.7 and 7.8 inches given, and a little closer to 7.8. Both numbers should have been rounded up to 7.8 inches since that's closer.

I wouldn't mind so much if both numbers were rounded the same direction, either way. But getting the same number in two adjacent boxes on your chart, and then rounding one up and the other down, is really not OK. This is a factual error caused by a methodology error. Whatever one's policy for rounding numbers, the same policy should be used for the entire article.

I emailed the article author and will update this post if it's fixed. The article did invite comment. As usual, I understand that mistakes can happen. We'll see if he's willing to fix it. Willingness to fix mistakes, or not, is even more important than making mistakes, or not, in the first place.

Update 2015-12-03:

They replied:
You have incorrectly assumed that both displays have exactly the same 264.0 ppi in order to calculate their width and height. This is a technically weak assumption.

We used the published screen size to calculate the width and height. Both methods are subject to a round off error of the Apple published specifications, but ours is the more technically sound one because it only assumes that the displays have square pixels, which is true for all current high-end displays to very high precision.

A 2732x2048 pixel 12.9" screen is 7.74" by 10.32" which is 7.7 x 10.3 as published

A 2048x1536 pixel 9.7" screen is 7.76" by 5.82" which is 7.8 x 5.8 as published
So they did it by assumption, not lab measurement. And they did the calculation using Apple's tenths of diagonal inches number as exact, even though it's easy to guess that's rounded. Basing their numbers directly on Apple's rounded tenths of diagonal inches is not a reasonable way to end up publishing that two things which are basically the same length are a tenth of an inch apart.

The 264 PPI number from Apple is also rounded, but it could still easily be that the displays Apple gives the same PPI number for are actually made in the same way and have the same PPI. PPI is not something Apple would want to manufacture in lots of slightly different variants, they'd prefer reuse. (If Apple was fine with slightly different PPIs, you'd often see PPI numbers that are a couple apart, rather than different by at most a rounding error, but you don't see that in Apple's lineup.)

So I still think DisplayMates are mistaken and their article is unreasonable. And I think it's bad to publish seemingly contradictory numbers without saying the methodology you used so that readers can judge for themselves if it's reasonable. And they've refused to change this.

Elliot Temple | Permalink | Messages (0)

curi reads a correlation study

This is my real-time unedited (just formatting cleanup) comments on an "original research article" in Frontiers in Systems Neuroscience, "Valproate reopens critical-period learning of absolute pitch".

anonymous-1 wrote:
study says drug can help learn perfect pitch:

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3848041/pdf/fnsys-07-00102.pdf
they claim it's double blind, but doesn't someone being able to do something he otherwise couldn't (they claim) tell him which group he's in and therefore unblind it?

> On days 8–14 of each treatment, we instructed participants to undergo an on-line training program for approximately 10 min per day. During each online training session, they observed a video, which trained associations between piano tones and proper names.

so it could actually be a drug for better boring video watching focus?

oh god they put ppl thru a bunch of junk tests to try to control for mood, depression, mania, being smart

> We counted a training session as complete if the subject both watched the full length of the video (up to within 15 s of the end) and answered the subsequent test question correctly.

did they decide those rules before they started?

> There was no significant correlation between the number of completed training sessions and performance

hahaha

> The experiment was double-blind, as neither participants, nor experimenters knew the randomization for treatment conditions. However, we did ask participants to intuit in which arm they received VPA treatment, and why they thought so. We also instructed them to write down any side effects they experienced during the experiment. Out of the 18 participants who completed the second treatment arm, 17 guessed correctly.

hahaha i told you it wasn't blind

fucking liars

they found out during the study it was not blind

then publish it as a blind study

what scumbags


i think the prior study asserting the critical period exists at all might be more interesting. at least if it's any good. b/c i find a critical period a bit intuitively surprising. like i wouldn't rly expect it

> Second, the analysis of the crossover, i.e., of the 17 participants for whom we have data from both arms, revealed an order-dependent effect of treatment. For participants who took VPA first, AP performance was significantly higher after VPA treatment than after placebo. In contrast, for participants who initially took placebo, there was no such difference. It may be that carry-over effects impeded performance on the AP task in the second treatment arm.

that's odd

> Relatedly, it needs to be noted that we did not test how long the effect of the improvement in AP perception lasted.

so they did not study learning perfect pitch. they studied doing better on certain tests while actively on drugs, but not any kind of longer term skill improvement. so the study title:

> Valproate reopens critical-period learning of absolute pitch

that's bullshit. they didn't study that.

> In sum, our study is the first to show a change in AP with any kind of drug treatment. The finding that VPA can restore plasticity in a fundamental perceptual system in adulthood provides compelling evidence that one of the modes of action for VPA in psychiatric treatment may be to facilitate reorganization and rewiring of otherwise firmly established pathways in the brain and its epigenome (Shen et al., 2008).

wow such bullshit

like it's bad enough they are claiming it creates plasticity for pitch stuff – maybe it just makes u better at pitch without plasticity? among other things – but then to start saying they found out about psychiatry... ugh
the big picture tho is this is explanationless "science". they don't know what VPA does or how it works, and they are focusing on correlations (btwn taking VPA and high scores on pitch tests) not explanations

> If confirmed by future replications, our study will provide a behavioral paradigm for the assessment of the potential of psychiatric drugs to induce plasticity. In particular, the AP task may be useful as a behavioral correlate. If further studies continue to reveal specificity of VPA to the AP task (or to tasks on which training or intervention is provided), critical information will have been garnered concerning when systemic drug treatments may safely be used to reopen neural plasticity in a specific, targeted way.

i think they are saying here that they have no idea if VPA (their drug) has anything to do with pitch, or just helps learning more generally

the intended use for approving psychiatry drugs is disturbing

Refuting the study like this took under 20 minutes. Then people discussed the point about whether the study was blind:

anonymous-1:
    How does that make it not double-blind?
curi:
    if you know what group you're in, that isn't blind.
    do you know what blind means? *confused*
anonymous-1:
    but you don't know, you guess
curi:
    they could tell which they were in
anonymous-1:
    they guessed which they were in
curi:
    so you think 17 out of 18 got it right by coincidence, and there was no unblinding information?
anonymous-1:
    still blind?
    they weren't told until after the study
    this is a standard thing in psych studies to find out whether the person can guess about placebo?
curi:
    if you can guess better than chance, then you have information about which group you're in (or ESP). that information means it's not fully blind. in this case they appear to have quite a lot of such info.
    "standard thing in psych studies" is not reassuring!!!
Justin Mallone:
    ya lol
    psych studies typically trash
anonymous-1:
    not by coincidence, by stuff like feeling the drug
curi:
    right, that makes it not blind.
anonymous-1:
    so yes no unblinding info
curi:
    feeling it is unblinding info
anonymous-1:
    you don't know for sure though
    hmmm
    why should that be considered unblinding?
curi:
    but if you know (from feeling it) better than chance, you know something about whether you have the placebo or not. you have information about it (just not PERFECT information if you don't know for SURE). so it's not fully blind. (and, again, they seem to in this case have had LOTS of info, so not close to blind)
Justin Mallone:
    doing double blind can be hard
curi:
    yeah in medical studies they sometimes use complex active placebos to try to make stuff blind
Justin Mallone:
    the fact that lots of stuff is done incompetently doesn’t lower the bar tho
curi:
    like try to find stuff that'll have the same side effects and other feelable consequences
anonymous-1:
    oh cool @ complex active placebos
    didn't know about that. makes sense

Elliot Temple | Permalink | Messages (0)

Adios America Fact Check

I fact checked Adios, America: The Left's Plan to Turn Our Country into a Third World Hellhole by Ann Coulter.

Method: I randomly selected 5 chapters. For each chapter, I selected a random endnote to check. I used a random number generator. Aftewards, I personally selected 5 more issues to check. I chose issues I thought were important like the number of illegal immigrants in the US.

I scored each issue up to 100% based on scholarship, not politics. Coulter's average score across 10 checks was: 87.5%. But that's just a quick overview. My main focus was on checking the details and explaining why she was right or wrong.

Endnote quotes are blue, quotes from the main book are green, and other quotes are yellow. Bold in quotes was added by me for emphasis.

Chapter 13, Endnote 33

32. Congressional Budget Office, “Migrants’ Remittances,” 10.

33. In surveys, 70 percent of illegal immigrants from Mexico say the money they send home is used exclusively for consumption; 96 percent say it is used for both consumption and savings. Ibid.
The majority of the money sent by immigrants to Mexico is used for “consumption”—i.e., to buy Carlos Slim’s telephone service, shop at Carlos Slim’s department stores, and eat in Carlos Slim’s restaurants.33
It was easy to find page 10 of the pdf online:



The 70% figure matches the report. This means the book text, which says "majority", is correct.

96% is the sum for either consumption only, or both consumption and savings. Coulter's wording is confusing. It sounds like she's saying 96% remit for both purposes, when actually 70% were remitting for consumption only. What she should have written, and presumably meant, is that 96% remit at least partially for consumption.

Note that Coulter says "In surveys". I appreciate that accuracy. She isn't saying this is actually true, it's just a survey result.

I wouldn't take off points for Coulter just writing in her style which isn't always literal. But I think this is an actual wording error in an endnote, not a style choice to entertain readers. However, there's no serious error which would mislead a reader about what's happening in world affairs. It's just a technical wording error in an endnote. It doesn't meet my ideal standards, but it doesn't really hurt the book either.

Score: 85%.

Chapter 3, Endnote 23

23. David North, “Lessons Learned from the Legalization Programs of the 1980s,” ILW.com, http://www.ilw.com/articles/2005,0302-north.shtm; and David S. North and Anna Mary Portz, The U.S. Alien Legalization Program (Washington, DC: TransCentury Development Associates, June 1989), 82–90.
Under the special agricultural amnesty of the 1986 bill, the INS received nearly one hundred thousand applications from “farmworker” illegal aliens living in the lush, fertile farmland of New York City. Another hundred thousand applications were mailed in directly from Mexico.23
From Coulter's link:
In the first place, IRCA’s objective was to offer legal status primarily to people who were in the United States at that time that they applied. There was a minor exception to that in that some 100,000 or so of the 3,000,000 applicants were allowed to file for SAW status at the southern border or at U.S. consulates in Mexico—but they had to claim that they had previously been in the United States doing a sufficient amount of farm work to qualify.
Many an urban resident claimed SAW status, many without justification. There were countless anecdotes of fur-coat wearing Europeans seeking SAW status in Manhattan, applicants who contended that the cotton they harvested was purple, or that cherries were dug out of the ground, or that one used a ladder to pick strawberries.
100,000 people is a "minor exception"? And the policy was to let them file from Mexico if they simply claimed to be legit? Dumb. But Coulter said the applications were "mailed" from Mexico, whereas this talks about applying at the border or a consulate.

And what about the 100,000 "farmworker[s]" applying from New York City? Let's check the cited book. It discusses some ridiculous fraud similar in spirit to what Coulter wrote. But page 83 contradicts Coulter:
there were 28,889 applications filed in New York City
That's not "some 100,000". Page 89 is also relevant:
There were some 118,000 applications filed outside the U.S., all but a handful in Mexico.
The number is right. But this says "filed", not "mailed", so I think Coulter exaggerated on that point.

The gist of what Coulter says in this part of the book is roughly accurate. There was a lot of fraud and the government did a bad job. But she wrote 100k and cited a book which says 29k. That's simply false. However, it doesn't mislead the reader. If she simply changed the number, her passage would be OK. 29k and 100k are both big numbers, so the general idea is correctly communicated. I really don't like errors, but it's only a technical error, so I'm giving half credit.

Score: 50%.

I tweeted Coulter about this error, but received no response. I'd be happy to raise Coulter's score if she acknowledged the error and corrected it for the next edition.

Chapter 2, Endnote 16

15. See, e.g., William Branigin, “INS Accused of Giving In to Politics; White House Pressure Tied to Citizen Push,” Washington Post, March 4, 1997.

16. See ibid.
A year before the 1996 presidential election, the Clinton administration undertook a major initiative to make 1 million immigrants citizens in time to vote. The White House demanded that applications be processed twelve hours a day, seven days a week. Criminal background checks were jettisoned for hundreds of thousands of applicants, resulting in citizenship being granted to at least seventy thousand immigrants with FBI criminal records and ten thousand with felony records.15 Murderers, robbers, and rapists were all made citizens so that the Democrats would have a million foreign voters on the rolls by Election Day.16
From the article:
It is not clear how many of the 180,000 immigrants whose criminal backgrounds were not checked had criminal records that would have disqualified them from being sworn in as U.S. citizens, but at least some felons have slipped through. Among them were an Ecuadoran wanted for murder and a Vietnamese immigrant who faced deportation for two felony convictions and a recent parole violation.
So that's at least one murderer, and presumably more in the other 180,000 people who didn't get a background check. No doubt that's enough people with no criminal background check to include some robbers and rapists too.
While murder has always disqualified an applicant no matter when it was committed, other serious crimes such as robbery or assault could make someone ineligible if they were committed within five years of the application.
And to make matters worse, they weren't even trying to exclude robbers and thugs who commited their major crimes 5 years ago.
The auditors also found that another 71,000 immigrants were granted citizenship despite having criminal histories on file with the FBI. Of them, about 10,800 were charged with felonies.
This article, which complains several times about Republicans, is conceding everything. Since it's a hostile article – this is what Coulter's opponents are actually willing to admit to – I'm going to accept these numbers.

180k is close enough to "hundreds of thousands". It rounds up to 200k. The 70k and 10k figures are good. The murders, robbers and rapists claim is good.

Score: 100%.

Chapter 15, Endnote 28

28. Sarah Stuteville, “Hate Crimes Inflict Fear That May Never Fade,” Seattle (WA) Times, February 27, 2015, http://www.seattletimes.com/seattle-news/crime/hate-crimes-inflict-fear-that-may-never-fade/.
They will no longer be subjected to “hate crimes and discrimination” in America—as put by Pramila Jayapal, who was born in India, but now represents Seattle in the Washington State House.28
I appreciate endnotes which provide the link to the material.
Hate crimes and discrimination comes from a lack of understanding and information about who these populations are, as well as a desire to target and other-ize people,” says Washington state Sen. Pramila Jayapal, who was founder of Hate Free Zone (now OneAmerica), an organization formed after 9/11 to address backlash against immigrant communities.
The Seattle Times is a perfectly reasonable source for quoting what someone said. Jayapal was indeed born in India.

Score: 100%.

Chapter 14, Endnote 10

9. Behar, “The Secret Life of Mahmud.”

10. Ibid.
Luckily for Mahmud, just as his tourist visa was expiring six months later, Schumer’s farmworker amnesty became law. So Mahmud submitted an application, claiming to have worked on a farm in South Carolina, despite having never left New York, except one short visit to the Michigan Islamic community.10
Happily, Coulter actually links the article in a previous endnote.
Six months after [Mahmud] Abouhalima arrived in New York, his tourist visa expired. Fortunately for him, Congress was preparing to authorize an amnesty program for more than 1 million illegal aliens who merely had to assert that they worked as migrant farmers. Abouhalima applied for amnesty in 1986, received temporary legal residence in 1988 and became a permanent resident two years after that. Through an attorney, Abouhalima now claims he worked for seven months on a farm in South Carolina. But his current wife told a TIME reporter that she can remember no travels outside the New York metropolitan area except for one trip to Michigan to visit friends. "The amnesty program was a joke," says Duke Austin, a spokesman at the Immigration and Naturalization Service. "Since documentation wasn't required, the burden was on the government to prove the aliens were not farmers. Fraud was widespread and enforcement virtually impossible."
Time reports Mahmud's own wife told a Time reporter that Mahmud's a liar. There was no checking by the government, no need for documentation. Everything Coulter writes matches her source. Looks good to me.

Score: 100%.

Selected Checking

That concludes the random endnote checks. Now I'll choose 5 major issues to look at:

How many illegals?

There were 11 million illegals in the United States as of 2005, according to everyone. Thus, for example, the pro-browning Pew Hispanic Center estimated the number of illegal aliens in the United States to be 11.1 million in March 2005.26 The Department of Homeland Security put it at 10.5 million in January 2005.27 Other estimates from the New York Times, the Center for Immigration Studies, the Urban Institute, and the Current Population Survey produced similar numbers.28
Each endnote offers a link. 26:



27:
DHS estimates that the unauthorized immigrant population in the United States numbered 11.6 million in January 2008 compared to 11.8 million in January 2007, 11.3 million in January 2006, 10.5 million in January 2005
28:
The latest estimate is that the United States has 11.5 million undocumented foreigners, and it's those immigrants — the illegal ones — who have galvanized Congress.
That last quote is from the New York Times, from 2006 not 2005. But close enough. It does reflect that the NYT thought there were "similar" to 11 million illegals in 2005.
The reason all the estimates from Pew, DHS, CIS, the Urban Institute, and the Current Population Survey are nearly identical—11 million!—is that they all use the same census data.
THE REAL NUMBER IS 30 MILLION ILLEGALS [Coulter's emphasis, it's a section title.]
There’s good reason to believe the census numbers are wrong. In 2005, two Bear Stearns analysts, Robert Justich and Betty Ng, warned clients that there was “significant evidence” that the census undercounted the illegal immigrant population by at least half.29 They estimated the number at closer to 20 million—and they were advising clients about something important: their money.

Justich and Ng discounted the census data because it relied on illegal aliens answering surveys.
29. Robert Justich and Betty Ng, “The Underground Labor Force Is Rising to the Surface,” Bear Stearns Asset Management, January 3, 2005, http://www.steinreport.com/BearStearnsStudy.pdf.
The report has some reasonable points:
The strongest evidence supporting our theory that the actual illegal population is double the consensus estimates lies within several micro trends at the community level. We see very dramatic increases in services required in communities that have become gateways for immigration.
Based on several criteria, we believe that immigration is growing significantly faster than the consensus estimates:
1. Remittances
2. Housing permits in gateway communities
3. School enrollment
4. Cross border flows
The rate of increase in remittances far exceeds the increases in Mexicans residing in the U.S. and their wage growth. Between 1995 and 2003, the official tally of Mexicans has climbed 56%, and median weekly wage has increased by 10%. Yet total remittances jumped 199% over the same period. Even considering the declining costs of money transfers, the growth of remittances remains astounding.
In New Jersey, the three gateway towns of New Brunswick, Elizabeth, and Newark exemplify this trend. According to the census, the combined population in these three towns between 1990 and 2003 grew only 5.6%, less than the 9% reported in the rest of the three corresponding counties. Yet housing permits in these three towns shot up over six-fold, while the rest of the three counties only saw a three-fold increase. More importantly, 80% of these permits were designated for multiple dwellings, so the corresponding increase in people accommodated are even greater. Official statistics state that illegal immigrants in New Jersey have jumped 110% during the same period – an estimate that is inconsistent with the housing statistics, our discussions with local realtors and the changes that we have visually observed in the demographic landscape.
“To a significant degree, high rates of immigration offset the effect of a declining number of births on school enrollment.” Administrators have been surprised that school population growth significantly exceeded earlier projections, thus creating overcrowding in many school districts.
Pulitzer Prize reporters Donald L. Barlett and James B. Steele recently reported for TIME magazine that “the number of illegal aliens flooding into the United States this year will total 3 million. It will be the largest wave since 2001 and roughly triple the number of immigrants that will come to the U.S. by legal means.” The TIME investigation, according to Mr. Barlett, relied not only on figures projected by the U.S. Border Patrol, but also on the reporter’s extensive investigations along the Mexican border at factories, local communities, and the district offices of the U.S. Border Patrol.
I don't think this is a perfect answer by any means. The Bear Stearns analysts don't have all the answers. But it's some reasonable information on the topic. Coulter herself emphasizes the topic doesn't have good enough data and statistics. For example:
YOU WILL SPEND MORE TIME TRYING TO OBTAIN BASIC CRIME STATISTICS ABOUT immigrants in America than trying to sign up for Obamacare. The facts aren’t there.
and
In just a few decades, Minnesota has gone from being approximately 99 percent German, Dutch, Finnish, Danish, and Polish to 20 percent African immigrant,7 including at least one hundred thousand Somalis.8 And that’s not counting the Somalis who have recently left the country to fight with al Qaeda and ISIS. One hundred thousand is just an estimate. We don’t know precisely how many Somalis the federal government has brought in as “refugees” because the government won’t tell us. The public can’t be trusted with the truth.
The big picture is we don't know all the numbers. Coulter's numbers make more sense than numbers she's challenging. That's good. And she doesn't overestate her case by claiming perfection with her stats.

I'd say Coulter did a good job here. She presented the reader with useful information and put it in context in reasonable way. She challenged some claims that deserved challenging and gave some alternatives to consider that are more reasonable. They're imperfect, but the main point is people should stop accepting the 11 million figure and reconsider. Coulter's right about that.

Score: 95%.

A quarter of Mexico's population?

America has already taken in more than one-quarter of Mexico’s entire population, according to the Pew Research Center’s analysis of census data.9 The United States has more Hispanics than any other country besides Mexico.10 Do we have to admit all 120 million Mexicans to prove to the New York Times that we’re not “nativist”?
9. Anna Brown and Eileen Patten, “Hispanics of Mexican Origin in the United States,” Pew Research Center Hispanic Trends Project, 2011, http://www.pewhispanic.org/2013/06/19/hispanics-of-mexican-origin-in-the-united-states-2011/. (“An estimated 33.5 million Hispanics of Mexican origin resided in the United States in 2011, according to the Census Bureau’s American Community Survey.”)
The Pew Research Center page linked does give the 33.5 million figure exactly as quoted. The population of mexico is around 120 million.

One problem is if we took in 33.5 million Mexicans, and there's 120 million in Mexico, then that's 153.5 million total, of which we have closer to a fifth (21.8%), not a quarter.

I think Coulter's point was to put 33.5 million Mexicans in context. It's over a quarter of the current population of Mexico! That's a lot! I read her comment more as a stylistic choice than strictly about math. And I don't think rounding 21.8% to 25% is very bad, it's in the right ballpark.

The one-quarter comment bothered Politifact, a group of partisan left-wingers who like to dress up their talking points as "facts". Their best counter was:
In reality, the immigration data from Pew is not nearly as neat and tidy as Coulter concludes. The Pew report attempted to count the number of people who trace their roots back to Mexico, not people who came directly from that country.

Why does that make such a difference?

Well, about two-thirds of Americans with Mexican ancestry were born in the United States. By definition, they were never part of Mexico’s population.

If they weren’t Mexican, they could not be "taken in."

The Pew definition is important, and if the numbers about Mexico don’t make it clear, let’s look at another country. We picked Ireland. In 2014, the Census Bureau said there were 34.1 million Americans with Irish roots. That’s nearly seven times Ireland’s current population.
That sounds like a pretty big error. But let's see what the Pew analysis actually says:
An estimated 33.5 million Hispanics of Mexican origin resided in the United States in 2011, according to the Census Bureau’s American Community Survey. Mexicans in this statistical profile are people who self-identified as Hispanics of Mexican origin; this means either they themselves are Mexican immigrants or they trace their family ancestry to Mexico.
They were not looking for, or counting, anyone with any Mexican ancestry or roots like Politifact claims. They were only counting people who self-identified as "Hispanics of Mexican origin". Politifact is contradicting Pew's own statement about their data (hoping no one will notice) in order to try to make Coulter look bad.

Did Coulter use loose language and exaggerate here? Yes. (Was what Politifact said worse? Yes!) But so what? You're allowed to talk loosely at times. The one quarter comment was putting things in perspective, not trying to be a rigorous analysis. There's plenty of other material in Adios America which is more rigorous and factual, and is worded to indicate that.

I would like if Coulter was a little more careful at times, but I don't see any significant problem here. I don't think it would mislead a reader in general. There's a big problem and Coulter's saying there's a big problem, which is true.

Score: 90%.

Do Illegals Honestly Answer Government Surveys?

Another part of Politifact's article looked interesting to me. And I think picking issues to look at that her enemies bring up is a good method to try some. Coulter wrote:
Justich and Ng discounted the census data because it relied on illegal aliens answering surveys. As Justich told the Wall Street Journal, “The assumption that illegal people will fill out a census form is the most ridiculous concept I have ever heard of.”30 People who have left their families, paid huge sums of money to smugglers, trekked thousands of miles, and broken American law to enter this country don’t have much incentive to fill out questionnaires from the U.S. government.

The census tried to account for the reluctance of illegal aliens to answer government surveys by adding 10 percent to their population estimate. Guess where they got 10 percent? From another survey of illegals.
But Politifact says:
In a recent report, the center wrote "It is well established that illegal aliens do respond to government surveys such as the decennial census and the Current Population Survey."
Well, they did indeed write that contradiction to Coulter. But they didn't argue it. At all. Coulter's position makes sense. This is just a "center" asserting something:
It is well established that illegal aliens do respond to government surveys such as the decennial census and the Current Population Survey. While Census Bureau surveys do not ask the foreign-born if they are legal residents of the United States, the Department of Homeland Security (DHS), former INS, the Pew Hispanic Center, and the Census Bureau have all used socio-demographic characteristics in the data to estimate the size of the illegal alien population. We follow this same approach.50
And does endnote 50 have an argument that illegals respond to government surveys? No.
To distinguish legal from illegal immigrants in the survey, this report uses citizenship status, year of arrival in the United States, age, country of birth, educational attainment, sex, receipt of welfare programs, receipt of Social Security, veteran status, and marital status. [...]
That endnote is on the topic of estimating things about the people who did fill out surveys, not on the topic of how they "established" that illegals are filling out surveys in the first place.

Rather than argue the issues, Politifact relied on judging statements by who said them:
The Center for Immigration Studies, a group that favors reduced immigration much as Coulter does, disagrees with that last point.
It's not that the Center for Immigration Studies had a good argument. Or any argument at all. Nor does Politifact have an argument. Instead, it's that the Center for Immigration Studies is asserted by Poltifact to be anti-immigration, and their point is basically "even the people who don't like immigration know Coulter is wrong". That's such an unscholarly approach that I wanted to point it out.

For the issue of Politifact attacking Coulter's argument that illegals don't fill out governement surveys, I'd say Politifact did a lot worse than just remaining silent. It showed their own flaws, not any mistake by Coulter.

Score: 100%.

How Dumb Is The Government?

That last claim Coulter made sounded interesting to me. Did the government really use a survey of illegals to try to find out whether (and at what rate) they answer surveys? Let's find out.
The census tried to account for the reluctance of illegal aliens to answer government surveys by adding 10 percent to their population estimate. Guess where they got 10 percent? From another survey of illegals. In 2001, the University of California asked Mexican-born residents of Los Angeles if they had taken the recent census. Ten percent said “no.” But almost 40 percent refused to take that survey.31
30. Carl Bialik, “In Counting Illegal Immigrants, Certain Assumptions Apply,” Wall Street Journal, May 7, 2010, http://www.wsj.com/articles/SB10001424052748704370704575228432695989918.

31. Ibid.
The cited article says what Coulter claimed:
Researchers at CIS and Pew and in the federal government use a decades-old technique that looks at the number of foreign-born people in the U.S., as counted by annual census surveys. Then they subtract the number of foreign-born people in the U.S. legally, based on immigration records and projections of deaths and outmigration. The remainder is believed to be the number of illegal immigrants.

There are several assumptions that underlie these estimates, including the figures for outmigration, which isn't tracked by the U.S. government. The biggest problem, though, is that no one really knows what proportion of illegal immigrants respond to census interviewers and how honest they are about their place of birth.

These studies presume that about 10% of illegal immigrants aren't counted by census takers. But that figure largely is based on a 2001 University of California-funded survey of 829 people born in Mexico and living in Los Angeles, in which individuals were asked, among other things, whether they responded to census interviewers a year earlier. Representatives of nearly two in five households refused to answer that survey, and those who didn't might have been more likely to skip the census count as well.
But it's just a WSJ article with no cites or links. This is the internet! Why not link to the surveys you're talking about? :( He didn't even give the name of the study, the journal, or anyone involved with it, which makes it hard to search for.

Even if I find the 2001 study and everything checks out, how would I know that the other unspecified studies presuming the 10% figuring were basing it largely on the 2001 study? To figure this out properly would require a bunch of work. Coulter or Bialik should have done this work and shared it, but they haven't. Coulter, unfortunately, seems to have just dumped responsibility on Bialik's article which makes some big claims without giving the details.

I think Coulter's right about the issue here. For example the Bear Stearns Study says:
The Census Bureau’s counting process for the migrant population has some shortcomings. According to our discussions with illegal immigrants, they avoid responding to census questionnaires. For this reason, the official estimates do not fully capture this group.
and
According to Maxine Margolis, author of An Invisible Minority: Brazilians in New York City, the discrepancies started well over a decade ago. The 1990 census, for example, recorded only 9,200 Brazilians in New York City, while the local Brazilian consulate estimated 100,000 Brazilians at that time. The Brazilian foreign office placed the number at 230,000; Dr. Margolis also noted that comparisons of the Boston Archdiocese and Brazilian consulate records with U.S. census records show a startling 10 to 1 difference.
I didn't find a paper on the 2001 survey itself, but I found Immigrant Voting in Home Country Elections which has detailed information about it.
The July 2001 Los Angeles County Mexican Immigrant Legal Status Survey (LA-MILSS) is a random sample of 456 households in which at least one person was born in Mexico and 829 foreign-born Mexicans who resided in Los Angeles County in July 2001.
Looks like the survey happened in the right place with the right number of people.
household response rate of the LA-MILSS is 62 percent.
This 38% non-response rate fits with the claim that almost two in five households refused to answer. (Note: they already are ignoring outcomes like no one was home. This is people who were there and didn't answer the questions, so the word "refused" is accurate.)
Slightly less than half (46 percent) of adult respondents admitted to residing in the United States without being a naturalized citizen, a legal permanent resident or a temporary visitor.
That's a lot!
If we apply Marcelli and Ong’s (2002) estimated 10 percent undercount rate for all foreign-born Mexicans in the 2000 Census to these two point estimates, then the estimated number of expatriate Mexicans residing in the United States who will vote in the 2006 Mexican elections if the 1996 Mexican electoral reforms remain inoperative is 1.8 to 3.1 million.15
Guess what the footnote is. Think it'll provide details of the 10% undercount? Or maybe it'll give their calculations for the 1.8-3.1 million range? No, all it does is say the government used the 10% number.
15 This estimated undercount rate was employed in the recent U.S. INS report on unauthorized immigration in the United States (U.S. Immigration and Naturalization Service 2003).
That's not useful. Although it does provide an example of the 10% figure being used, like the WSJ article claimed.

Here's another statement about the 10% undercount. It's in a paper that at least has a bunch of linked endnotes with citations written out:
During the 2000s, the two leading producers of estimates of the unauthorized foreign-born population, the Office of Immigration Statistics (OIS) and the Pew Hispanic Center (Pew), assumed that coverage error was, respectively, 10 (Hoefer, Rytina and Baker 2011
) and 13 percent (Passel and Cohn 2009) for the unauthorized foreign born, and about 2.5% for other foreign born. OIS rested its assumption about coverage error on a survey conducted in Los Angeles that was then compared to Census counts (Marcelli and Ong 2002). Pew based its assumption on the levels of enumeration error estimated for the 2000 Census, which were calculated by incorporating data from the Accuracy and Coverage Evaluation (ACE) post-enumeration surveyviii
I looked for "2000 Census coverage of foreign-born Mexicans in Los Angeles County: Implications for demographic analysis" by Marcelli and Ong. Google scholar is aware it exists. But it's not available online. It isn't just behind a paywall. There's no copy of it available. They presented it at an IRL meeting, and people cite it, but there's I see no mention of it actually being published anywhere. Here is the meeting information and the paper information:
This paper employs the 2001 Los Angeles Mexican Immigrant Legal Status Survey (LA-MILSS) data to estimate the contribution of unauthorized and Legal Mexican immigrants to the Census undercount in Los Angeles County. After estimating the number of Mexican immigrants by legal status and whether each individual was enumerated in the 2000 Census, we examine various sources of omission. Logistic regression results suggest that individual demographic characteristics, social network quality, and neighborhood characteristics help explain variation in whether a person was counted.
And that's all the information we get. This makes it hardre to blame Bialik and Coulter for not providing more cites. These guys just publish a paragraph summary online and don't bother publishing their actual details. They share their ideas in person, apparently to be cited by other people who took notes while they were talking, I guess.

Finally, I see the government is using this, as claimed:

Estimates of the Unauthorized Immigrant Population Residing in the United States: 1990 to 2000

Office of Policy and Planning
U.S. Immigration and Naturalization Service


...

About 12.6 million foreign-born persons who entered the United States from 1990 to 1999 were counted in the 2000 Census. The INS adjusted that number upward by about 850,000, primarily to account for estimated undercount in the census,4

4 The estimate of net census undercount of 10% for unauthorized residents is consistent with results reported in a paper by Enrico Marcelli, “2000 Census Coverage of Foreign-born Mexicans in Los Angeles County: Implications for Demographic Analysis,” presented at the 2000 Annual Meeting of the Population Association of America, Atlanta, GA. For lawful residents, as defined here, the rate of net census undercount was set at one fourth of the rate for unauthorized residents, or 2.5 percent. [Bold in original for headings.]
Note the 850,000 adjustment the INS used is 6.7%, not 10%, even though their footnote says 10%.

OK now let's step back. Coulter said they asked people if they answered the census, and 10% said no. But I wasn't able to find that question from the survey and the results for it. Coulter's own citation should have led me to find that, since she makes that claim in her book. That's bad.

On the other hand, she's right about the big picture: the government and others are pretty much just making stuff up instead of being scholars with facts. The quality of the work Coulter's questioning is ridiculously low. She's right to draw attention to it. The theme of her book holds up. So again I'm going to deduct some points for a technical problem (I couldn't find some of the specifics she brought up her endnotes, even after doing quite a bit of research), but Coulter hasn't said anything that would mislead a reader about the state of the world. She isn't playing loose with facts to trick anyone about anything.

Score: 70%.

Adios America?

So, will illegal immigration destroy the country? Would amnesty mean Republicans never get elected again? Are these third-worlders assimilating, or not? Are we in danger? Is this a serious enough issue to really threaten our country? Could it be Adios America!?
According to a Washington Post poll, a majority of second-generation immigrants from Mexico, Cuba, Haiti, Vietnam, and the West Indies did not refer to themselves as “Americans” and said America was not the best country in the world.22
22. William Booth, “One Nation, Indivisible: Is It History?,” Washington Post, February 22, 1998, http://www.washingtonpost.com/wp-srv/national/longterm/meltingpot/melt0222.htm.
The article says:
One study of the children of immigrants, conducted six years ago among young Haitians, Cubans, West Indians, Mexican and Vietnamese in South Florida and Southern California, suggests the parents are not alone in their concerns.

Asked by researchers Alejandro Portes and Ruben Rumbauthow how they identified themselves, most chose categories of hyphenated Americans. Few choose "American" as their identity.

Then there was this – asked if they believe the United States in the best country in the world, most of the youngsters answered: no.
Like Coulter said. But where's the details? They were harder to find because Ruben Rumbaut's name is mispelled :( I did find some paywalled stuff, but since I don't even know which one they are talking about, I didn't buy it.
when Obama won his 2012 reelection, Teixeira gloated that—as he had predicted—ethnic minorities were voting 8–2 for the Democrats, and had grown to nearly one-third of the electorate. “McGovern’s revenge only seems sweeter,” Teixeira said.19
19.Ruy Teixeira, “The Emerging Democratic Majority Turns 10,” Atlantic, November 10, 2012, http://www.theatlantic.com/politics/archive/2012/11/the-emerging-democratic-majority-turns-10/265005/.
Teixeira's article says, as claimed:
Voters in 2012 were 28 percent minority, an increase of 2 percentage points from the 2008 level and a massive 13 percentage point increased from the 1988 level of 15 percent.
(28% is a little low to be calling nearly a third.)
Minority voters backed Obama 80 percent to 18 percent in 2008 -- and did exactly the same for the president this year. His support among African-Americans was almost as overwhelming (93-6) as it was in 2008 (95-4). And his support among Hispanics (71-27) improved substantially over its 2008 level (67-31). In addition, Obama achieved historic levels of support among Asian-Americans. This year he carried them 73-26, compared to 62-35 in 2008.
What about assimilation?
Everyone seems to agree that it is Minnesotans’ responsibility to assimilate to Somali culture, not the other way around.11 The Catholic University of St. Thomas has installed Islamic prayer rooms and footbaths in order to demonstrate, according to Dean of Students Karen Lange, that the school is “diverse.” Minneapolis’s mayor, Betsy Hodges, has shown up wearing a full hijab to meetings with Somalis. (In fairness, it was “Forbid Your Daughter to Work Outside the Home” Day.) A suburban Minnesota high school has “Welcome” signs written in Somali, a Somali student group, and articles in the school newspaper about how unhappy the Somalis are.
11. See, e.g., “Mayors Seek Closure of Troubling Gaps,” Minneapolis (MN) Star Tribune, January 7, 2014. (“Changing people’s thinking about the value of every part of the city is essential to closing the income gap, achievement gap, health gap and all the other income- and race-based disparities that afflict the Twin Cities. . . . The arc of history has truly bent toward diversity and inclusivity.”)
The article indeed is a bunch of appeasement of unassimilated immigrants. It has an attitude that their problems are white people's fault, and American needs to change to make Somalis better off. For example:
The arc of history has truly bent toward diversity and inclusivity in both Minneapolis and St. Paul. Whether history’s arc can also bend more nearly toward justice and opportunity for nonwhite, nonaffluent residents is an unanswered question. Making it so may be the greatest challenge these cities face if they are to remain prosperous in the 21st century.
If we do it right, we will begin to weave our city and our neighborhoods together fully, not merely in our conversations, but in our hearts and in our minds, as well. [...]” Hodges said.
Changing people’s thinking about the value of every part of the city is essential to closing the income gap, achievement gap, health gap and all the other income- and race-based disparities that afflict the Twin Cities. It will take vigorous use of the mayoral bully pulpit to spur that change. At that task, Coleman and Hodges have begun well.
The focus here is on Americans doing something, changing their thinking, looking at the world differently, etc, rather than on saying to the immigrants, "Hey guys, you came here. If you want to make more money and be more educated, then you change. Start acting like Americans and you'll get the same results we do without our city changing anything."

With immigrants not being assimilated and voting heavily for the Democrats, America is at genuine risk. But I wasn't satisfied with the details of the second generation immigrant cite. Again I'm not questioning the book's main themes, but I would have liked better research behind Coulter's factual details.

Score: 85%.

Conclusion

Coulter's average score is 87.5%. But you should try to understand what Adios America is like, not rely on a summary number. Please judge for yourself.

Here's what I think:

Despite all the endnotes, this doesn't appear to be a book of extremely careful fact checking and research. Coulter sometimes relies on sources like newspaper articles and repeats their claims without further checking. She makes some technical errors. But I didn't find a single instance where the message of her book was mistaken, which is what I'd say matters the most.

If you liked this, check out my previous Ann Coulter fact check, and my review of her critics' scholarship.

Thank you Justin Mallone for help finding some of the information.

Elliot Temple | Permalink | Messages (3)

Stefan Molyneux is a Dishonest Hack

The Truth About Ted Cruz by Stefan Molyneux is a hit video that throws everything it can against Ted Cruz while pretty much ignoring all his merits.

It purports to be a well-sourced factual takedown relying mostly on quotes. Molyneux made a website for it with a detailed table of contents and a long list of sources with links.

One of the issues, "Texas Values", discusses the Michael Wayne Haley court case. Here's what Molyneux says:



And he has two sources for this:

The Brutalism of Ted Cruz from The New York Times, a leftist propaganda rag that hates Cruz, and which can't be trusted after getting caught in so many lies. And, second, David Brooks’ (Slightly) Unfair Attack on Ted Cruz which basically agrees with the first article.

When I google for "cruz prosecute haley" (without quotes), the articles Molyneux used come up first and sixth. What Molyneux ignored is the second google hit:

David Brooks’ Dirty Hit On Ted Cruz: How Pundits Lose Credibility

Both articles Molyneux links are light on details. But this one is a detailed scholarly refutation of the position Molynex repeated straight from the New York Times. Why did Molyneux ignore it?

Molyneux is offensively dishonest because he pretends to be a scholar. He didn't just make a video attacking Cruz. He put together a big list of sources in order to lie to people that he'd done a bunch of proper research. He hadn't. He just looked for one-sided ways to smear Cruz no matter how false they were. There's no excuse for missing the second google hit on the topic. (Which also comes up on the first page of google results for a variety of other search terms I tried.)

I also dislike the sneaky claim that Cruz was "just following orders". That is not something Cruz said, nor is it what the Cruz defender I linked at Ethics Alarms said. It's just Molyneux dishonestly trying to call Rob Garver a Cruz defender (the guy from his second source who wrote, "Yet it’s hard to argue with many of [Brooks'] conclusions."). Molyneux is pretending to give both sides of the issue, but he just attacks Cruz twice and attributes one of the attacks to Cruz defenders, while ignoring Cruz's actual defenders.

Elliot Temple | Permalink | Messages (7)

Ann Coulter's Bad Scholarship

Ann Coulter tweeted:

Professor whose statistical model predicted every election since 1912: Odds Of President Trump Range Btwn 97% & 99%-http://bit.ly/1p63RMW

After my previous positive reviews of her book scholarship, I wanted to highlight how atrocious this is. Let's look over the article:

Political Science Professor: Odds Of President Trump Range BETWEEN 97% AND 99%

The model has been correct for every election since 1912 except for the 1960 election

Ann said "every election". Did she even read the article? What a travesty.

Specifically, Norpoth predicts that Trump has a 97 percent chance of beating Hillary Clinton and a 99 percent chance of beating Bernie Sanders.

The predictions assume Trump will actually become the 2016 presidential nominee of the Republican Party.

So it doesn't predict either primary. It only predicts Trump is 97-99% to become president if you throw in the big assumption that he's literally 100% likely to win the Republican primary.

So that's two major factual errors in Ann's tweet.

Besides getting the basic facts wrong, twice, there's also the issue that the article and prediction model are utter crap.

“When I started out with this kind of display a few months ago, I thought it was sort of a joke,” the professor told the alumni audience

You know what would have been impressive? If the prediction model was published in 1911.

Instead it was worked out a few months ago and has never actually predicted anything? It's really easy to "predict" past data. It's called back-fitting and it's well known. Making a formula to fit past data is completely different than making successful predictions about the future.

(That it was back-fitting, not prediction, was predictable to me before I even clicked the article. Ann should have known better even if she literally didn't read a single word of the article.)

Norpoth, a 1974 University of Michigan Ph.D. recipient who specializes in electoral behavior alignment, said his crystal ball also shows a 61-percent chance that the Republican nominee — Trump or not — will win the 2016 presidential election.

Wait what? This is pretty incoherent. These numbers do not make sense. For this math to add up – around 98% chance for Trump to win if he's the nominee, and 61% chance for any Republican to win – requires Trump to have only around a 60% chance to be the nominee (if the other Republican candidates are somehow all around 0% likely to win the general election) or less.

I also checked out the Daily Caller's source:

Political science professor forecasts Trump as general election winner

“You think ‘This is crazy. How can anything come up with something like that?’ ” Norpoth said “But that’s exactly the kind of equation I used to predict Bill Clinton winning in ‘96, that I used to predict that George Bush would win in 2004, and, as you remember four years ago, that Obama would win in 2012.”

Note the wording, "the kind of equation". So he made up a new equation just now. He's made up other equations in the past. He keeps changing them each time, rather than re-using an equation that's ever predicted anything.

In contrast, Norpoth forecasted that a hypothetical presidential race with Ted Cruz or Marco Rubio on the Republican ticket would be a much closer race. The results showed Clinton with a 55 percent chance of winning the race against Cruz or Rubio with a 0.3 percent lead in the popular vote.

So Trump needs to have a very low chance to win the GOP primary for the math to work out. Meanwhile the prediction model saying he'll win the general election is based on him doing so well in the primaries! This is all a bunch of contradictory nonsense.


And Ann Coulter is promoting this utter nonsense on Twitter while making factual errors. This fits her recent pattern of saying anything – even stupid and dishonest things – that are on Trump's side. :(


Elliot Temple | Permalink | Messages (2)