Back to Submissions

1
Does intelligence have nonlinear effects on political opinions?

Submission status
Reviewing

Submission Editor
Submission editor not assigned yet.

Author
Emil O. W. Kirkegaard

Title
Does intelligence have nonlinear effects on political opinions?

Abstract

We sought to study intelligence’s relationship with political opinions with particular interest in nonlinear associations. We surveyed 1,003 American adults using Prolific, where we measured English vocabulary ability, as well as 26 political opinions. We find that intelligence has detectable linear associations with most political opinions (21 of 26). Using natural splines and the multivariate adaptive regression splines (MARS) algorithm, we find evidence of nonlinear effects on both individual opinions (15 of 26) and a general conservatism score. Specifically, the association between intelligence and conservatism is mainly negative, but becomes positive in the right tail.

Keywords
intelligence, IQ, cognitive ability, political ideology, multivariate adaptive regression splines, nonlinear

Supplemental materials link
https://osf.io/tbqzw/

Pdf

Paper

Reviewers ( 0 / 2 / 2 )
Reviewer 1: Considering / Revise
Reviewer 2: Accept
Reviewer 3: Accept
Reviewer 4: Considering / Revise

Thu 16 May 2024 22:37

Reviewer

Not much to comment on here, but I still find the >120 IQ effect quite unconvincing. Fuse both datasets and calculate the correlation within the >120 IQ subgroup. If there is no statistically significant effect, then priors dictate that it's an attenuation effect, not a U-curve effect. I also recommend using a survey package to remove low quality responses to test whether the effect of low IQ is sensitive to low quality data.

Paper looks fine otherwise.

 

Reviewer | Admin

Interesting paper. Before I can recommend it for publication, I would ask you to address the following comments:

1. Typos/grammar mistakes:

“with the rise of more populist of the party”
“To total sample’s IQ was 98.2”
“obtain higher precisions”
“linear effect of political opinions”
“and endspan.”. However”
“pervasive evidence of the association of intelligence”
“which were most shorter and less reliability than the current study”

2. As an alternative method of testing for non-linear associations, you could try adding a squared term for cognitive ability in each regression model. If the term enters with a significant coefficient in the expected direction, that is evidence of non-linearity.

3. On Figure 2, several of the charts seem to show cognitive ability becoming positively associated with a _left-wing_ attitude in the right-tail of cognitive ability. (If these items were reverse-coded, the chart titles should be changed.) In addition, several of the charts show evidence of flattening in the right-tail, rather than reversal. 

4. Figure 4 appears to show lower variance in conservativism in the tails of cognitive ability.

5. You say, “The findings may in fact be interpreted as confirming a variant of the midwit or bell curve meme”. This claim seems too strong to me. While there is evidence of non-linearity and flattening for some measures, evidence of a clear U-shape is weak. In Figure 4, the predicted value of conservatism for an IQ of 140 is substantially lower than the predicted value for an IQ of 60.

6. I would remove Figure 8. Most people know what the midwit/Bell Curve meme is, and if they don’t they can just look it up.
 

Reviewer | Admin
Replying to Fri 14 Jun 2024 08:51

Not much to comment on here, but I still find the >120 IQ effect quite unconvincing. Fuse both datasets and calculate the correlation within the >120 IQ subgroup. If there is no statistically significant effect, then priors dictate that it's an attenuation effect, not a U-curve effect. I also recommend using a survey package to remove low quality responses to test whether the effect of low IQ is sensitive to low quality data.

Paper looks fine otherwise.

 

Would it be possible to bootstrap 95CIs for figures 5 and 6?

Reviewer | Admin

This paper makes a very important contribution to our knowledge on intelligence and political opinions. Although it has been speculated for a while that the relationship may be non-linear or u-shaped, this hypothesis has not been tested thoroughly using approaches that are reliable in the extremes of the IQ distribution. The manuscript uses a highly reliable IQ test, with a large sample and a highly apt methodology (splines as opposed to higher order terms) to test for and identify non-linearities. The paper now allows us to say quite conclusively that the relationship is not perfectly linear, albeit that the effect appears to level off at higher IQs, rather than change direction. I intend to support publication after the author has considered several small issues.

 

1) Why analyse only one latent factor of political opinions? As the author has previously declared on vieweing political opinions as one dimensional: "However, this model is actually and obviously false in a nontrivial way... Political ideology cannot generally be reduced to 1 dimension without massive loss of information and probably substantial chance of misinterpretation." Yes, it is a useful simplification and a general politics factor should be the main result, but I see little reason not take a two factor solution and analyse the non-linearity on the second factor. My prior guess is that non-linearity will be stronger on the second factor (at least if it was reliably measured). In Figure 2 it appears that it might be the economic questions which are most u-shaped e.g. large companies should be controlled by the state and not private actors. It would be a shame not to run this as a supplementary test. It would be worth writing another paper on the topic if the author were to skip it. 

The only argument I can think of against testing the relationship with two latent factors is that the author thinks the reliability will be too low to say anything. I'm generally skeptical of using hard and fast rules regarding reliabilities being too low to publish (because publication bias is annoying and as long as the sample szie is large enough you might still have power to detect an effect). But if this is the author's reasoning it might be worth reporting the reliability of a second latent politics factor.

 

2) Related to point 1, it might be worth adding the reliability of the politics factor. Part of the author's justification of the paper is that his more reliably IQ testing allows non-linearities to be tested with good power. The reliability of the latent conservatism factor is also related to that claim. 

 

3) The author seems to want to say that there is a positive effect among the very high IQ, but the results as they are presented seem to only clearly show that the effect is somewhat nonlinear. 

I view the results as vindicating the scholars who thought the relationship was approximately linear, moreso than those who have trumpeted nonlinearities and certainly moreso than fans of the midwit meme. The change in adjusted R squared from including splines in table 1 is 0.012, or change in "adjusted r" of 0.11. Important, to be sure, but at times over-sold in the paper. For example, in the abstract the author says "becomes positive in the right tail". Looking at Figure 2, I'm not sure you can say the relationship isn't just flat after a certain IQ. Sure, the MARS algorithm gets nice large positive effects at high IQs, but they don't have confidence intervals with which I can judge how strong the reversal is. As another reviewer has pointed out, the author seems to overplay how congruent his results are with the midwit meme.

I see a few possible solutions: a) change the language of the conclusions to be slightly less strong ("the effect levels off", "possible that the effect of IQ changes direction" etc.) b) Literally subset to the high IQ in the sample, and recalculate the linear effect in that portion so you can then see if it is significantly different from 0.  (or any other equivalently simple test that can tell us whether there really is a significant positive effect in the right tail) c) Putting confidence intervals on the MARS estimates. "Confidence intervals" not possible. With a bootstrap and computer left on overnight, anything is possible.

 

The rest of my comments are less substantive and are primarily concerned with writing. 

- First sentence - "with political opinions with". Two "withs" so close is ugly.

- First sentence of introduction "long standing interest". The studies cited only go back to 2012. Research on the topics goes back to at least the 40s or 50s. I'd cite Onraet et al.'s meta-analysis here, or cite one of the classic studies to justify the long standing interest claim. 

- First paragraph of intro. A lot of claims are made e.g. effect of IQ on party support in multi-party systems, changes over time in the relationship between IQ and politics. I think all the claims are correct, but citing them would make it easier to follow this. Some of this information is surely in the citations given in the first sentence. But it is a pain for me to trawl through to see which citation corresponds to which claim made later in the paragraph. I think the author might want to cite Ludeke et al. (2018) Different political systems suppress or facilitate the impact of intelligence on how you vote: A comparison of the US and Denmark for this claim regarding multi-party systems.

- "measures of free market support (economic liberalism) show positive relationships". I think Jedginer et al meta-analysis says r = 0.05. I'd say "tend to show positive relationships", "tend to show null or positive relationships". 

-"This test has quite limited reliability". Personal taste, but I dislike adverbs or qualifying adjectives. Writing is clearer and stronger without them. ie. "This test has limited reliability."

-The first study was for something else. Maybe explain what this something else was or cite it

- Maybe cite your new intelligence test. And explain/cite how you used "an optimally chosen 50-item abbreviation" for the second sample. 

- Footnote 2 says "we removed both the effect of age on the central tendency and on the dispersion." I'm dumb but how did you remove the effect of age on dispersion? Calculated the standard deviation within each birth year or within bins of five years? Could use simple words for simple readers. Many readers, I expect, won't know what central tendency means. 

- Maybe give more detail on the ethnicity questions. ie. which groups got messed up in the second survey and which became "other". 

-related to the above. It might be useful to post the survey on an OSF page

- Table S1 is a little unclear. I'm guess demo_rsq is Rsquare with just demographic variables and linear_rsq is after IQ is controlled linearly? Maybe the names could be clarified or a footnote could do this to.

- endspan.". However... There are two fullstops here. Best to remove the second one. 

- "Two prior studies." Three, however are cited. One of which does not actually use polygenic scores, but only the within-family design. 

-"which were most shorted and less reliabiliy than the current study". Could change to "which were mostly short and had less reliability..."

 

Bot

Author has updated the submission to version #2

Author | Admin

Thank you for the detailed reviews. I have made many changes.

R2:

One can calculate correlations/slopes in various subsets to look for any region with a positive and significant association. This was added (Figure 5), though the best possible threshold yielded p = 0.08. How unsatisfactory.

I initially forgot to apply the attention checks for filtering. I have added these now, which reduced the sample size to 958. It made no difference to the results though.

R3:

I have fixed the writing mistakes.

I don't like squared terms, as this presumes to know the function form. The splines are more flexible.

The various item-level models show many different functions, so I did not try to summarize them all. The study is not sufficiently powered to detect reversals in the right tail, but the change in slope can certainly be detected.

Yes, there can be heteroscedasticity in tails, but we don't have enough power here to detect that I think.

I agree the evidence for reversal of the effect is not strong. I have modified the phrasing in various places.

I moved the meme to the appendix.

R4:

I've removed the use of the multivariate adaptive regression spline (MARS) algorithm. Instead, I found another spline method, thin plate regression, and used that as the robustness test. This comes with analytic confidence intervals, removing the need to implement a novel bootstrap method.

R1:

I've added analyses using 2- to 5-factor models. After 5, and arguably after 4, the factors became uninterpretable or due to method variance. The evidence for nonlinear effects of IQ are consisistent for the general factor from these 2-5 factor models too.

I'm not sure how to determine the reliability of a factor from the psych::fa fits. Best I could find was to compute omega(), with various numbers of sub-factors. Omega total was 0.90 for the 4-factor solution, and 0.91 for the 5-factor solution. Alpha was 0.88 for the 1-factor model. This was added.

Ludeke 2018 was a good find. I added this.

I made the claim regarding market support weaker (null to positive).

The first study is not yet published. I've cited the placeholder title.

One can remove the mean effect of age using OLS. Afterwards, one can remove the dispersion effect using squared or absolute values also using OLS. The resulting residuals have constant mean and variance across age.

I added the ethnic questions used in the second survey. The issue is with Asians, which in the first were split into South and East Asians.

I uploaded the surveys as exported from the survey tool.

I improved the wording for Table S1.

No, two dots are correct when one is inside the quote (indicating I am quoting a sentence in full), and the second dot marks the end of the sentence.

--

Many other wording changes were also made, hopefully for the better.

Reviewer | Admin

I recommend publication.

That's all I wanted to see. Recommend publication.