The Unz Review: An Alternative Media Selection
A Collection of Interesting, Important, and Controversial Perspectives Largely Excluded from the American Mainstream Media
 BlogviewJames Thompson Archive
Can Tests Predict Academic Outcomes?
🔊 Listen RSS
Email This Page to Someone

 Remember My Information



=>

Bookmark Toggle AllToCAdd to LibraryRemove from Library • BShow CommentNext New CommentNext New ReplyRead More
ReplyAgree/Disagree/Etc. More... This Commenter This Thread Hide Thread Display All Comments
AgreeDisagreeThanksLOLTroll
These buttons register your public Agreement, Disagreement, Thanks, LOL, or Troll with the selected comment. They are ONLY available to recent, frequent commenters who have saved their Name+Email using the 'Remember My Information' checkbox, and may also ONLY be used three times during any eight hour period.
Ignore Commenter Follow Commenter
Search Text Case Sensitive  Exact Words  Include Comments
List of Bookmarks

http://www.isironline.org/isir-2015-invited-address-paul-sackett-nathan-kuncel/

Paul Sackett and Nathan Kuncel cover a lot of ground in this talk, and slay a lot of dragons as well. Test bias, critical thinking, tests of rationality, the idea that once you have basic intelligence higher scores don’t contribute anything more: all those sorts of beasts.

A distinguished member of the audience commented to me at the time: Paul Sackett and Nathan Kuncel utterly destroyed the idea that SAT tests do not predict college performance. Their “ginormous” dataset comprised over a million students. A droll and data rich talk, they left myths about the non-utility of standardised tests lying like road-kill on the highway of evidence.

The link is above, but here are their conclusions:

Tests predict academic performance

The final point is somewhat obscured by their modesty: they have ginormous data sets (1.2 million students), which they analyse very carefully, looking at many confounding variables. Clever sillies who want to muddy the water can always find a small sample to prove anything they want. A more dependable picture emerges from the collation and evaluation of the available literature, graded for quality.

Here is a typical example of a clever silly being “lawyerly” rather than scholarly:

image

Psychology will never get anywhere if this sort of courtroom science is given any credence.

Colleges and schools are prone to the “rubber ruler” distortion: academic scores for easy subjects boost apparent ability, so corrections have to be made for the difficulty of courses. Academic performance measures often conflate exam results with attendance scores (and even credits for taking part in experiments). The purer the measure of academic ability, the more powerfully it can be predicted by good admission tests.

Sackett and Kuncel are good grinders and polishers, flicking away the dust to get to the polished steel. They know their data, and handle it with aplomb. By doing so they demolish lots of popular delusions.

Their talk is worth watching in its own right but also because they only take 45 minutes, which gives time for the audience to ask questions, and this gives you a look at some of the key researchers in the field, and an insight into their interests and opinions.

(Republished from Psychological Comments by permission of author or representative)
 
• Category: Science 
Hide 4 CommentsLeave a Comment
Commenters to Ignore...to FollowEndorsed Only
Trim Comments?
    []
  1. panjoomby says: • Website

    thank you – that was awesome! especially the first 25 minutes – superb!
    thanks to you i just joined ISIR, so you should be receiving your cut soon:)

    • Replies: @James Thompson
  2. @panjoomby

    The society is enriched, in all senses.

  3. Anonymous • Disclaimer says:

    "road-kill on the highway of evidence"

    It doesn't get any better than this.

  4. Jim says:

    It's difficult enough to find the truth when one wants to. In this case many people don't want to find the truth.

Current Commenter
says:

Leave a Reply - Comments on articles more than two weeks old will be judged much more strictly on quality and tone


 Remember My InformationWhy?
 Email Replies to my Comment
Submitted comments have been licensed to The Unz Review and may be republished elsewhere at the sole discretion of the latter
Subscribe to This Comment Thread via RSS Subscribe to All James Thompson Comments via RSS