The Unz Review - Mobile
A Collection of Interesting, Important, and Controversial Perspectives Largely Excluded from the American Mainstream Media
 Announcements
Powerful Searching, Peter Frost, and Our First MSM Breakthrough
Email This Page to Someone

 Remember My Information



=>
Search Text Case Sensitive  Exact Words  Include Comments

A couple of days ago I finally completed integrating a very powerful new search technology into the website, providing both much greater flexibility and far greater speed and performance, while allowing almost unlimited room for future growth. Not only does the new system allow text searches of the 450,000 comments on the same footing as the 25,000 articles and posts, but could easily handle a million or even ten million such documents in the future.

Just as before, text searches may be filtered or restricted by Author, Topic, Category, Date Range, original Publication, or various other criteria, but users may now also choose whether or not to include the respective comments in their searches, or even restrict the search to the output of a particular commenter.

As a simple example of the usefulness of this powerful new system, here’s the results of a search for all the comments of a certain “gcochran” that contain the word “Neanderthal,” with these items probably containing a great deal of valuable scientific information. To the best of my knowledge, nothing like this search technology currently exists anywhere else on the Internet, even including the websites of such powerful media organizations as the NYT or the WSJ. Well over fifty million words of often impressive content material are now fully at everyone’s fingertips.

As the search example indicates, I am also very pleased to announce that Peter Frost, who has published a great deal of high-quality material over the years on his longtime personal anthropology blog Evo and Proud, has authorized The Review to republish his complete archives, including comments, a corpus that totals nearly a million and a half words, and we will be running his future science columns on an ongoing basis. I will have much more to say about this very valuable addition to our webzine in a forthcoming column.

We have also now republished the complete Internet archives of the notable writer Robert Bonomo, which contains a great deal of fascinating and controversial material, all now at everyone’s fingertips and fully searchable.

And as most readers are surely aware, our star blogger Steve Sailer scored a huge media coup two weeks ago by exposing the fact that world-renowned Marxist celebrity-academic Slovaj Zizek had plagiarized his review of Kevin MacDonald’s controversial books on Jews from the pages of American Renaissance, Jared Taylor’s White Nationalist publication. This astonishing juxtaposition of several bold-face ideological names drew the attention of the mainstream media, notably Newsweek, whose article received a remarkable 700-plus tweets, the sort of attention that would be an excellent outcome for a front-page story in The New York Times. Newsweek‘s coverage was soon followed by additional pieces in Slate, the Huffington Post, Gawker, and numerous other MSM publications. Certainly this constituted the biggest MSM breakthrough of our young publication to date, and exactly fulfilled the founding intent of this webzine, namely covering controversial ideas and individuals that the regular media tends to otherwise ignore.

Although implementing the new search technology occupied most of my time during the last week or two, I also added a number of small features to the website, including the capability to easily add bold, italics, or blockquote tags to comments via dedicated buttons, and following the excellent suggestion of a commenter, reduced the obtrusiveness of access to a commenter’s complete comment-archive by providing it as a link to the individual’s name.

As this last example indicates, I am always happy to receive complaints and suggestions from readers, though I cannot guarantee that I will necessarily implement them. So fire away.

Addendum:

I just added a couple of additional features to the Search module. The system now allows searches entirely based on words contained in the Title+Subtitle (just leave the main Search textbox blank). Also, Search results may be ordered by ascending or descending date, as well as relevance, though the last remains the default.

 
    []
  1. including the capability to easily add bold, italics, or blockquote tags to comments via dedicated buttons

    First I would like to express my gratitude for your excellent web site. Thank You!

    Is there a page or post that explains these new features?

    Thank’s – Honest John

    Read More
    ReplyAgree/Disagree/Etc.
    AgreeDisagreeLOLTroll
    These buttons register your public Agreement, Disagreement, Troll, or LOL with the selected comment. They are ONLY available to recent, frequent commenters who have saved their Name+Email using the 'Remember My Information' checkbox, and may also ONLY be used once per hour.
    Sharing Comment via Twitter
    /announcement/powerful-searching-peter-frost-and-our-first-msm-breakthrough/#comment-619037
    More... This Commenter Display All Comments
  2. “Please, sir, may I have a little more?”
    that is, a link or widget to Unz.org, an amazing and (I’m guessing) under-utilized treasure trove of pre-PC old white guys?
    Thanks!

    Read More
  3. SFG says:

    I do kind of wonder what your motivations are. You want to slow down the war machine? You’re annoyed at (y)our co-ethnics for forsaking meritocracy? You want to keep America the way it is? You find the idea of suppressed viewpoints fascinating? None unreasonable, and you may well have reasons for keeping your cards close to your chest, but I am curious.

    Read More
  4. Good work with the new search engine!

    Some suggestions:
    1.How about different background colors, something trivial as a background color you don’t like can put you off from a site.

    2. If you read a specific author you can easily click the next article, but there is no such option if you want to read all the authors.
    I would like to have an option where you can read them all in a row, and if possible to select the authors you want or don’t want to read.
    And it should remember the last site I read.

    Read More
  5. Anonymous says: • Disclaimer

    How about video content. A video of the day/week would do for now.

    Read More
  6. Sail On says:

    Ooooh, our fearless Sailer punked a commie!

    I guess this is the wrong time to ask for a Sailer-free portal, so I’ll settle for requesting the integration of /pgiraldi/ and /author/philip-giraldi/.

    Read More
  7. B and B says:

    Ron,
    Can you add more volumes to the Mankind Quarterly archives in the publications please?

    Read More
  8. wah wah says:

    Are you using MarkLogic for search? If not, that’s impressive and I bet the world would be grateful if you open-sourced it :). (blooming free-loaders that we be.)

    Read More
  9. Cool search feature.
    Since you’re having fun with technology as well as content, you might consider running latent dirichlet allocation on your corpus of articles. You can generate really useful concept trees and clusters in this way, and find hidden relationships you might not have thought of. I’ve never tried running it on a very large corpus, but I think the MALLET package should do it; I believe it’s been run on Wikipedia. Shucks, just running it on Steve’s comments would be interesting.

    Read More
  10. Svigor says:

    Thanks Ron, you’re a mensch. P.S., you’re on my list of Righteous Jews (I can’t always be foaming at the mouth, right?).

    Read More
  11. Ron,
    Thanks for giving easy access to the old comments from Steve’s blog. And especially for the particularly difficult case of my comments because of the way I indicated my name. I don’t want to ask for too much, but, at least in my case, it seems that you missed comments from 2009 and 2010. Perhaps that reflects some flaw in the system

    Read More
    • Replies: @Ron Unz
    I managed to locate another handful of your old "Anonymous" comments from iSteve and incorporated them (your commenting format had changed, explaining why I'd previously missed them). But almost none were from 2009 or 2010.

    Perhaps you could track down one or two of them, and provide links, so I can figure out why my filtering process isn't picking them up.


    Meanwhile, more generally, I've uploaded a new version of the software to the Live server, fixing a large number of minor bugs, and with luck not producing too many new ones.

    Also, this weekend, I migrated the website to a much more powerful server, one that should easily be able to handle 100x as much content material and traffic, providing a great deal of room for growth.

  12. Richard S says:

    Excellent, thank you you very much, Mr Unz! I’m particularly impressed by the scanned historic articles and reviews on this site. Invaluable historical sources. I love living in the future!

    Read More
  13. Richard S says:

    Sorry, I’ve just realised they’re 2 different websites – org and com. Lol, still excellent work for the public good!

    Read More
  14. Ron Unz says:
    @Robert Hume
    Ron,
    Thanks for giving easy access to the old comments from Steve's blog. And especially for the particularly difficult case of my comments because of the way I indicated my name. I don't want to ask for too much, but, at least in my case, it seems that you missed comments from 2009 and 2010. Perhaps that reflects some flaw in the system

    I managed to locate another handful of your old “Anonymous” comments from iSteve and incorporated them (your commenting format had changed, explaining why I’d previously missed them). But almost none were from 2009 or 2010.

    Perhaps you could track down one or two of them, and provide links, so I can figure out why my filtering process isn’t picking them up.

    Meanwhile, more generally, I’ve uploaded a new version of the software to the Live server, fixing a large number of minor bugs, and with luck not producing too many new ones.

    Also, this weekend, I migrated the website to a much more powerful server, one that should easily be able to handle 100x as much content material and traffic, providing a great deal of room for growth.

    Read More
  15. Sorry I don’t have any records of my own. I tried various search engines and here’s all I came up with: always on the UK version.

    http://isteve.blogspot.co.uk/2009/04/guest-commentary-on-rep-jane-harmans.html?m=1

    There were family health problems in 2009, 2010 maybe I didn’t comment much after all.

    Read More
  16. Sail On says:

    Thanks for fixing /pgiraldi/. It seems the same issue affects /pgottfried/.

    Read More
Current Commenter says:

Leave a Reply - Comments on articles more than two weeks old will be judged much more strictly on quality and tone


 Remember My InformationWhy?
 Email Replies to my Comment
Submitted comments become the property of The Unz Review and may be republished elsewhere at the sole discretion of the latter
Subscribe to This Comment Thread via RSS
Personal Classics
The major media overlooked Communist spies and Madoff’s fraud. What are they missing today?
Are elite university admissions based on meritocracy and diversity as claimed?
The unspoken statistical reality of urban crime over the last quarter century.
What Was John McCain's True Wartime Record in Vietnam?
What the facts tell us about a taboo subject
While other top brass played press agents for the administration’s war, William Odom told the truth about Iraq—though few listened.