Correcting the bad reporting

I complained about the credulous media coverage of the so-called landmark success at the Turing test yesterday. That was the first flush of press release regurgitation; fortunately, there’s been a strong rebound of sensible journalism now. Gary Marcus talks about failing the Turing test, Scott Aaronson has a chat with Eugene Goostman, and Mike Masnick really rips it a new one.

Oh, and the biggest red flag of all. The event was organized by Kevin Warwick at Reading University. If you’ve spent any time at all in the tech world, you should automatically have red flags raised around that name. Warwick is somewhat infamous for his ridiculous claims to the press, which gullible reporters repeat without question. He’s been doing it for decades. All the way back in 2000, we were writing about all the ridiculous press he got for claiming to be the world’s first "cyborg" for implanting a chip in his arm. There was even a — since taken down — Kevin Warwick Watch website that mocked and categorized all of his media appearances in which gullible reporters simply repeated all of his nutty claims. Warwick had gone quiet for a while, but back in 2010, we wrote about how his lab was getting bogus press for claiming to have "the first human infected with a computer virus." The Register has rightly referred to Warwick as both "Captain Cyborg" and a "media strumpet" and has long been chronicling his escapades in exaggerating bogus stories about the intersection of humans and computers for many, many years.

This is what has happened to journalism: the competent get fired to make room for cheap hacks who can disgorge press releases without thinking, and the qualified experts have to follow along behind, sweeping up the crap.

Media fails to pass the Turing test

I don’t get it — there are news reports everywhere credulously claiming that the Turing Test has been successfully passed, and they are all saying exactly the same thing: that over 30% of the judges couldn’t tell that a program called Eugene Goostman wasn’t a 13 year old boy from Odessa with limited language skills. We’re not hearing much about the judges, though: the most common thing to report is that one of them was actor Robert Llewellyn, who played robot Kryten in the sci-fi comedy TV series Red Dwarf.

Instead of parroting press releases, it seems to me that the actual result should be reported as a minority of poorly qualified judges in a single media-driven event were trivially fooled by a clumsy chatbot with a background story to excuse its bad grammar and flighty behavior into thinking they were talking to a real person. It’s not so much a validation of the capabilities of an AI as it is an indictment of the superficiality of this test, as implemented.

Or, if an editor really wanted a short, punchy, sensationalist title, they have permission to steal mine.

We don’t yet have transcripts of the conversation, but the text of a 2012 test of the same program are available. They are painfully unimpressive.

Get ’em young

I got to meet someone in Seattle who is working on an evolution book for four year olds — this is a great idea, because I remember shopping for kids’ books and their usual idea for introducing zoology was something about Noah’s Ark. But the real story is so much more interesting!

Rough sketches of the book, Grandmother Fish, are available online; those aren’t the final drawings, and the work will be done by KE Lewis, once funding is obtained. You can see the challenges of getting a sophisticated scientific concept across to very young children, but I think the current story does the job very well.

squeak

There will be a kickstarter later this week to get the project off the ground.

Albert Einstein was not your prophet

This photo has been making the rounds for a while — it’s garbage, Snopes suggests that there is no corroboration for the quote, and the commenters agreeing with the sentiment are idiots. Who are using technology to talk about it.

fakeeinsteinquote

I look at that bottom photo and see five women interacting intensely with a larger circle of human beings than just that one little clump right there — and they could very well be talking to people world-wide. I see technology as an enabler and enhancer of communication.

I look at the top photo and see an authoritarian jerk behind it, who thinks putting their words into the mouth of a famous scientist lends their opinion greater authority. It doesn’t. It’s also kind of unfair to poor old Albert.

A clusterfk

In an interesting discussion of the genetic structure of human populations, Jeremy Yoder weighs in on Nicholas Wade’s little book of racism.

So with all due respct to Sewall Wright, modern genetic data pretty clearly show that if aliens arrived tomorrow and started sequencing the DNA of planet Earth, they would probably not sort Homo sapiens into multiple genetic subspecies. It is true that people from different geographic locations look different—and we have known that these visible differences have a genetic basis since the first time distant tribes met and interbred. But that interbreeding, and our drive to explore and settle the world, have maintained genetic ties among human populations all the way back to the origin of our species.

As the evolutionary anthropologist Holly Dunsworth notes in her discussion of A Troublesome Inheritance, whether you choose to focus on the visible differences among human populations, or on those deep and ancient genetic ties, comes largely down to a matter of personal inclination. Knowing what I do of evolutionary genetics, and of how our judgments about the visible differences among human populations have shifted over time, I’m far more inclined to think that the social, economic, and cultural differences among human societies are products not of our genes, but of how we treat each other.

Wade’s inclinations are, quite obviously, different from mine. However, comparing Wade’s claims to the scientific work he cites, I find it hard to conclude that we are simply looking at the same data with different perspectives. Time and again, data that refutes his arguments is not only available and widely cited in the population genetics literature—it is often in the text of the papers listed in his endnotes.

By the way, Wade has responded to various criticisms. I would not have thought he could dig himself any deeper, but he succeeded.

Despite their confident assertions that I have misrepresented the science, which I’ve been writing about for years in a major newspaper, none of these authors has any standing in statistical genetics, the relevant discipline. Raff is a postdoctoral student in genetics and anthropology. Fuentes and Marks are both anthropologists who, to judge by their webpages, do little primary research. Most of their recent publications are reviews or essays, many of them about race. Their academic reputations, not exactly outsize to begin with, might shrink substantially if their view that race had no biological basis were to be widely repudiated. Both therefore have a strong personal interest (though neither thought it worth declaring to the reader) in attempting to trash my book.

Holy crap. Nicholas Wade is a journalist who has no standing in any field of biology, and his criticism is that those who have repudiated his book aren’t experts in the very narrow and specific subfield of biology that he has deemed the only one of importance? And that they’ve only published scholarly reviews in science journals, rather than in the primary literature? You know that publishing a tertiary summary in a mass-market newspaper would have far less credibility to scientists, right, especially with Wade’s penchant for getting the science wrong?

Getting a Ph.D. is only the start of a scientific career — scientists spend their whole lives learning and exploring new ideas (that’s why it’s a little weird to see people getting multiple Ph.D.s — it’s really not necessary. Once you’ve got one, you’ve got the tools to be a scholar.) My grad school advisor started out his career with a degree in immunology, and drifted towards neuroscience, and then development, and then genetics as his career progressed — it would be really weird to judge his work as just an immunologist.

Scientists get trained in thinking scientifically more than anything else — something that Nicholas Wade missed.