Dreams Come True?

Oh man, that British election… early results are a disaster for the Tories. No time for analysis now, but I’ll try and type something up later. Until then, watch that link.


As I type this, at about 6AM on June 9th in Britain, the Conservatives sit at 307 seats. They need an additional 19 to earn a majority… yet there are only 18 up for grabs. Overall, they’ve lost 12 seats while their rivals the Labour party gained 30. That majority is lost, let alone the gain they wished would signal a mandate. The Scottish National Party has suffered major losses, but UKIP have been wiped out of parliament. The Liberal Democrats, a former powerhouse that’s fallen on hard times, have seen impressive gains. There’s a chance Labour could form a coalition and take control of government.

Add in the record number of women elected as MPs (192, out of 650), and this is a night for progressives to cheer. It’s not a perfect outcome, as Labour also want to leave the EU, but it’ll do nicely.

Rather than chew your ear off with further details, I’ll defer to H. Bomberguy‘s setup for the election.

Sometimes, Bugs are Inevitable

Good point:

“Hacking an election is hard, not because of technology — that’s surprisingly easy — but it’s hard to know what’s going to be effective,” said [Bruce] Schneier. “If you look at the last few elections, 2000 was decided in Florida, 2004 in Ohio, the most recent election in a couple counties in Michigan and Pennsylvania, so deciding exactly where to hack is really hard to know.”

But the system’s decentralization is also a vulnerability. There is no strong central government oversight of the election process or the acquisition of voting hardware or software. Likewise, voter registration, maintenance of voter rolls, and vote counting lack any effective national oversight. There is no single authority with the responsibility for safeguarding elections.

You run into this all the time when designing systems. One or more of the requirements are a dilemma, pitting one need against another. Ease-of-use vs. security, authentication vs. anonymity, you know the type. Fixing a bug related to that requirement may cause three more to pop up, and that may not be your fault. The US election system is tough to hack, because it’s a patchwork of incompatible systems; but it’s also easy to hack, because some patches are less secure than others and the borders between patches lack a clear, consistent interface. Solving this sort of problem usually means trashing the system and starting from scratch, with a long, extensive consultation session.

Oh yeah, and an NSA report provides evidence that Russia hacked some distance into US voting systems. The Intercept also outed their source, the reporters somehow forgot that all colour printers output a unique stenographic code while printing. That doesn’t speak highly of them, the practice is decades old, and they should have know this as the Intercept was founded on sharing sensitive documents.

[HJH 2017-06-19: A minor update here.]

Russian Hacking and Bayes’ Theorem, Part 2

I think I did a good job of laying out the core hypotheses last time, save two: the Iranian government or a disgruntled Democrat did it. I think I can pick them up on-the-fly, so let’s skip ahead to step 2.

The Priors

What’s the prior odds of the Kremlin hacking into the DNC and associated groups or people?
I’d say they’re pretty high. Right back to the Bolshevik revolution, Russian spy agencies have taken an interest in running disinformation campaigns. They have a word for gathering compromising information to blackmail people into doing their bidding, “kompromat.” Putin himself earned a favourable place in Boris Yeltsin’s government via some kompromat of one of Yeltsin’s opponents.
As for hacking elections, European intelligence agencies have also fingered Russia for using kompromat to interfere with elections in Germany, the Netherlands, Hungary, Georgia, and Ukraine.
That’s all well and good, but what about other actors? China also has sophisticated information warfare capabilities, but they seem more interested in trade secrets and tend to keep their discoveries under wraps. North Korea is a lot more splashy, but recently have focused on financial crimes. The Iranian government has apparently stepped up their online attack capabilities, and have a grudge against the USA, but apparently focus on infrastructure and disruption.
The DNC convention was rather contentious, with fans of Bernie Sanders bitter at how it turned out, and putting Trump in power had been preferred to voting for Clinton, for some, but it doesn’t fit the timeline: the DNC was suspicious of an attack in April, documents were leaked in June, but Sanders still had a chance of winning the nomination until the end of July.
An independent group is the real wild card, with any number of motivations and due to their lack of power eager to make it look like someone else did the deed.
What about the CIA or NSA? The latter claims to be just a passive listener, and I haven’t heard of anyone claiming otherwise. The CIA has a long history of interfering in other countries’ elections; in 1990’s Nicaragua, they even released documents to the media in order to smear a candidate they didn’t like. It’s one thing to muck around with other countries, however, as it’ll be nearly impossible for them to extradite you over for a proper trial. Muck around in your own country’s election, and there’s no shortage of reporters and prosecutors willing to go after you.
Where does all this get us? I’d say to a tier of prior likelihoods:
  • “The Kremlin did it” (A) and “Independent hackers did it” (D) have about the same prior.
  • “China,” (B) “North Korea,” (C) “Iran,” (H) and “the CIA” (E) are less likely than the prior two.
  • “the NSA” (F) and “disgruntled insider” (I) is less likely still.
  • And c’mon, I’m not nearly good enough to pull this off. (G)

The Evidence

I haven’t placed quantities to the priors, because the evidence side of things is pretty damning. Let’s take a specific example: the Cyrillic character set found in some of the leaked documents. We can both agree that this can be faked: switch around the keyboard layout, plant a few false names, and you’re done. Do it flawlessly and no-one will know otherwise.
But here’s the kicker: is there another hypothesis which is more likely than “the Kremlin did it,” on this bit of evidence? To focus on a specific case, is it more likely that an independent hacking group would leave Cyrillic characters and error messages in those documents than Russian hackers? This seems silly; an independent group could leave a false trail pointing to anyone, which dilutes the odds of them pointing the finger at a specific someone. Even if the independent group had a bias towards putting the blame on Russia, there’s still a chance they could finger someone else.
Put another way, a die numbered one through six could turn up a one when thrown, but a die with only ones on each face would be more likely to turn up a one. A one is always more likely from the second die. By the same token, even though it’s entirely plausible that an independent hacking group would switch their character sets, the evidence still provides better proof of Russian hacking.
What does evidence that points away from the Kremlin look like?

President Vladimir Putin says the Russian state has never been involved in hacking.

Speaking at a meeting with senior editors of leading international news agencies Thursday, Putin said that some individual “patriotic” hackers could mount some attacks amid the current cold spell in Russia’s relations with the West.
But he categorically insisted that “we don’t engage in that at the state level.”

Is this great evidence? Hell no, it’s entirely possible Putin is lying, and given the history of KGB and FSB it’s probable. But all that does is blunt the magnitude of the likelihoods, it doesn’t change their direction. By the same token, this ….
Intelligence agency leaders repeated their determination Thursday that only “the senior most officials” in Russia could have authorized recent hacks into Democratic National Committee and Clinton officials’ emails during the presidential election.
Director of National Intelligence James Clapper affirmed an Oct. 7 joint statement from 17 intelligence agencies that the Russian government directed the election interference…
….  counts as evidence in favour of the Kremlin being the culprit, even if you think James Clapper is a dirty rotten liar. Again, we can quibble over how much it shifts the balance, but no other hypothesis is more favoured by it.
We can carry on like this through a lot of the other evidence.
I can’t find anyone who’s suggested North Korea or the NSA did it. The consensus seems to point towards the Kremlin, and while there are scattered bits of evidence pointing elsewhere there isn’t a lot of credibility or analysis attached, and some of it is “anyone but Russia” instead of “group X,” which softens the gains made by other hypotheses.
The net result is that the already-strong priors for “the Kremlin did it” combine with the direction the evidence points in, and favour that hypothesis even more. How strongly it favours that hypothesis depends on how you weight the evidence, but you have to do some wild contortions to put another hypothesis ahead of it. A qualitative analysis is all we need.
Now, to some people this isn’t good enough. I’ve got two objections to deal with, one from Sam Biddle over at The Intercept, and another from Marcus Ranum at stderr. Part three, anyone?

The Monkey’s Climate Agreement

This must have seemed like an excellent idea to Trump.

I am fighting every day for the great people of this country. Therefore, in order to fulfill my solemn duty to protect America and its citizens, the United States will withdraw from the Paris Climate Accord.

(APPLAUSE)

Thank you. Thank you.

But begin negotiations to re-enter, either the Paris Accord or in, really entirely new transaction on terms that are fair to the United States, its businesses, its workers, its people, its taxpayers. So we’re getting out. But will we start to negotiate and we will see if we can make a deal that’s fair. And if we can, that’s great. And if we can’t, that’s fine.

It distracts from the ongoing Russia scandal, and it’s a move which will earn favour from many Republicans. But there’s also good reason to think it won’t have the effect Trump hopes for.

For one, the USA has been very successful at watering down past climate agreements.

When aggressively lobbying to weaken the Paris accord, U.S. negotiators usually argued that anything stronger would be blocked by the Republican-controlled House and Senate. And that was probably true. But some of the weakening — particularly those measures focused on equity between rich and poor nations — was pursued mainly out of habit, because looking after U.S. corporate interests is what the United States does in international negotiations.

Whatever the reasons, the end result was an agreement that has a decent temperature target, and an excruciatingly weak and half-assed plan for reaching it.

If the US withdraws from climate talks, as seems likely despite Trump’s “renegotiation” line, the US delegation won’t be at the table. And with China now in full support of taking action, India pushing for aggressive targets, and even Canada still willing to stick with the Paris agreement, there’s no one left to step on the brakes. Future climate change agreements will be more aggressive.

They might also carry penalties for non-signing nations. There are only three countries who didn’t sign the Paris agreement: Nicaragua didn’t sign because the agreement didn’t go far enough, Syria had been diplomatically isolated so they weren’t even invited to the table, and the US refused to even submit it for ratification by Congress. Yes, the US is a major player in world financial markets, but its dwarfed by the output of the rest of the world. If the globe agreed to impose a carbon tax on non-signing nations, the US could do little to push back.

Even if the rest of the world doesn’t have the appetite for that route, there are more creative kinds of penalties.

Calling the President’s decision “a mistake” for the US as well as the planet, [French President] Macron urged climate change scientists, engineers and entrepreneurs to go to France to continue their work. “They will find in France a second homeland,” Mr Macron said. “I call on them,” he added. “Come and work here with us, work together on concrete solutions for our climate, our environment. I can assure you, France will not give up the fight.”

Climate change has become the one thing the international community could reach a consensus on. Pulling from the Paris agreement was like kicking a puppy; regardless of the intent or circumstances, it’s an action the world can unite against. It makes for a convenient excuse to isolate the US or play hardball, much more so than any boorish behaviour by Trump.

It also won’t stop the US from following the Paris agreement anyway.

Representatives of American cities, states and companies are preparing to submit a plan to the United Nations pledging to meet the United States’ greenhouse gas emissions targets under the Paris climate accord, despite President Trump’s decision to withdraw from the agreement.

The unnamed group — which, so far, includes 30 mayors, three governors, more than 80 university presidents and more than 100 businesses — is negotiating with the United Nations to have its submission accepted alongside contributions to the Paris climate deal by other nations.

“We’re going to do everything America would have done if it had stayed committed,” Michael Bloomberg, the former New York City mayor who is coordinating the effort, said in an interview. […]

“The electric jolt of the last 48 hours is accelerating this process that was already underway,” said Mr. Orr, who is now dean of the School of Public Policy at the University of Maryland. “It’s not just the volume of actors that is increasing, it’s that they are starting to coordinate in a much more integral way.”

Various US states, municipalities, universities, businesses, and even the military have been working towards cutting emissions for years without waiting for the federal government to get its act in order. A national policy would be more effective, but these piecemeal efforts have substantial force behind them and look to be gaining even more.

Finally, the boost this move earns from his supporters may get cancelled out by backlash from everyone else.

It’s also possible that Trump gave a win to his base on an issue they don’t care that much about while angering the opposition on an issue they do care about. Gallup and Pew Research Center polls indicate that global warming and fighting climate change have become higher priorities for Democrats over the past year. … As we wrote earlier, if Trump’s voters view the Paris withdrawal as an economic move, he’ll likely reap some political benefit from it. If, however, it’s viewed as mostly having to do with climate change, perhaps Trump won’t see much gain with his base. Jobs, the economy and health care rate as top issues for Republicans, but climate change and the environment do not, so it’s hard to know how Trump voters would weigh the president doing something they don’t like on an issue they care a lot about (the GOP health care bill) against him doing something they do like on an issue they don’t care much about (withdrawing from Paris).

This may have looked like an easy win for Trump, but the reality could be anything from a weak victory to a solid defeat. Time will tell, as it always does.

Russian Hacking and Bayes’ Theorem, Part 1

I’m a bit of an oddity on this network, as I’m pretty convinced Russia was behind the DNC email hack. I know both Mano Singham and Marcus Ranum suspect someone else is responsible, last I checked, and Myers might lean that way too. Looking around, though, I don’t think anyone’s made the case in favor of Russian hacking. I might as well use it as an excuse to walk everyone through using Bayes’ Theorem in an informal setting.

(Spoiler alert: it’s the exact same method we’d use in a formal setting, but with more approximations and qualitative responses.)

[Read more…]

Journal Club 1: Gender Studies

Last time, I pointed out that within the Boghossian/Lindsay kerfuffle no-one was explaining how you could falsify gender studies. As I’ve read more and more of those criticisms, I’ve noticed another omission: what the heck is in a gender studies journal? The original paper only makes sense if it closely mirrors what you’d find in a relevant journal.

So let’s abuse my academic access to pop open the cover of one such journal.

Gender & Society, the official journal of Sociologists for Women in Society, is a top-ranked journal in sociology and women’s studies and publishes less than 10% of all papers submitted to it. Articles analyze gender and gendered processes in interactions, organizations, societies, and global and transnational spaces. The journal publishes empirical articles, along with reviews of books.

They also happened to be at the top of one list of gender studies journals. I’ll go with their latest edition as of this typing, volume 31 issue 3, which is dated June 2017.

[Read more…]

About Damn Time

Ask me to name the graph that annoys me the most, and I’ll point to this one.538's graph of Trump's popularity, as of May 25th, 2017.

Yes, Trump entered his presidency as the least liked in modern history, but he’s repeatedly interfered with Russian-related investigations and admitted he did it to save his butt. That’s a Watergate-level scandal, yet his approval numbers have barely changed. He’s also pushed a much-hated healthcare reform bill, been defeated multiple times in court, tried to inch away from his wall pledge, and in general repeatedly angered his base. His approval ratings should be negative by now, but because the US is so polarized many conservatives are clinging to him anyway.

A widely held tenet of the current conventional wisdom is that while President Trump might not be popular overall, he has a high floor on his support. Trump’s sizable and enthusiastic base — perhaps 35 to 40 percent of the country — won’t abandon him any time soon, the theory goes, and they don’t necessarily care about some of the controversies that the “mainstream media” treats as game-changing developments. […]

But the theory isn’t supported by the evidence. To the contrary, Trump’s base seems to be eroding. There’s been a considerable decline in the number of Americans who strongly approve of Trump, from a peak of around 30 percent in February to just 21 or 22 percent of the electorate now. (The decline in Trump’s strong approval ratings is larger than the overall decline in his approval ratings, in fact.) Far from having unconditional love from his base, Trump has already lost almost a third of his strong support. And voters who strongly disapprove of Trump outnumber those who strongly approve of him by about a 2-to-1 ratio, which could presage an “enthusiasm gap” that works against Trump at the midterms. The data suggests, in particular, that the GOP’s initial attempt (and failure) in March to pass its unpopular health care bill may have cost Trump with his core supporters.

At long last, Donald Trump’s base appears to be shrinking. This raises the chances of impeachment, and will put tremendous pressure on Republicans to abandon Trump to preserve their midterm majority. I’m pissed the cause appears to be health care, and not the shady Russian ties or bad behavior, but doing the right thing for the wrong reason is still doing the right thing. It also fits in nicely with current events.

According to the forecast released Wednesday by the nonpartisan Congressional Budget Office, 14 million fewer people would have health insurance next year under the Republican bill, increasing to a total of 19 million in 2020. By 2026, a total of 51 million people would be uninsured, roughly 28 million more than under Obamacare. That is roughly equivalent to the loss in coverage under the first version of the bill, which failed to pass the House of Representatives.

Much of the loss in coverage would be due to the Republican plan to shrink the eligibility for Medicaid; for many others—particularly those with preexisting conditions living in certain states—healthcare on the open marketplace would become unaffordable. Some of the loss would be due to individuals choosing not to get coverage.

The Republican bill, dubbed the American Health Care Act, would also raise insurance premiums by an average of 20 percent in 2018 compared with Obamacare, according to the CBO, and an additional 5 percent in 2019, before premiums start to drop.

So keep an eye on Montana’s special election (I’m writing this before results have come in); if the pattern repeats from previous special elections, Republicans will face a huge loss during the 2018 midterms, robbing Trump of much of his power and allowing the various investigations against him to pick up more steam.

Finding Her Voice

Have you ever heard of a cool scientific paper, went out to find yourself a copy, and been frustrated to find no trace of it? I’ve been there for years for one particular paper, until I got lucky.

Cutler, Anne, and Donia R. Scott. “Speaker Sex and Perceived Apportionment of Talk.” Applied Psycholinguistics 11, no. 03 (1990): 253–272.
I’m sure you’ve heard the stereotype that women talk excessively. A number of studies have actually sat down and counter total talking time, only to find that men tend to be the blabbermouths. What gives?
An alternative suggestion is more complex and may rely on a difference in content between men’s and women’s speech. Kramer (1975) and Spender (1980) suggested that women are undervalued in society, and as a consequence women’s speech is undervalued – female contributions to conversation are overestimated because they are held to have gone on “too long” relative to what female speakers are held to deserve. Preisler (1986) similarly argued that evaluation of women’s speech is a function of (under)evaluation of the social roles most usually fulfilled by women.
The former explanation suggests that overestimation of women’s conversational contributions is a perceptual bias effect that should be reproducible in the laboratory simply by asking listeners to judge amount of talk produced by male and female speakers, even if content of the talk is controlled. [pg. 255]
So Anne Cutler and the other authors tested that by having the standard reference human listen to excerpts from plays, where both speaking roles said about the same number of words. The sex was varied, of course.
In single-sex conversations, female and male first speakers received almost identical ratings (49.5% and 50%, respectively), but in mixed-sex conversations, female speakers were judged to be talking more (55.2%), male speakers to be talking less (47.8%). Although the number of words spoken was identical for each column, listeners believed that in mixed-sex conversations, females spoke more and males spoke less.

In fact, three of these mean ratings are actually underestimates, since the true mean first speaker contribution across all four dialogues was 53.7%. ….

The interaction of speaker sex with whether the dialogue was mixed- or single-sex was significant in both analyses … There was also a main effect of speaker
sex, with female speakers’ contributions being overestimated, but male speakers’ contributions being underestimated relative to the actual number of words spoken. [pg. 259-260]
What’s interesting is that when people were asked to guess the sex of each role, handed nothing more than the script, men and women sometimes differed.
When a part was not particularly sex-marked (Dialogue 1), females speaking it were judged to have said more than males speaking it. When a part was marked as female for male and for female subjects alike (Dialogue 2), the same effect was found. When, however, a part was marked as female for male subjects only (Dialogue 3), only male subjects showed the effect; and when a part was marked as female for female subjects only (Dialogue 4), only female subjects showed any effect. [pg. 268]
Unfortunately, this muddied up the conclusions a bit. And I do have other issues with the paper, primarily in their use of p-values, but I think the findings rise above it. They also fit nicely into the existing body of work on sexism and speech.
These behaviors, the interrupting and the over-talking, also happen as the result of difference in status, but gender rules. For example, male doctors invariably interrupt patients when they speak, especially female patients but patients rarely interrupt doctors in return. Unless the doctor is a woman. When that is the case, she interrupts far less and is herself interrupted more. This is also true of senior managers in the workplace. Male bosses are not frequently talked over or stopped by those working for them, especially if they are women; however, female bosses are routinely interrupted by their male subordinates.

What can we do to raise women’s voices? Maybe technology can help.

Gender Timer is the app that measures the talk times between the sexes. It is used to raise awareness and generate discussion about how airtime looks in practice. The aim is to ultimately develop your organization and its meeting culture.

Available on Android and iPhone.

Daryl Bem and the Replication Crisis

I’m disappointed I don’t see more recognition of this.

If one had to choose a single moment that set off the “replication crisis” in psychology—an event that nudged the discipline into its present and anarchic state, where even textbook findings have been cast in doubt—this might be it: the publication, in early 2011, of Daryl Bem’s experiments on second sight.

I’ve actually done a long blog post series on the topic, but in brief: Daryl Bem was convinced that precognition existed. To put these beliefs to the test, he had subjects try to predict an image that was randomly generated by a computer. Over eight experiments, he found that they could indeed do better than chance. You might think that Bem is a kook, and you’d be right.

But Bem is also a scientist.

Now he would return to JPSP [the Journal of Personality and Social Psychology] with the most amazing research he’d ever done—that anyone had ever done, perhaps. It would be the capstone to what had already been a historic 50-year career.

Having served for a time as an associate editor of JPSP, Bem knew his methods would be up to snuff. With about 100 subjects in each experiment, his sample sizes were large. He’d used only the most conventional statistical analyses. He’d double- and triple-checked to make sure there were no glitches in the randomization of his stimuli. Even with all that extra care, Bem would not have dared to send in such a controversial finding had he not been able to replicate the results in his lab, and replicate them again, and then replicate them five more times. His finished paper lists nine separate ministudies of ESP. Eight of those returned the same effect.

One way to attack an argument is to merely follow its logic. If you can find it leads to an absurd conclusion, the argument must have been flawed even if you cannot find the flaw. Bem had inadvertently discovered a “reductio ad absurdum” argument against contemporary scientific practice: if proper scientific procedure can prove ESP exists, proper scientific procedure must be broken.

Meanwhile, at the conference in Berlin, [E.J.] Wagenmakers finally managed to get through Bem’s paper. “I was shocked,” he says. “The paper made it clear that just by doing things the regular way, you could find just about anything.”

On the train back to Amsterdam, Wagenmakers drafted a rebuttal, to be published in JPSP alongside the original research. The problems he saw in Bem’s paper were not particular to paranormal research. “Something is deeply wrong with the way experimental psychologists design their studies and report their statistical results,” Wagenmakers wrote. “We hope the Bem article will become a signpost for change, a writing on the wall: Psychologists must change the way they analyze their data.”

Slate has a long read up on the current replication crisis, and how it links to Bem. It’s aimed at a lay audience and highly readable; I recommend giving it a click.