Tech Quisling

GOOGLE IS CONDUCTING A SECRET “PERFORMANCE REVIEW” OF ITS CENSORED CHINA SEARCH PROJECT
By Ryan Gallagher

GOOGLE EXECUTIVES ARE carrying out a secret internal assessment of work on a censored search engine for China, The Intercept has learned.
A small group of top managers at the internet giant are conducting a “performance review” of the controversial effort to build the search platform, known as Dragonfly, which was designed to blacklist information about human rights, democracy, religion, and peaceful protest.
Performance reviews at Google are undertaken annually to evaluate employees’ output and development. 

They are usually carried out in an open, peer review-style process: Workers grade each other’s projects and the results are then assessed by management, who can reward employees with promotion if they are deemed ready to progress at the company.
In the case of Dragonfly, however, the peer review aspect has been removed, subverting the normal procedure. 

In a move described as highly unusual by two Google sources, executives set up a separate group of closed “review committees,” comprised of senior managers who had all previously been briefed about the China search engine.

The existence of the Dragonfly review committees has not been disclosed to rank-and-file Google employees, except for the few who have been evaluated by the committees because they worked on China search. 

Fewer than a dozen top managers at the company are said to be looped in on the review, which has involved studying documents and technical work related to Dragonfly.
“Management has decided to commit to keeping this stuff secret,” said a source with knowledge of the review. 

They are “holding any Dragonfly-specific documents out of [employees’] review tools, so that promotion is decided only by a committee that is read in on Dragonfly.”

Executives likely feared that following the normal, more open performance review process with Dragonfly would have allowed workers across the company to closely scrutinize it, according to two Google sources.
If some of the documents about Dragonfly had been made more widely accessible inside the company, according to the two sources, it would probably have led to further controversy about the project, which ignited furious protests and resignations after it was first exposed by The Intercept in August last year.
The decision to carry out the review in secret, however, is itself likely to stoke anger inside the company. 

During the protests over Dragonfly last year, a key complaint from employees was that the China plan lacked transparency and went against the company’s traditionally open workplace culture. 

Until it was publicly exposed, knowledge about Dragonfly had been restricted to a few hundred of Google’s 88,000 employees — around 0.35 percent of the total workforce.
Facing pressure from both inside and outside the company, Google CEO Sundar Pichai told his staff during an August crisis meeting that he would “definitely be transparent [about Dragonfly] as we get closer to actually having a plan of record. We definitely do plan to engage more and talk more.”
But Google employees told The Intercept this week that company bosses have consistently refused to provide them with information about Dragonfly — leaving them in the dark about the status of the project and the company’s broader plans for China.
Late last year, amid a firestorm of criticism, Google executives moved engineers away from working on the censored search engine and said publicly that there were no current plans to launch it. 

Earlier this month, however, The Intercept revealed that some Google employees were concerned that work on the censored search engine remained ongoing, as parts of the platform still appeared to be under development. 

Google subsequently denied that Dragonfly remained in progress, insisting in a statement that there was “no work being undertaken on such a project. Team members have moved to new projects.”

Google previously launched a search engine in China in 2006, but pulled out of the country in 2010, citing concerns about Chinese government interference. 

At that time, Google co-founder Sergey Brin said the decision to stop operating search in the country was principally about “opposing censorship and speaking out for the freedom of political dissent.”
Dragonfly represented a dramatic reversal of that position. 

The search engine, which Google planned to launch as an app for Android and iOS devices, was designed to comply with strict censorship rules imposed by China’s ruling Communist Party regime, enabling surveillance of people’s searches while also blocking thousands of terms, such as “Nobel prize,” “human rights,” and “student protest.”
More than 60 human rights groups and 22 U.S. lawmakers wrote to Google criticizing the project. 

In February, Amnesty International met with Google to reiterate its concerns about the China plan. “The lack of transparency around the development of Dragonfly is very disturbing,” Anna Bacciarelli, an Amnesty researcher, told The Intercept earlier this month. 

“We continue to call on Google’s CEO Sundar Pichai to publicly confirm that it has dropped Dragonfly for good, not just ‘for now.’”
Google did not respond to a request for comment.

Google’s censored search engine for China is sparking a moral crisis within the company

The company is cracking down on employees who are sharing details about it.
By Alexia Fernández Campbell
Google’s office in Gurugram, India, on September 7, 2018.
An internal battle is playing out at Google’s offices in Silicon Valley and around the globe.
After news leaked in August that the company was secretly developing a censored search engine for China, more than 1,400 employees have signed a letter demanding more transparency and accountability about the project’s potential impact on human rights. 

The controversy has reportedly prompted at least five Google employees to quit in protest.
Now Google is cracking down on employees who say the tool will also allow Chinese to closely track and monitor users.
The search engine under development, known as Dragonfly, is designed to hide search results that China’s authoritarian government wants to suppress, such as information about democracy, free speech, peaceful protest, and human rights, according to an investigation published in August by the Intercept.
Google executives have revealed little about the project, but a Google spokesperson told Vox in a statement Tuesday that “the work on search has been exploratory, and we are not close to launching a search product in China.”
The spokesperson declined to confirm or deny new details published this week by the Intercept that suggest that the project is far along in development — and much creepier than we knew. 

It’s sparking a moral crisis within the company that has yet to be addressed.

The search engine is a spying tool
In addition to hiding search results that the Chinese government wants to suppress, Google’s new search engine would also track a user’s location and would share an individual’s search history with a Chinese partner, who would have “unilateral access” to the data. 

This includes access to a user’s telephone number, according to an employee memo obtained last week by the Intercept.
The data would be available because the search engine would require Chinese users to download an app and log in with their personal information.
These alarming new details were outlined in a memo written by a Google engineer who was asked to work on the project and were posted in an internal chat room where employees have been voicing concerns about Dragonfly, according to the Intercept.
The new details seemed to confirm the worst fears of international human rights groups.
Amnesty International, Human Rights Watch, Reporters Without Borders, the Committee to Protect Journalists, and about a dozen other groups signed a letter in August, urging Google CEO Sundar Pichai to cancel the project. 

“As it stands, Google risks becoming complicit in the Chinese government’s repression of freedom of speech and human rights in China,” they wrote.
Google has not responded publicly to the claims in the engineer’s memo or the system’s potential use as a spying tool for the Chinese government. 

A spokesperson for Google declined to confirm or deny the reports on Tuesday and released this statement: “We’ve been investing for many years to help Chinese users, from developing Android, through mobile apps such as Google Translate and Files Go, and our developer tools. But our work on search has been exploratory, and we are not close to launching a search product in China.”
Instead of addressing employee concerns about the memo’s claims, Google leadership has cracked down on its own employees.
Here’s what happened, according to the Intercept’s Ryan Gallagher:
According to three sources familiar with the incident, Google leadership discovered the memo and were furious that secret details about the China censorship were being passed between employees who were not supposed to have any knowledge about it. 

Subsequently, Google human resources personnel emailed employees who were believed to have accessed or saved copies of the memo and ordered them to immediately delete it from their computers. 

Emails demanding deletion of the memo contained “pixel trackers” that notified human resource managers when their messages had been read, recipients determined.
If the memo is accurate, and if this was the company’s response, then Google’s moral crisis is far worse than many employees have described.

Google employees are pushing back against Dragonfly
Hundreds of people who work at the Silicon Valley tech giant are protesting the company’s decision to develop the censored search engine for Beijing.
About 1,400 Google employees — out of more than 88,000 — signed a letter to company executives in August, seeking more details and transparency about the project, and demanding employees get input on decisions about what kind of work Google takes on.
They also expressed concern that the company is violating its own ethical principles.
“Currently we do not have the information required to make ethically-informed decisions about our work, our projects, and our employment,” they wrote in the letter, obtained by the Intercept and the New York Times.
The existence of the censored search tool was revealed in early August by the Intercept, sparking outcry within the company’s ranks and drawing harsh criticism from human rights groups across the world. 

Internal documents leaked to journalists described how the app-based search platform could block internet users in China from seeing web pages that discuss human rights, peaceful protests, democracy, and other topics blacklisted by China’s authoritarian government.
Only a small group of Google engineers are reportedly developing the platform for Beijing, and information about the project has been so heavily guarded that until recently only a few hundred Google employees even knew about it.
The internal backlash among employees represents mounting concerns about whether Google has “lost its moral compass” in the corporate pursuit to enrich shareholders. 

But it also suggests, interestingly, that the people who make Google’s technology have more power in shaping corporate decisions than even shareholders.
In April, thousands of Google employees protested the company’s military contract with the Pentagon — known as project Maven — which developed technology to analyze drone video footage that could potentially identify and kill human targets.
About a dozen engineers resigned over what they viewed as an unethical use of artificial intelligence, prompting Google to let the contract expire in June and leading executives to promise that they would never use AI technology to harm others.
The fact that Google employees succeeded in forcing one of the most powerful companies in the world to put ethics before shareholder value is a remarkable feat in corporate America and signals why workers need an official voice in strategic decisions. 

Whether Google decides to drop its plan to help China censor information will be a test of how far that power extends.
At least five Google employees have reportedly resigned over the Dragonfly project, including a senior research scientist named Jack Poulson.
“Due to my conviction that dissent is fundamental to functioning democracies, I am forced to resign in order to avoid contributing to, or profiting from, the erosion of protections for dissidents,” Paulson wrote in his August resignation letter. 

“There is an all-too-real possibility that other nations will attempt to leverage our actions in China in order to demand our compliance with their security demands.”

For Google, doing business in China is good for shareholders, but possibly bad for humanity
It’s no mystery why Google executives want to do business with Chinese government officials: It’s profitable. 

With its population at 1.3 billion, China has the largest number of internet users in the world, so breaking into the Chinese market has been a long-time goal for Silicon Valley tech giants in their quest to find new users and to grow profits.
But working in China inevitably raises ethical issues for any US company. 

Doing business in mainland China means making deals with an authoritarian government that has a record of human rights abuses and strict suppression of speech.
Despite this, Silicon Valley tech companies have shown a willingness to put aside their idealism or rationalize their decisions to court Beijing. 

LinkedIn, for example, has a presence in China because it agreed to block online content.
Facebook is still banned in China, but chief executive Mark Zuckerberg has been trying to change that. 

In 2016, news surfaced that Facebook was building a censorship tool similar to Google’s Dragonfly project: It would allow a third-party to block certain Facebook posts in China in exchange for the government’s permission to operate the social media network there.
A backlash similar to the Dragonfly controversy ensued, raising concerns about the potential for government officials to use the platform to spy on dissidents and punish them. 

These concerns led several Facebook employees who worked on the project to resign. 

That project was in its early stages, too, and there’s no evidence that Facebook ever presented the tool to Chinese officials.
But Google’s decision to enter the Chinese market is more unnerving, for several reasons.
It’s a striking reversal of the strong stance the company took back in 2010, when it decided to leave China in protest of Chinese government hacking and its crackdown on free speech. 

The decision also seems at odds with Google’s once-prominent motto, “Don’t be evil.” 

It clashes with the principles the company adopted in June after the Pentagon contract controversy, in which Pichai promised that the company would not use artificial intelligence to develop technology “whose purpose contravenes widely accepted principles of international law and human rights.”
Google employees say these kinds of promises are no longer enough, in light of the news about the censorship tool, and they are demanding a more formal role in decisions about the ethical implications of their work.

The push to make employees corporate stakeholders
For the past few decades, rank-and-file workers have had no real influence in how public companies invest profits or make decisions about new revenue streams.
In keeping with modern American capitalism, many companies are driven by a singular vision: to bring value to the people who own company stock. 

Vox’s Matt Yglesias explains how this mentality plays out: Therefore, for executives to set aside shareholder profits in pursuit of some other goal like environmental protection, racial justice, community stability, or simple common decency would be a form of theft. 

If reformulating your product to be more addictive or less healthy increases sales, then it’s not only permissible but actually required to do so. 

If closing a profitable plant and outsourcing the work to a low-wage country could make your company even more profitable, then it’s the right thing to do.
While it’s true that CEOs are required by law to prioritize value to shareholders, that doesn’t necessarily mean they are required to make decisions guided only by what maximizes profits. 

The Supreme Court made this clear in its 2014 opinion in Burwell v. Hobby Lobby.
“Modern corporate law does not require for-profit corporations to pursue profit at the expense of everything else, and many do not,” the justices wrote in their opinion.
Momentum is starting to build to change this dynamic, by giving employees and consumers more power in corporate decision making.
Just last month, Sen. Elizabeth Warren (D-MA) introduced a bill that would require large public companies to make decisions not only based on how they would affect shareholders, but also on how they would affect consumers, employees and the communities where the company operates. 

The bill, titled the Accountable Capitalism Act, would also require corporations to allow employees to elect 40 percent of a company’s board of directors.
The idea behind the bill is to make sure that US corporations are decent citizens. 

That seems to be the same idea motivating Google employees to make more demands from their employer, which happens to be one of the most powerful companies in the world.

Google employees want a role in evaluating company projects
The response of Google employees to the company’s Dragonfly project for China gives us a glimpse of what might happen if workers had a more formal role in corporate decision making.
In their letter to executives, Google employees made four specific demands. 

First, they want the company to create a structure to allow rank-and-file employees to review ethical issues in company projects. 

Second, they want the company to appoint an ombudsman to oversee the ethics review process, with input from employees over who fills the position.
They also want a plan to ensure Google is transparent with employees about the purpose of the technology the company is developing, so employees can make informed choices about the ethical implications of the work they do. 

And they want the company to publish ethical assessments of their projects, such as Dragonfly, and to communicate regularly with employees about issues of concern.
So far, Google executives haven’t said publicly whether or not they will go along. 

Based on reports describing a staff meeting last month at the company’s California headquarters, the conversation about Dragonfly didn’t get that far.
But if Pichai and other executives do go along with the demands, it would certainly reflect a major shift in corporate priorities. 

And it would bolster a fundamental point in the debate: Employees are the ones who literally create value for shareholders, so they need to be on board with what they are creating.
Brandon Downey, a former Google engineer who says he regrets his role in helping develop the company’s first censored search tool in China (before the company stopped operating its search engine in the Chinese market in 2010), wrote a moving essay about what’s at stake:
Google is acting like a traditional company; one that squeezes every dime out of the marketplace, heedless of intangibles like principle, ethical cost, and even at the risk of the safety of its users. ...
If technology is a tool, then it means the people making that tool have a responsibility to curb their tool’s misuse by playing a role in the decisions on how it gets used. 

And if the people who are the leaders of the company don’t believe this, they should hear it in plainer and clearer terms: namely, you do not become one of the largest companies in the history of capitalism without the assistance of the workers making those tools.

Evil Tech

Google's China prototype links searches to phone numbers

By Christopher Carbone

How the Google search retrieves results is a closely guarded trade secret, but a few things are known about the mysterious algorithm.
Google built a prototype of a censored search engine for China that links users’ searches to their personal phone numbers—therefore making it easier for the Chinese government to monitor its citizens’ queries.
The app-based project, codenamed Dragonfly, also would remove content deemed sensitive by China’s authoritarian Communist Party regime, including information about freedom of speech, dissidents, peaceful protest and human rights, The Intercept reported.
Previously unknown details about Dragonfly included a censorship blacklist  compiled by Google that included terms such as “student protest” and “Nobel Prize” in Mandarin.
Human rights organizations have criticized Dragonfly and seven engineers resigned in protest over the lack of accountability and transparency for the controversial project.
“This is very problematic from a privacy point of view, because it would allow far more detailed tracking and profiling of people’s behavior,” Cynthia Wong, a senior internet researcher with Human Rights Watch, told The Intercept. 

“Linking searches to a phone number would make it much harder for people to avoid the kind of overreaching government surveillance that is pervasive in China.”
Fox News reached out to Google for comment and received the following statement from a spokesperson on Sunday:
“We've been investing for many years to help Chinese users, from developing Android, through mobile apps such as Google Translate and Files Go, and our developer tools. But our work on search has been exploratory, and we are not close to launching a search product in China.”
Back in August, more than a dozen human rights groups sent Google CEO Sundar Pichai a letter asking him to explain how Google was safeguarding Chinese users from censorship and surveillance.
The search giant told Fox News at the time that it had been “been investing for many years to help Chinese users, from developing Android, through mobile apps such as Google Translate and Files Go, and our developer tools. But our work on search has been exploratory, and we are not close to launching a search product in China.”

In 2010, Google announced it was leaving China, mentioning the Communist country’s censorship tactics as a reason for its decision.
However, Pichai has said that he wanted the world’s most-used search engine to be in China "serving" its 800 million Internet users.