Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I've had Richard Stallman personally lambaste me for unethical behavior, namely by not quitting my job at Apple because he disagreed with Apple's behavior.

While I agree that ethics are important, there are people who will use ethics-like arguments to manipulate you.

I make shooter video games. Is that a bad thing? According to some people I'm evil. I've written software that people used to write software that people used to kill people, is that okay?

Saying, "We gotta follow ethics" is great stuff, but I'm unwilling to be used.



I'm sympathetic to the broad point your making, but your example isn't very good:

> I make shooter video games. Is that a bad thing? According to some people I'm evil.

If you thought that shooter video games were bad and you built them anyway, that would be poor ethics. That other people think shooter video games are evil isn't what matters; it's what you think that matters.


The essence is that the people who built the unethical NSA tools most likely did not consider the things they did unethical, so calling on people to be ethical as a response to the NSA leaks only work if "ethical" is understood as "you can't build surveillance tools for the NSA even if you personally believe it's ethical".


There are roughly two sorts of people to consider here. The people who agree that the project they are working on is unethical (or would agree if they stopped to think about it), and the people who honestly believe that their work is ethical.

Obviously when we tell engineers to consider the ethical implications of the project that they are working on, we are talking to the first group (particularly the parenthesized subgroup). The people who believe their work is unethical won't stop working on it just because we disagree, but that should not discourage us from encouraging people to grow a spine and not work on projects that they have ethical objections to.

For people in the second group, we can work with alternative techniques. One possibility is socially ostracizing and blacklisting people who continue to work on unethical projects. (As discussed at some length on HN three or so weeks ago: https://news.ycombinator.com/item?id=6714585)


I think these debates tend to dramatically overemphasize the size of group one, to the point of being misanthropic ("grow a spine"?). A fundamental fact of life is that people have vastly diverging belief systems and that those in the ivory tower don't always know what's right or best.

There's a tangential group to this, which are the people who work on something they don't consider unethical, but may change their minds when they learn the true scale of what they are part of (it's unlikely many people in the NSA outside the very top have full visibility on all the programs detailed in the Snowdon leaks, and it's very possible that each, viewed in isolation and with the right context can be quite defensible).

The second suggestion overemphases just how attractive hanging out with judgmental purists actually is. Today it's NSA, tomorrow it's people who work on social gaming, the day after it's finance and the next it's ads. These sectors are already shunned by (some? large? At least they're vocal.) parts of the tech community that considers themselves and their endeavours morally superior, yet they thrive just fine.


Hm.

The NSA is different from all your other examples, though. Finance, social gaming, ads and pretty much everything else is or can be regulated by the rule of law.

Intelligence agencies cannot.

There is no precedent of a surveillance society that managed to keep from turning authoritarian. Why should anybody assume that this time is different?


Of course intelligence agencies can, should be and are regulated by law. Sometimes they manipulate the law in their favour and sometimes they break it, but so do the other fields, most notably finance.

But more importantly, law and ethics are not the same thing. Merely not breaking the law does not make you an ethical person (and that's not the point of the law). Conversely, breaking some laws under some circumstances does not make you an unethical person.


> "I think these debates tend to dramatically overemphasize the size of group one, to the point of being misanthropic ("grow a spine"?). A fundamental fact of life is that people have vastly diverging belief systems and that those in the ivory tower don't always know what's right or best."

You seem to have not fully read my comment, or misinterpreted it.

I am not telling people who consider their (in my opinion, unethical) work to be ethical to grow a spine. Disagreeing with with other people, even me, on matters of ethics does not imply that somebody is spineless.

Performing a job that you consider unethical makes you spineless.

I am telling people to act on their own assessment of their work. Frankly I shouldn't even need to tell people that, it is practically tautological how common sense it is.


The quoted line is more responding to your second paragraph, not your first: "Obviously when we tell engineers to consider the ethical implications of the project that they are working on, we are talking to the first group"

No, I think when "we" tell engineers that, we're addressing a straw-man, posturing and showing off our superior ethics. Imagining that there's an audience of engineers who just need to be told that what they're doing is unethical is vain.


The "first group" refers to "The people who agree that the project they are working on is unethical".

Telling people to, in essence, 'follow their heart' and do what they think is right is not "posturing and showing off our superior ethics". If they think that their work is unethical, then they should not do it.

The third paragraph is the paragraph that endorses posturing and showing off our superior ethics.


var allHackersHaveSamePoliticalBeliefs=FALSE;

while (! allHackersHaveSamePoliticalBeliefs) {

  // Should randomize topics NSA, Snowden, Wikileaks, US Govt, US Military

  postPoliticalStoryToHackerNews(); 

  sleep(1_DAY);

}


> so calling on people to be ethical as a response to the NSA leaks only work if "ethical" is understood as "you can't build surveillance tools for the NSA..."

It also works if enough other people believe it. For example, the medical doctors who helped design torture at Guantanamo. Would you join a practice with them? Allow them to admit to your hospital?


I'll bet all those NSA tools are all running on Linux. Linux is a tool. Is Linus ethical?


Merely making a tool that is used in an atrocity is traditionally not enough to condemn a toolmaker.

Consider the extraordinarily extreme case of Bruno Tesch. He was hung because he provided his pesticide for the express purpose of killing humans, knowing that this is what it was for. This was evidenced by the sale of the pesticide without the standard warning odorant, and witness testimony. Conversely, I am unaware of anybody that was hung for manufacturing train cars.

An NSA employee may claim ignorance, and assert that they were told the systems they helped develop were only to be used for legal and ethical purposes. If this is work that they did before various NSA revelations became public, they might even be believed and therefore excused.


So what if these NSA engineers really thought they were helping people and doing good? What if they personally decided they were willing to deal with the certain privacy sacrifices they were making because from what they knew, working in very secret high level intelligence(seeing and knowing a lot more than we do), the threat to peoples lives and safety were worth what they are doing. Then in that case this whole article would be considered bunk. Ethics like morals are relative.


>it's what you think that matters.

Is that actually useful in any way? It sounds like self-help "be true to yourself" kinda nonsense.

Ethics are rather pointless without some general priors to agree on. It's hard to reach full consensus even on basic human rights. Even if everyone did, they diverge rather quickly. The whole topic is logically pointless.


The article is arguing from the useful prior that what the NSA is doing is wrong. Then people are jumping in and saying, "hang on a second, what if people disagree about what's right and wrong?" (e.g. "According to some people I'm evil"). So it sounds like you should be arguing with them instead of me?

But to expand the discussion a bit, ethics is a multilayered thing. As Crito points out above, there's a difference between "x is wrong" and "x is wrong but not my problem because I just build stuff". A major thrust of the article is that engineers should take ethically responsibility for the consequences of our actions, which the author sees many engineers as failing to do. Thinking through the ethical implications--assuming those ethics are founded on some general priors--results in a world more closely honed to those priors. Think of "take ethical responsibility" as a meta-ethic.

In that context, "be true to yourself" isn't as nonsensical as your dismissal makes it out to be. It's true that arguing about moral axioms isn't helpful (and wasn't that sort of my point?), but that's not actually what's happening here.


I happened to think that nuclear power is a good thing (or at least, that it can be). Many people agree with me. I'm at odds with people who think that nuclear power is evil. Is it unethical for me to write firmware for a nuclear power plant?

Frankly, these lists of things that engineers need to follow in order to behave ethically pop up every now and then, and it's clear to me that the authors of these lists have their own agendas. As I've said, I refuse to be used. I'll pick my own standards.

The lists appear to be so broad that they're useless (e.g., "Don't be evil") or so narrow that they are instruments of control ("Don't work on X or Y or Z").

So I think we're in agreement.

Finally, it's likely that the number of engineers who actually do evil is quite small, and of a character that, upon reading a code of ethics, they are rather unlikely to shake their heads, wake up and change their ways. (I'm thinking in particular about malware writers, but there are many other examples).


"it's what you think that matters."

Along with a question of whether you've done an appropriate amount of reflection on the matter.


You don't see yourself as evil, so no one should call you evil?


I think the idea is that "evil" is a relative term and it relates to morals, not ethics.

http://www.diffen.com/difference/Ethics_vs_Morals


I think the point which the parent is trying to get at is that he should not be expected to follow rules whose premise he disagrees with. People can call you whatever they like, but the question is whether you should allow their moral or ethical norms to affect your actions.


You don't see yourself as evil, so no one should call you evil?

Hitler had a lot of self confidence


Hitler mentioned




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: