Hacker Newsnew | past | comments | ask | show | jobs | submit | goatlover's commentslogin

The market is not able to fix corruption. Regulation is needed. For example, exploitative labor practices weren't ended in the early 20th century because of customer preference. Laws had to be passed.

This is just trickle down economics, which has led to great wealth inequality while the middle and lower class wages have stagnated as inflation has gone up and more people have to rent instead of owning their own porpoerty. What really helps is strong social safety nets and programs that help struggling people. The Nordic model leads to better societal outcomes.

This is just trickle down economics, which has led to great wealth inequality while the middle and lower class wages have stagnated as inflation has gone up. What really helps is strong social safety nets and programs that help struggling people. The Nordic model leads to better societal outcomes.

Always wondered what Skynet would have done had it killed off the humans in the Terminator future. Would it build a machine society?

There are some acceelerationists who want "superior" machines to replace humanity. But what if instead they get the equivalent of a paper clipping gray goo, or a bored Skynet who just fights it's own creations? Is that worth replacing all the humans?

As a thought experiment, what is a p doom AI doing after humanity is gone?


There are many insect/bird/mammal species that exhibit reliably predictable behaviors. It will co-opt them.

You can cut the power to data centers where the models are run.

Who has the authority to perform that shutdown without getting arrested, and does that person have a mandate and responsibility to take that action in response to AI misbehavior?

What is their trigger condition? Will they get fired for pulling the plug? Do they get a bigger bonus if the servers keep running? Whose approval do they need? What response time is acceptable? How will they detect that the incident is happening?

It's easy to hand-wave "someone can just pull the plug" but there's an entire history of industrial accidents that happened because of the above problems of incentives, detection, procedures, not being taken seriously in advance. Someone could easily have pulled the plug on Chernobyl but nobody did, at least not before it was too late.


Who is this "you"?

Maybe we shouldn't want that to happen?

The singularity has been termed, "Rapture of the Nerds" since the futurists promoting it sound like evangelicals talking about the end times, both with the Revelations doom stuff, and the utopian stuff that follows.

Do the experts in the relevant fields agree with the "substantive" technical details on how the entire human race can be made extinct?

Have you noticed they're not interviewing these people? IMO that would totally kill the AI 2027 buzz.

This sounds like a rationalization for gambling with everyone's lives, assuming they really believe such a thing.

What's the alternative? There's no realistic way to globally coordinate and enforce a ban. A direct action campaign against AI labs would only motivate increased security until sabotage becomes impossible. Starting a nuclear war would probably be enough to stop dangerous AI research, and that's only likely to kill about 50% of humans instead 100%, so it's a great improvement, but how is an individual supposed to start a nuclear war? Of course it would be better if everybody stopped, but it's a prisoner's dilemma scenario with no possibility of future rounds, so the rational play is to defect.

> There's no realistic way to globally coordinate and enforce a ban.

I don't see what is unrealistic about that.

The major players already have strong incentives to freeze AI advancements at the the current state, while the technology is highly efficient for totalitarian surveillance systems that can eliminate any threat to their power in the buds, but still not so advanced that it could create crises that might endanger their power.

So I think the situation where several largest countries declare AI a deadly threat for humanity and start fighting it development much like they fight ISIS to be quite plausible.

This isn't a prisoner's dilemma; the distribution of risks and rewards is entirely different. Ban AI research, give away advanced models, bomb a couple of Russian datacenters where they launching those models unsafely, and then AI development will stop in the entire world.


> they believe only they can be stewards of digital gods

You do't see how absurd that sounds? Not only the idea that they can create gods, but that they are the only good stewards for such beings. It's also incredibly arrogant.


Yes, that's why the rest of society needs to make them pause.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: