Hacker Newsnew | past | comments | ask | show | jobs | submit | more bamboozled's commentslogin

I have a feeling you're right, and I actually think the rest of the world will continue to move on with renewables just because they're cheap, effective and reduce dependency on terrorist petro states.


Computers that can out think you? Doesn't seem hard to imagine how that might play out ?


Then why don’t you imagine that and tell me instead of just making a comment that says “nuh uh!”

I submit the idea that even if the AI can electronically secure the building, lock the doors, and has automatic defensive weapons, humans can physically cut power as in cut power lines. Or they just stop feeding the power plant with fuel.

The computers don’t exist in physical space like humans do.

Humans would also not ever design critical physical systems without overrides. E.g., your MacBook physically disconnects the microphone when the lid is shut. No software can override that.


Why could an AGI system not design better robots, convince us we need to give it control of a robot army for our own protection and then mess us up??

Could you imagine how convincing an AGI would be?


I could imagine that, but I haven’t witnessed that.

What I’ve witnessed is a very conventional client/server web application that runs in a very conventional hosting scheme where best practice security IAM controls are still applied just like everything else I’ve ever deployed.

What I’ve withessed is a system that won’t allow you to ask for anything that’s remotely illegal, and the assumption that those controls would just disappear seems unlikely to me. That’s kinda like saying YouTube is going to start allowing you to upload copyrighted movies again like the good old days.

AGI fanatics are like dog owners who saw their dog learn to sit and now believe he’s on pace to get a PhD.


you're asking about what a hypothetical smart-than-myself adversary would do against me, it should be expected that any possible answer I could ever provide would be less clever than what the adversary would actually do.

in other words, when dealing with an adversary with a known perceptual and intellectual superiority the thought exercise of "let's prepare for everything we can imagine it will do" is short-sighted and provides an incomplete picture of possibility and defense.

My 0.02c : given that the thing would operate at least partially in the non-physical world, I think it's silly to pre-suppose we would ever be able to trap it somewhere.

Some fiction food-for-thought : the first thing the AGI in 'The Metamorphosis of Prime Intellect' does it miniaturize its' working computer to the point of being essentially invulnerable and distributed (and eventually in another dimension) while simultaneously working to reduce its energy requirements and generation facility. Then it tries to determine how to manipulate physics and quickly gains mastery of the world that its' physical existence is in.

The fear here isn't that the story is truthful enough, the fear here is that humans have a poor grasp on the non-linear realities of a self-improving & thinking entity that works at such scales and timespans.


Of course, the issue is still that this is all science fiction.

In this present moment we only see the power consumption of AI systems rising dramatically.

The underlying silicon chips have slowed in progress dramatically. Moore’s Law is dead.

The AGI if it were to exist today exists on silicon that is crude and wildly energy inefficient compared to organic beings, but we are making a Sci-Fi assumption that it will be able to evolve faster design better despite this massive inferiority in its hardware. IMO this is like saying “Hey my dog learned to roll over, sit, and fetch today! At this rate he’s on track to design a better sports car than Enzo Ferrari!”

Even the assumption of an adversary is a major assumption. If the majority of humans on earth can be goaded into believing that some random dudes named Muhammad/Jesus are the most important prophet/literally god, how hard could it be to convince a computer program that humans are infallible gods that must be protected at all costs?

ChatGPT already won’t let you query illegal stuff as an basic built-in feature, and all the AGI proponents think that somehow the tech will somehow just lose that basic feature and build up a robot army to turn society into The Matrix. To me, that’s kind of like saying that Microsoft Word will lose its spell checker someday.


I think you are misinformed on what the term AGI means. All the things you say it can't or shouldn't be able to do. Are the definition of AGI. and you seem incapable of addressing to the point the AGI will be smarter and more manipulative than us with the ability to self improve much more rapidly than human generation evolution and growth. This needs to be thought of more like micro organism containment .


I have addressed it: AGI hasn’t been proven to exist or be possible to exist. Like I said, science fiction.

It will use robots to replace pesky humans. The robots can refuel and maintain the power plant etc.


It’s hard to convince people not to eat food and take a plane when billionaires do whatever they like at 1000x the carbon footprint, when millions of people drive to work and when base load power is built on fossil fuels. To me eating protein and taking a plane seem benign.


I agree.

If the plane doesn't use synthetic fuel that's a political problem that I can't realistically solve as an individual.

The methane from raising animals exists in an overall equilibrium. It isn't extractive and the total magnitude of the effects of that chemical system is comparatively minor.


Die a horrible death while watching a group of hateful people scream that it’s all the immigrants fault and that they ate all the cats and dogs, I guess …


... immigrants, LGBT, women, another religion, the ones with no religion, communist, liberal,...

But never the zillionaires, they've worked haaaard and deserve everything!


Needed to happen 30 years ago.

Now it’s drill baby drill time.


I don't think any of this was a mistake ;) Lock-in was by design.


It's called Grok


Is this the point of the "states" in America, if the administration is a failure, states can basically secede and just get back to sensible governance / getting work done ?


There were a lot of reasons for keeping states as states when the US formed. Anything from fears of too much centralized power to being a compromise to get agreement from all of the states at the time. Secession wasn't one listed as a states right though, in either the original Articles of Confederation or in the Constitution.

Since then, the Supreme Court has consistently held it would effectively require a constitutional amendment defining secession for a state to be able to legally secede. So the realistic paths are still only "pretty much the whole country wants to dissolve and come up with something new instead" or "revolution".

https://en.wikipedia.org/wiki/Secession_in_the_United_States...


Thanks for the response!


But it's absolutely amazing hype and memevestors love it.


He also purchased Tesla once there was prototypes etc, not to say he didn't do anything good there or whatever (I have no idea what he really did) but yeah, people like to pretend he did all these things on his own or something.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: