Mike Perrotta
1 min readDec 12, 2023

--

It certainly would be a safe course to stop doing anything that AI responds negatively to. Of course, we could easily program an AI to say "ow" and respond in other ways that suggest it is experiencing an internal world, even if it is no different than today's AIs. Perhaps more troubling, we could also program it to tell us it isn't conscious, even if it is. ChatGPT's response when asked if it's conscious is "No, I'm not conscious. I process and generate responses based on patterns in data, but I don't have self-awareness, consciousness, or personal experiences." This strikes me as likely a canned response instructed by Open AI, rather than a raw response from the model. Processing and generating responses based on patterns in data seems to be exactly what we do, and thus does not preclude ChatGPT from being conscious. So to your point, I think you're correct that we need to be careful about limiting AIs ability to communicate with us.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Mike Perrotta
Mike Perrotta

Written by Mike Perrotta

I write about neuroscience, consciousness, and artificial intelligence from my full-time van home.

Responses (1)

Write a response