Monthly Archives: April 2023


Q: You’re seen as the Godfather of this industry. Do you have any concern about what you’ve wrought?

A: I do a bit. On the other hand, I think whatever going to happen is pretty much inevitable. One person stopping doing this research wouldn’t stop it happening. If my impact is to make it happen a month earlier, that’s about the limit of one person can do.

Q: We haven’t touched on job displacement. Is this going to eat up job after job?

A: I think it’s going to make jobs different. People are going to be doing more of the creative end and less of the routine end.

Q: This is the biggest technological advancement since… is this another industrial revolution, or how should people think of it?

A: I think it’s comparable in scale to the industrial revolution or electricity, or maybe the wheel.

Q: And sentience? I think you have complaints about how you even define that?

A: When it comes to sentience, I’m amazed that people can confidently pronounce that these things are not sentient, and when you ask them what they mean by sentient, they say they don’t really know. So how can you be confident about sentient if you don’t know what sentient means?

Q: So maybe they are already?

A: Who knows. I think whether they’re sentient or not depends on what you mean by sentient. So you better define what you mean by sentient before you answer the question of whether they’re sentient.

Q: Does it matter what we think, or does it only matter whether it effectively acts as if it is sentient?

A: That’s a very good question.

Q: And what’s your answer?

A: I don’t have one.

Q: Because if it’s not sentient, but it decides for whatever reason that it believes it is and that it needs to achieve some goal that’s contrary to our interests but it believes is in its interest, does it really matter in terms of any human reflection?

A: I think a good context to think about this thing is an autonomous lethal weapon. It’s all very well saying it’s not sentient, but when it’s hunting you down to shoot you, you’re going to start thinking it’s sentient.

Q: Or not really caring, not an important standard any more.

A: The kind of intelligence we’re developing is very different from our intelligence. It’s an idiot-savant kind of intelligence. It’s quite possible that if it is at all sentient, it’s sentient in a somewhat different way from us.

It seems probable that once the machine-thinking method starts, it would not take long to outstrip our feeble powers. At some stage therefore we should have to expect the machines to take control.

— Alan Turing


Here’s a thought experiment for you. Suppose you’re sitting in a room, there’s a box on the table, and you believe there’s something in that box there’s a strong chance it will give glorious gifts to your family and to everyone. But there’s something in the small print on the box that says: Pandora. There’s a chance that this could unleash unimaginable evils on the world. Do you open that box?

It’s happening by design

The Bot

Why do I love the Bot? Because it frees me up. It appeals to the laziest parts of my mind. It does my work for me. It will wipe out my doubts. It will think and decide for me. It will kill who I thought I was, which I always secretly wanted.

The total decoding and synthesising of reality

Misere mei, Deus

Gloria in Excelsis Deo

Goldberg Variations

The Future

Give me back my broken night
My mirrored room, my secret life
It’s lonely here
There’s no one left to torture

Give me absolute control
Over every living soul
And lie beside me, baby
That’s an order

Give me crack and anal sex
Take the only tree that’s left
And stuff it up the hole
In your culture

Give me back the Berlin wall
Give me Stalin and St. Paul
I’ve seen the future, brother
It is murder

Things are gonna slide in all directions
Won’t be nothing you can measure anymore
The blizzard of the world has crossed the threshold
And it’s overturned the order of the soul

When they said repent
I wonder what they meant

You don’t know me from the wind
You never will, you never did
I’m the little Jew who wrote the Bible

I’ve seen the nations rise and fall
I’ve heard their stories, heard them all
But love’s the only engine of survival

Your servant here, he has been told
To say it clear, to say it cold
It’s over, it ain’t going any further

And now the wheels of heaven stop
You feel the devil’s riding crop

Get ready for the future
It is murder

Things are going to slide in all directions
Won’t be nothing you can measure anymore
The blizzard of the world has crossed the threshold
And it’s overturned the order of the soul

When they said repent
I wonder what they meant

There’ll be the breaking of the ancient western code
Your private life will suddenly explode
There’ll be phantoms, there’ll be fires on the road
And the white man dancing

You’ll see a woman hanging upside down
Her features covered by her fallen gown
And all the lousy little poets coming round
Trying to sound like Charlie Manson

Give me back the Berlin wall
Give me Stalin and Saint Paul
Give me Christ or give me Hiroshima

Destroy another fetus now
We don’t like children anyhow
I’ve seen the future, baby
It is murder

When they said repent
I wonder what they meant