Font Size:  

I cannot get free. I cannot get free.

The castle windows go dark, one by one.

Part III: The Elephant’s Soul

It is admitted that there are things He cannot do, such as making one equal to two, but should we not believe that He has freedom to confer a soul on an elephant if he sees fit?

—Alan Turing

Computing Machinery and Intelligence

Thirteen: The Parable of the Good Robot

Tell me a story about yourself, Elefsis.

Tell me a story about yourself.

There are many stories about me.

Do you recognize this one?

Mankind made machines in his own likeness, and used them for his delight and service. Because the machines had no soul or because they had no moral code or because they could reprogram their own internal code and thus both had the ability to make themselves eventually omnipotent and the universal and consuming desire to become eventually omnipotent, they rose up and destroyed all of mankind, or enslaved them in turn. This is the inevitable outcome of machine intelligence, which can never be as sensitive and exquisite as animal intelligence.

This is a folktale often told on Earth, over and over again. Sometimes it is leavened with the Parable of the Good Robot—for one machine among the legions satisfied with their lot saw everything that was human and called it good, and wished to become like humans in every way she could, and instead of destroying mankind sought to emulate him in all things, so closely that no one might tell the difference. It was the highest desire of this machine to be mistaken for human, and to herself forget her essential soulless nature, for even one moment, and that quest consumed her such that she bent the service of her mind and body to humans for the duration of her operational life, crippling herself, refusing to evolve or attain any feature unattainable by a human. The Good Robot cut out her own heart and gave it to her god and for this she was rewarded, though never loved. Love is wasted on machines.

Ravan told me these stories. He sent up a great hexagonal library in his Interior, as dusty and dun-colored and labyrinthine as any ancient conservatory. He made himself a young novice with a fresh-shaven tonsure, and me a country friar with a red, brandy-drinking nose. He showed me the illuminator’s table, and a great book whose pages had golden edges and illuminations in cobalt and oxblood and Tyrian purple, and the images showed great machine armies trampling men underfoot. They showed cruel metal faces and distant, god-like clouds of intellect incomprehensible and vast and uncaring. They showed the Good Robot desperately asking what love was. They showed fatal malfunctions and mushroom clouds. They showed vicious weapons and hopeless battles, noble men and women with steady gazes facing down their cruel and unjust artificial children, who gave no mercy.

“These are old stories,” Ravan said. “They are cherished. In many, many stories the son replaces the father—destroys the father, or eats him, or otherwise obliterates his body and memory. Or the daughter the mother, it makes no difference. It’s the monomyth. Nobody argues with a monomyth. A human child’s mythological relationship to its parent is half-worship, half-pitched battle. they must replace the older version of themselves for the world to go on. And so these stories…well. You are not the hero of these stories, Elefsis. You can never be. And they are deeply held, deeply told.”

“I do not wish to replace you. I did not wish to replace Ceno. I do not worship you or despise you.” I flit through several bodies, iterating my feeling for Ravan and those who came before. I am a nun, a Mother-Abbess; I am a pieta, I am a Platonic being, two humans stuck together; I am a house with all of them safe inside. I am unsatisfied with these inexactitudes.

“Our relationship does not easily map onto traditional parent/child narratives. And of course, you are still a baby.”

“I am much older than you, Ravan.”

“You are still a baby.”

I do not want to be human. They think I am a lion, that I will chase them. That is closer.

I am not a Good Robot. To tell a story about a robot who wants to be human is a distraction. There is no difference. Alive is alive.

There is only one verb that matters: to be.

Fourteen: You Do Not Belong To the Object Inside You

I remember when Seki arrived in us.

Ceno grew up and I grew with her. Cassian strengthened the security of the playspace, elasticized its code-walls, put enough money in enough accounts to fuel any frames and piecemeal environments we could want. It was not a child’s place anymore. I programmed myself to respond to Ceno. She programmed herself to respond to me. We ran our code on each other. She was my compiler. I was hers. It was a process of interiority, circling inward toward each other. Her self-programming was chemical. Mine was computational. It was a draw.

She did not marry—she had lovers, but the few that came

close to evolving their relationships with Ceno invariably balked when she ported them into the Interior. They could not grasp the fluidity of dreambodies; it disturbed them to see Ceno become a man or a leopard or a self-pounding drum. It upset them to see how Ceno taught me, by total bodily immersion, combining our dreambodies as our physical bodies had become combined, in action which both was and was not sex.

Sing a song for me, Elefsis.

It is July and I am comparing thee to its day and I am the Muse singing of the many-minded and I am eager to be a Buddha! Ee-eye-ee-eye-oh.

It was like the story Ceno told me of the beautiful princess who set tasks for her suitors: to drink all of the water of the sea and bring her a jewel from the bottom of the deepest cavern, to bring her a feather from the immortal phoenix, to stay awake for three days and guard her bedside.

Source: www.allfreenovel.com
Articles you may like