Originally posted by Bosse de Nage
Yet I fail to see the arc from this aspect of being to AI.
Two human babies are born. Identical twins. They are separated at birth, and grow up in different homes. At age thirty, what will the differences be? What will the similarities be? The differences are a result of environment. The similarities a result of DNA, or 'design' if you will.
I think twins are often more similar than we would like to admit (ie we don't like to think that we are a function of our DNA). But they are never truly identical.
A computer (or computer program) that is designed for AI, can learn. What it learns, affects how it thinks. A sufficiently sophisticated AI could become concious then learn like a human, gain character like a human, maybe even get religion. But although much of the structure and programming would be designed, and possibly intentional, there would always be some elements that simply worked unintentionally, or don't work as planned, but far more importantly, the learning aspect means that the character of the conciousness will be partly a function of its environment.
If you take two identical AI computers and put one with an alcoholic father and the other with a loving mother, you will end up, with two very different computer AIs, just as you would with identical twins.
But most importantly as regards previous discussions, if you put one with a dolphin, will it end up being more like a dolphin than a human? Will it do maths like a dolphin?