Originally posted by PBE6
Self-awareness, or more precisely "consciousness', is a little more involved than simply relating to the environment and learning from mistakes. Any feedback system attached to a sensor can do that. Consciousness involves formulating the concept of "I", which is evident in many animals from watching their behaviour as you said, but is more complicated than si that produces the correct result (in a statistically significant way, of course).
What is a sense of self if not the recognition that my body is a different
entity than everything around me? And in recognising that fact, I am
also acknowledging the concept of "I", if not consciously. I don't think
you can say that self-awareness is anything more than that. A higher
form of intellect (a conciousness*) could start asking question about its
own self in relation to the surrounding, but the self-awareness bit is
pretty much the same: the ability to recognise that you are one part of a
greater whole.
(As an example, most of us are taught to ask these
questions that leads to our concious awareness of "I", as opposed to
being a subroutine running in the back of our mind and "causing"
individuality. But we were self-aware even before we realised what it
means to be self-aware. We must have been, or we wouldn't have had
any sense of individuality to begin with. And all intelligent life, even
two-year old babies and snails has a sense of individuality. They display
it by choosing their own directions of movement and by choosing
different activities in which to engulf themselves, as opposed to just
follow the tide.)
While I agree that understanding doesn't require a sense of self (or that
a sense of self require any understanding of what it actually means), I'm
not sure that impeccable language skill can come without understanding
the rules of the language and the subject being discussed, hence it does
require "thinking" in the sense that data will have to be analysed and a
response calculated. But to test for understanding, we merely need to
read the logs detailing how the system calculated the proper responses.
* Actually, I just realised that conciousness is the wrong word, as it
means the exact same thing as self-awareness. I don't know the English
word, but I'm talking about an awareness not just of your own self in
relation to the surrounding, but also an understanding of what that
awareness is (an understanding of the abstract concept). It may seem
like a subtle difference, but I think it's a very important one to make.