Computational Assessment of the `Magic' of Human Cognition

Abstract

The task of designing cognitive tests and challenges for robots and intelligent agents is vital for guidance and evaluation of the development of cognitive architectures aimed at the human level of intelligence. In addressing this task, the tremendous store of knowledge of experimental psychology cannot be ignored. At the same time, methods and test paradigms used for evaluation of humans and/or brain models need to be adjusted before they can be used for evaluation of artifacts. The present work is focused on this problem and its possible solutions in one general paradigm of ontogenesis in virtual environment. We propose several test scenarios and metrics that are adequate to assess cognitive features in computational agents.