Teaching an Agent by Playing a Multimodal Memory Game: Challenges for Machine Learners and Human Teachers, AAAI’09
Zhang developed a research platform that implements a cognitive game called multimodal memory game (MMG) to study machine learning architectures and algorithms for learning in a long-lasting, multimodal, interactive, and dynamic environment. MMG is a real challenge for current machine learning technologies. First the game is played online and the data are received in a stream. This is contrasted with machine learning situations where a fixed set of training data is given. Second, the amount of data is huge. For some machine learning algorithms, such as support vector machines, there is a limit in the number of training examples. Third, the problem involves multimodality. It is necessry to integrate multiple sources of data into a coherent knowledge. Fourth, the game involves vision and language problems. They demonstrated that a version of the MMG game can be solved by the hypernetwork learning model.