Computer Science - Artificial Intelligence

Playing Games in the Dark: An approach for cross-modality transfer in reinforcement learning

In this work we explore the use of latent representations obtained from multiple input sensory modalities (such as images or sounds) in allowing an agent to learn and exploit policies over different subsets of input modalities. We propose a …

Learning multimodal representations for sample-efficient recognition of human actions

Humans interact in rich and diverse ways with the environment. However, the representation of such behavior by artificial agents is often limited. In this work we present textitmotion concepts, a novel multimodal representation of human actions in a …