Building Intelligent Embodied AI Agents for Asking Clarifying Questions

Abstract

Interactive embodied agents are intelligent agents present inside some virtual environment and interact with humans to do tasks we want them to simulate. The communication takes place in some verbal or non-verbal form. This kind of communication gives a better and richer experience and more possibility for users to be satisfied with the carried-out task. An intelligent agent analyzes the environment it is in and performs tasks with all its knowledge based on the interaction. The task is carried out in the game environment where the Agent resides. There are some challenges to an agent that it needs to address, as well as to understand the instruction given to it. The next challenge is asking for clarification if the instruction given is unclear. In this research paper, we have discussed the problems mentioned above using the dataset provided by the NeurIPS 2022 IGLU Challenge which is a labeled dataset. We have discussed the various approaches for the problem mentioned. © 2023 IEEE.