Systems and methods are provided that may generate, based on an agent neural network, actions and/or policies for an environment, the environment comprising an apparatus and/or a software component. The actions and/or the policies may be enacted in the environment. A human observation may be received (“hijacked”) from a voice network module. A natural language processing neural network may output encodings of labels for entities, actions, and/or policies, when the human observation and environment observations are supplied as input to the natural language processing neural network. The environment observations are indicative of states of the environment. A relational reasoning neural network may generate cross-modal embeddings from the environment observations and the encodings of labels for entities, actions, and/or policies. The agent neural network may generate the actions and/or the policies from the environment observation and the cross-modal embeddings.
SYSTEM FOR VOICE COMMUNICATION WITH AI AGENTS IN AN ENVIRONMENT