Hi @Christoph_Heindl !
Your project looks really interesting…
I am trying to create a chatbot using Blender and Pytorch. I’ve got the blend file in which I’ve created the poses (the rain rig). The Rain rig responds to the audio input based on the (.dat) file. And honestly,  I’m still clueless about how it gonna create poses based on output from the conversational module in real-time.

image879×484 95.2 KB

Although I came across blendtorch- a Python framework to seamlessly integrate Blender into PyTorch datasets for deep learning from artificial visual data
But I’m still wondering how it will create poses on the go ie. based on conversational input in real-time. Can you please guide me a little on how shall I proceed?
I’m trying to create something like this:


GitHub - huihut/Facemoji: 😆 A voice chatbot that can imitate your expression. OpenCV+Dlib+Live2D+Moments Recorder+Turing Robot+Iflytek IAT+Iflytek TTS 3 or just like digital human Fatema who answers customers’ queries.

Thanks in advance.