Hi @Yian_Chen thanks for raising the question. We happen to have a tutorial on the website that demonstrates how to do “data re-uploading” here: Parametrized Quantum Circuits for Reinforcement Learning 3
I’m not entirely sure of the specifics of your exact setup, but hopefully this working implementation will be enough to springobard the functionality into what you are doing.
Does this help with things at all ?

Michael