No, these models won’t run in parallel as the execution is sequential due to the data dependence:
output_c = actor(input)
output_a = critic(output_c, other_inputs)

I.e. critic cannot start the execution before output_c is calculated.
If models do not depend on each other you could execute them in parallel, if the GPU has free resources. Here 18 is another related post.