Solved by albanD in post #6 
              
              
                Yes that’s right. 
Basically, the Embedding layer cannot be plugged in in a middle of any system as it is not differentiable wrt to its inputs. It has to be the first layer.