I missed the fact that the serving method is explicitly exported as a metagraph in the SavedModel for all TF models (see here 5)
EDIT:
One thing that’s still not completely clear to me are the redefined inputs. The tutorial changes the serving method to accept token embeddings, yet the requests to the model use the output of the tokenizer, so token ids. What am I not seeing?