Hi,
I think it depends what you want to differentiate.
If you generate a new embedding for that new node and add it to the current graph state before further processing. I think this can be nicely differentiable.
If you want gradients for things like what this node should be connected to or added at all, it is going to be trickier as these quantities are usually discrete.