I wanted gradients to flow to wt (weight generator and embedding layer) and backbone layer but not to DC layer as it just gets the weights from the weight generator using class embeddings for each of the class.