Hi @SimonW, to avoid any misunderstanding about sparse=True, so if I set it to False, does it mean that during training, the gradient matrix shape is the same as Embedding weights, and although most of the gradient matrix will be 0s, right?
If so, for super large Embedding, sparse=False should make training very slow, since the gradient matrix will be a super huge dense matrix, right?