by symbolic, you mean discrete features (instead of continuous). For all discrete features, make them into one-hot coded symbols, or you can use an nn.Embedding and learn an embedding for each discrete feature.