@g3casey I also read your comments in this thread 1. I don’t have a solution for this and believe that it is a very important issue to consider for Huggingface experts. Adding several extra features (in my case, semantic features) should be feasible more easily by just adjusting some parameters maybe. And specially for token classification tasks.
@nielsr @sgugger