This library includes processors for several traditional tasks. These processors can be used to process a dataset into
examples that can be fed to a model.
Processors
All processors follow the same architecture which is that of the
[~data.processors.utils.DataProcessor]. The processor returns a list of
[~data.processors.utils.InputExample]. These
[~data.processors.utils.InputExample] can be converted to
[~data.processors.utils.InputFeatures] in order to be fed to the model.
[[autodoc]] data.processors.utils.DataProcessor
[[autodoc]] data.processors.utils.InputExample
[[autodoc]] data.processors.utils.InputFeatures
GLUE
General Language Understanding Evaluation (GLUE) is a benchmark that evaluates the
performance of models across a diverse set of existing NLU tasks. It was released together with the paper GLUE: A
