Note that the SequenceSummary object will disappear soon-ish: it goes against our philosophy of having each model fully defined in one self-contained file (except for obvious subclasses) and adds config arguments to some models that are never actually used. We will use an approach like in the BERT or ELECTRA modeling files, where all the layers for the head are defined in the modeling.py file.

Thank you. When SequenceSummary is removed, will all models then produce their own pooler_output ?