Check this. Its neatly implemented here.
And a pretty neat architecture as well.
model —> downstream_task . Well defined.

  
      github.com
  
  
    legacyai/tf-transformers/blob/main/src/tf_transformers/notebooks/tutorials/bert_cola_text_classification.ipynb 120
{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Install tf-transformers from github"
   ]
  },
  {
   "cell_type": "code",


  This file has been truncated. show original