Bert, NLP.
entity recognition task and observing the resulting F1 scores. (Image from Jay Allamar’s blog) While concatenation of the last four layers produced the best results on this specific task, many of the other methods come in a close second and in general it is advisable to test different versions for