Google T5 scores 88.9 on SuperGLUE Benchmark, approaching human baseline
I didn't know anything about SuperGLUE before (turns out it's a benchmark for language understanding tasks), so I clicked around their site where they show different examples of the tasks.<p>One "word in context" task is to look at 2 different sentences that have a common word and decide if that word means the <i>same</i> thing in both sentences or <i>different</i> things (more details here: <a href="https://pilehvar.github.io/wic/" rel="nofollow">https://pilehvar.github.io/wic/</a>)<p>One of their examples, though, didn't make any sense to me:<p>1. The pilot managed to <i>land</i> the airplane safely<p>2. The enemy <i>landed</i> several of our aircrafts<p>It says that the word "land" does NOT mean the same thing in those sentences. I am a native English speaker, and I honestly don't understand what they are thinking the second sentence means. Shot them down? If so, I have never heard "landed" used in that context, and it appears neither has Merriam-Webster. Also, the plural of aircraft is just "aircraft", without the s.