One model to learn them all
Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth?(My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual with double the brain size. We’ll do a lot of research in AI to find that there aren’t any machine learning problems that can’t be run on a computer about the size and speed of a brain, or distributed among some number of independently operating brain sized computers, and that the problem never was scale but just where to focus)