The Sumerians were a non-Semitic caucasoid people, and spoke a language isolate; a number of linguists believed they could detect a substrate language beneath Sumerian, because names of some of Sumer's major cities are not Sumerian, revealing influences of earlier inhabitants.
What influences did the Sumerian language seem to retain?
earlier inhabitants