Is “data scientist” the new “programmer”?
The take down on abstraction and software engineers (by using Java as an example) is similar to saying &quot;back in the day to find a prime number we would simply use a sieve, but today it is a tedium, what with all the pi&#x27;s and e&#x27;s and thetas that get in the way, and what are geometry and polynomials doing here, and what in the god&#x27;s name is this <i>i</i>, I just want to count the prime numbers which are nice round whole numbers&quot;.<p>That&#x27;s what happens when a topic grows from being a curiosity where dilettantes dabble into a proper field that is applied to solve problems. Granted, some of the developments can indeed be tedious and self indulgent, but otherwise this is the natural progression. Its sad and frustrating when people who ought to know better make such statements. Is it done to provoke a critical analysis, positive trolling if you will?<p>About the role of data scientist, I find it both amusing and disappointing that just about anyone with a three week MOOC gets to work in this field, who otherwise had never dealt with statistics before. I mean, statistics is a three year long grueling applied maths degree, and condensing it to three weeks is silly. It is actually in this way that it is similar to progamming job of the 90s (I don&#x27;t know how it was in the 70&#x27;s, I wasn&#x27;t born yet). Just about anyone who could learn Java or VisualBasic, or the self taught cowboys who used C, ended up programming professionally. Actually it was not that bad, for coding is not as hard as its made to be, but that until they got sucker punched by the n squared complexity, to say the least, on a big data. Coding couldn&#x27;t help them and they realized programming was more than learning to code and using some API&#x27;s and system calls. (I was one of them in a way, when I started to code in C++ to model and simulate my mechanical engineering project, and it lead me to the path of enlightenment.) So, today&#x27;s data scientists who are not bonafide statistics graduates or statisticians have it coming as well, whatever the analogue is, unless they are merely &quot;data monkeys&quot; in which case all is well and as expected.