Wittgenstein’s theories are the basis of all modern NLP
Inaccurate. This is absurd. Epigraphy is the basis of all modern NLP&#x2F;NLU. Add computational epigraphy, neuroscience, linguistics and cognition. Ref: Word2Vec is based on an approach from Lawrence Berkeley National Lab<p>&quot;&quot;Google silently did something revolutionary on Thursday. It open sourced a tool called word2vec, prepackaged deep-learning software designed to understand the relationships between words with no human guidance. Just input a textual data set and let underlying predictive models get to work learning.&quot;<p>“This is a really, really, really big deal,” said Jeremy Howard, president and chief scientist of data-science competition platform Kaggle. “… It’s going to enable whole new classes of products that have never existed before.” <a href="https:&#x2F;&#x2F;gigaom.com&#x2F;2013&#x2F;08&#x2F;16&#x2F;were-on-the-cusp-of-deep-learning-for-the-masses-you-can-thank-google-later&#x2F;" rel="nofollow">https:&#x2F;&#x2F;gigaom.com&#x2F;2013&#x2F;08&#x2F;16&#x2F;were-on-the-cusp-of-deep-learn...</a><p>Spotify seems to be using it now: <a href="http:&#x2F;&#x2F;www.slideshare.net&#x2F;AndySloane&#x2F;machine-learning-spotify-madison-big-data-meetup" rel="nofollow">http:&#x2F;&#x2F;www.slideshare.net&#x2F;AndySloane&#x2F;machine-learning-spotif...</a> pg 34<p>But here&#x27;s the interesting part:<p>Lawrence Berkeley National Lab was working on an approach more detailed than word2vec (in terms of how the vectors are structured) since 2005 after reading the bottom of their patent: <a href="http:&#x2F;&#x2F;www.google.com&#x2F;patents&#x2F;US7987191" rel="nofollow">http:&#x2F;&#x2F;www.google.com&#x2F;patents&#x2F;US7987191</a> The Berkeley Lab method also seems much more exhaustive by using a fibonacci based distance decay for proximity between words such that vectors contain up to thousands of scored and ranked feature attributes beyond the bag-of-words approach. They also use filters to control context of the output. It was also made part of search&#x2F;knowledge discovery tech that won the 2008 R&amp;D100 award <a href="http:&#x2F;&#x2F;newscenter.lbl.gov&#x2F;news-releases&#x2F;2008&#x2F;07&#x2F;09&#x2F;berkeley-lab-wins-four-2008-rd-100-awards&#x2F;" rel="nofollow">http:&#x2F;&#x2F;newscenter.lbl.gov&#x2F;news-releases&#x2F;2008&#x2F;07&#x2F;09&#x2F;berkeley-...</a> &amp; <a href="http:&#x2F;&#x2F;www2.lbl.gov&#x2F;Science-Articles&#x2F;Archive&#x2F;sabl&#x2F;2005&#x2F;March&#x2F;06-genopharm.html" rel="nofollow">http:&#x2F;&#x2F;www2.lbl.gov&#x2F;Science-Articles&#x2F;Archive&#x2F;sabl&#x2F;2005&#x2F;March...</a><p>A search company that competed with Google called &quot;seeqpod&quot; was spun out of Berkeley Lab using the tech but was then sued for billions by Steve Jobs <a href="https:&#x2F;&#x2F;medium.com&#x2F;startup-study-group&#x2F;steve-jobs-made-warner-music-sue-my-startup-9a81c5a21d68#.jw76fu1vo" rel="nofollow">https:&#x2F;&#x2F;medium.com&#x2F;startup-study-group&#x2F;steve-jobs-made-warne...</a> and a few media companies <a href="http:&#x2F;&#x2F;goo.gl&#x2F;dzwpFq" rel="nofollow">http:&#x2F;&#x2F;goo.gl&#x2F;dzwpFq</a><p>We might combine these approaches as there seems to be something fairly important happening here in this area. Recommendations and sentiment analysis seem to be driving the bottom lines of companies today including Amazon, Google, Nefflix, Apple et al.&quot;