Show HN: Ecco – See what your NLP language model is “thinking”
Hi HN,<p>Author here. I had been fascinated with Andrej Karpathy&#x27;s article (<a href="https:&#x2F;&#x2F;karpathy.github.io&#x2F;2015&#x2F;05&#x2F;21&#x2F;rnn-effectiveness&#x2F;" rel="nofollow">https:&#x2F;&#x2F;karpathy.github.io&#x2F;2015&#x2F;05&#x2F;21&#x2F;rnn-effectiveness&#x2F;</a>) -- especially where it shows neurons being activated in response to brackets and indentation.<p>I built Ecco to enable examining neurons inside Transformer-based language models.<p>You can use Ecco to simply interact with a language model and see its output token by token(as it&#x27;s built on the awesome Hugging Face transformers package). But more interestingly you can use it to examine neuron activations. The article explains more: <a href="https:&#x2F;&#x2F;jalammar.github.io&#x2F;explaining-transformers&#x2F;" rel="nofollow">https:&#x2F;&#x2F;jalammar.github.io&#x2F;explaining-transformers&#x2F;</a><p>I have a couple more visualizations I&#x27;d like to add in the future. It&#x27;s open source, so feel free to help me improve it.