Show HN: Ecco – See what your NLP language model is “thinking”
Hi HN,<p>Author here. I had been fascinated with Andrej Karpathy's article (<a href="https://karpathy.github.io/2015/05/21/rnn-effectiveness/" rel="nofollow">https://karpathy.github.io/2015/05/21/rnn-effectiveness/</a>) -- especially where it shows neurons being activated in response to brackets and indentation.<p>I built Ecco to enable examining neurons inside Transformer-based language models.<p>You can use Ecco to simply interact with a language model and see its output token by token(as it's built on the awesome Hugging Face transformers package). But more interestingly you can use it to examine neuron activations. The article explains more: <a href="https://jalammar.github.io/explaining-transformers/" rel="nofollow">https://jalammar.github.io/explaining-transformers/</a><p>I have a couple more visualizations I'd like to add in the future. It's open source, so feel free to help me improve it.