NNsight and NDIF: Democratizing Access to Foundation Model Internals
The enormous scale of state-of-the-art foundation models has limited their
accessibility to scientists, because customized experiments at large model
sizes require costly hardware and complex engineering that is impractical for
most researchers. To alleviate these problems, we introduce NNsight, an
open-source Python package with a simple, flexible API that can express
interventions on any PyTorch model by building computation graphs. We also
introduce NDIF, a collaborative research platform providing researchers access
to foundation-scale LLMs via the NNsight API. Code, documentation, and
tutorials are available at https://www.nnsight.net.
669f19d9c2436159a5c67cbc
Jaden Fiotto-Kaufman
admin_assigned
2024-07-23T08:15:33.764Z
6310fe73631a69165c082c28
/avatars/c0b5de389904ec3ee20c0019801aebd3.svg
Jaden Fiotto-Kaufman
user
JadenFK
669f19d9c2436159a5c67cbd
Alexander R Loftus
claimed_verified
2024-07-24T14:05:48.616Z
64cd5c581139ff0887246efc
/avatars/16298a298ccfefc3e3896c7f1109cbd8.svg
Alex Loftus
user
loftuale000
669f19d9c2436159a5c67cbe
Eric Todd
claimed_verified
2024-07-23T11:43:15.166Z
645a5a01c35da9c7afd5cdc3
/avatars/bb216e9194514faaf195cc4ab525a6ed.svg
Eric Todd
user
ericwtodd
669f19d9c2436159a5c67cbf
Jannik Brinkmann
admin_assigned
2024-07-23T08:18:03.886Z
62fe3051029f73cec2766f6f
https://cdn-avatars.huggingface.co/v1/production/uploads/62fe3051029f73cec2766f6f/eEJZhHXcmZGGhV_vCvpTv.jpeg
Jannik Brinkmann
user
jbrinkma
669f19d9c2436159a5c67cc0
Caden Juang
admin_assigned
2024-07-23T08:18:10.738Z
62ebf45a341b2cd73454e796
https://cdn-avatars.huggingface.co/v1/production/uploads/62ebf45a341b2cd73454e796/kmJkeT7L3-c5XAF5suS-p.png
Caden Juang
user
kh4dien
669f19d9c2436159a5c67cc1
Koyena Pal
admin_assigned
2024-07-23T08:18:17.651Z
632b2558ca316c73cd3bb0f5
/avatars/775af53c02f301fa400662b15cec41c8.svg
Koyena Pal
user
koyena
669f19d9c2436159a5c67cc2
Can Rager
admin_assigned
2024-07-23T08:18:24.565Z
66101de68dd1183537d62161
/avatars/d47dd0e4fc5bd08cf4f0c2c1355ea004.svg
Can Rager
user
canrager
669f19d9c2436159a5c67cc3
Aaron Mueller
admin_assigned
2024-07-23T08:18:30.236Z
60a5abbc8b5faf05f3c4d757
/avatars/eba6c3e61a7a6a12f487d531cf7a9934.svg
Aaron Mueller
user
amueller
669f19d9c2436159a5c67cc4
Samuel Marks
669f19d9c2436159a5c67cc5
Arnab Sen Sharma
admin_assigned
2024-07-23T08:19:10.835Z
64fcfd0167096272aea83a70
/avatars/aa4386234a8b1db5dbd2cefb3d90ed08.svg
Arnab Sen Sharma
user
sensharma
669f19d9c2436159a5c67cc6
Francesca Lucchetti
claimed_verified
2024-07-25T07:38:59.958Z
64025d945caf6d21d67cdad2
/avatars/17227ea5bd07c820f4f3fd29ffa5853e.svg
Francesca Lucchetti
user
franlucc
669f19d9c2436159a5c67cc7
Michael Ripa
admin_assigned
2024-07-23T08:19:33.198Z
6325d20a2a0af3bd4520a652
/avatars/772f3e5f5c3d990e90c39147f6a375a4.svg
Michael Ripa
user
mripa
669f19d9c2436159a5c67cc8
Adam Belfki
admin_assigned
2024-07-23T08:19:41.829Z
6611925efa38433529c8ec4c
/avatars/37ecae1133b5572299bdc360a898f17b.svg
Adam Belfki
user
AdamBelfki
669f19d9c2436159a5c67cc9
Nikhil Prakash
669f19d9c2436159a5c67cca
Sumeet Multani
669f19d9c2436159a5c67ccb
Carla Brodley
669f19d9c2436159a5c67ccc
Arjun Guha
admin_assigned
2024-07-23T08:21:07.672Z
62d8315bad693a1a962864b3
https://cdn-avatars.huggingface.co/v1/production/uploads/1664332914111-62d8315bad693a1a962864b3.png
Arjun Guha
user
arjunguha
669f19d9c2436159a5c67ccd
Jonathan Bell
admin_assigned
2024-07-23T08:21:15.693Z
6407d272a7bc7c3865adce6a
/avatars/726dfea7ec7ec779aaf3472878e34d2a.svg
Jonathan Bell
user
jonathanbellerwrwer
669f19d9c2436159a5c67cce
Byron Wallace
admin_assigned
2024-07-23T08:21:24.362Z
6474aa4433192631bace7ff0
/avatars/06b586fc65350800a9aeffacd7bbdf50.svg
Byron Wallace
user
byroncwallace
669f19d9c2436159a5c67ccf
David Bau
admin_assigned
2024-07-23T08:21:33.332Z
6214d6c01e35c843d42d1f77
/avatars/ac208cd180b4f3ed1ec367e581facfcf.svg
David Bau
user
davidbau
NNsight and NDIF: Democratizing Access to Foundation Model Internals
The enormous scale of state-of-the-art foundation models has limited their
accessibility to scientists, because customized experiments at large model
sizes require costly hardware and complex engineering that is impractical for
most researchers. To alleviate these problems, we introduce NNsight, an
open-source Python package with a simple, flexible API that can express
interventions on any PyTorch model by building computation graphs. We also
introduce NDIF, a collaborative research platform providing researchers access
to foundation-scale LLMs via the NNsight API. Code, documentation, and
tutorials are available at https://www.nnsight.net.
neural graphs computation graphs PyTorch model open-source Python package foundation-scale LLMs collaborative research platform NNsight NDIF