Hugging Face's logo

z-lab
/
sparselora-svd-estimator

Other
Transformers
English
Model card Files
xet
Community
2
Skhaki commited on
Commit
ffb723d
·
verified ·
1 Parent(s): 4d84dec

Upload barc0/Llama-3.1-ARC-Potpourri-Transduction-8B SVD Sparsity Estimators (#2)

Browse files

- Upload barc0/Llama-3.1-ARC-Potpourri-Transduction-8B SVD Sparsity Estimators (770c879ebcdd3f97819f43a513b7f58a5c5c0084)

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_k_low_rank_a.pt +3 -0
  2. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_k_low_rank_b.pt +3 -0
  3. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_q_low_rank_a.pt +3 -0
  4. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_q_low_rank_b.pt +3 -0
  5. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_v_low_rank_a.pt +3 -0
  6. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_v_low_rank_b.pt +3 -0
  7. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_k_low_rank_a.pt +3 -0
  8. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_k_low_rank_b.pt +3 -0
  9. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_q_low_rank_a.pt +3 -0
  10. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_q_low_rank_b.pt +3 -0
  11. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_v_low_rank_a.pt +3 -0
  12. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_v_low_rank_b.pt +3 -0
  13. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_k_low_rank_a.pt +3 -0
  14. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_k_low_rank_b.pt +3 -0
  15. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_q_low_rank_a.pt +3 -0
  16. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_q_low_rank_b.pt +3 -0
  17. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_v_low_rank_a.pt +3 -0
  18. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_v_low_rank_b.pt +3 -0
  19. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_k_low_rank_a.pt +3 -0
  20. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_k_low_rank_b.pt +3 -0
  21. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_q_low_rank_a.pt +3 -0
  22. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_q_low_rank_b.pt +3 -0
  23. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_v_low_rank_a.pt +3 -0
  24. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_v_low_rank_b.pt +3 -0
  25. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_k_low_rank_a.pt +3 -0
  26. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_k_low_rank_b.pt +3 -0
  27. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_q_low_rank_a.pt +3 -0
  28. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_q_low_rank_b.pt +3 -0
  29. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_v_low_rank_a.pt +3 -0
  30. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_v_low_rank_b.pt +3 -0
  31. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_k_low_rank_a.pt +3 -0
  32. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_k_low_rank_b.pt +3 -0
  33. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_q_low_rank_a.pt +3 -0
  34. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_q_low_rank_b.pt +3 -0
  35. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_v_low_rank_a.pt +3 -0
  36. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_v_low_rank_b.pt +3 -0
  37. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_k_low_rank_a.pt +3 -0
  38. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_k_low_rank_b.pt +3 -0
  39. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_q_low_rank_a.pt +3 -0
  40. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_q_low_rank_b.pt +3 -0
  41. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_v_low_rank_a.pt +3 -0
  42. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_v_low_rank_b.pt +3 -0
  43. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_k_low_rank_a.pt +3 -0
  44. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_k_low_rank_b.pt +3 -0
  45. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_q_low_rank_a.pt +3 -0
  46. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_q_low_rank_b.pt +3 -0
  47. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_v_low_rank_a.pt +3 -0
  48. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_v_low_rank_b.pt +3 -0
  49. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.16.self_attn_k_low_rank_a.pt +3 -0
  50. barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.16.self_attn_k_low_rank_b.pt +3 -0
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fffd5bd5efb8e03999d068e8f1f375374effdc24eb1cf8df60ceb3a8d15a965
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fde04b312c53ec3d0474943043df8f80361c8dc577b6ae0c4756ef83fc4604c0
3
+ size 17748
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11710d5be2d6aa34f608d8266648bd88a16727425ebcee5e92452230723cc1e6
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd98ab9ae2a54eb34aeb02b53eef030ae07b903cd32872a6a5f55248d789e0a3
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6135d38a8b2184ddbcf7185eb365c51cf4dc6ac5b48b47788df1c8e5126793a9
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.0.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff4a3035c98e4309fd6c469119e0c463b0d3bd6cc30d24b704d41f4018bb9f97
3
+ size 17748
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc83598206022e7ee6c01445cc6dff26585cbd6b51fd6fd867cbf2af776d1e2e
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b13c8b3e3403ddf39ef852caaf2e111a7190a2fab22686f7030375d729300a7
3
+ size 17748
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7676f3c7f00e6c2bb58fcb4a9b795c0fec8b67f64470b84a0a76d57c0a3e01e
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75a3b104fdbd119bac2a9403dba2feb432e2679a9f7c4addb68608ad6ea6a360
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44b3a7f21734fc8b56e20f95f3211b1672fa3218a214655d2d5c60d2cbec86cf
3
+ size 66900
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.1.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:845c66dc403c6a962032cf6b0be96e65cbee37c93d9e6c8d99572d70360116b7
3
+ size 17748
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbc1e226f362020e02d2832d656511accf229b55f97275c25d9ed1a8a06b7817
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5aff74d3f45bc5154c3db74e785264c567b197450fadca0faf22bad4f3a6d6a
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7831499f133081d8f71db2f4e3067ba0fb67d9c7fa834f190520b105a5a950c4
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a40b61bfa07fd60af7994cd601dc06cd2e70e22875d6df072bcb194eae7f878
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:968506c18f5bbcd9594505407c3da176596b140d1b751ccdf08815b0c1a31283
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.10.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08001384d7c728cb10a061daee62ff377e57becedc92c7e435fbfbbece40b488
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aa1ad7871401f332f350b3555a1ff813346eebac43795d482797ea84daaaaf3
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2233224ff0a8d164c394c80b44595b58a0982e6e868113f0702d4df0d54fa07
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c89f9c405a32a9d36396ee2f285667333cf837ec426905f25b607c2753fd58c1
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8828cc59052680d94c515caabbe2f8bab9626713d271e71093beb74e562296f4
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6b5e7eafa6199acab8f4c1e1ff2549e0eff213c9a758be9f21e25dc7dfd3d9e
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.11.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:308fe3710350c17318e9bd1bcfbb52502f335043989d0088f3d1e99bb4650c43
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ed6a8c9dd1abe589de121fb523225abee0545a6ee46de1e811e6257c0122d96
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9457ef491dd7423654fa1e8a5566a69303ead12cbe876088e42ea304776fe834
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27226696ca0689902814d8b1341f448f951a0cf34035103b4a0a9526abb39b28
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43bd7e6d5a108f45d608ffe58986140273f75333756f5c601ca49f765aee7742
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba384a32b27beb73e50a2b970c8d50ccd2fbbd5c114f1b0be77f7ca7e8d3bc57
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.12.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ef5145f6fa6684357ada97ebde5d8d524f17dff4070a2f5808bf6a2b8ba02d0
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8c2d1cb7bd4fc534601a5fe1b0e0720c3b2e01786d7a826a8c4c7ba2ddc786f
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a70141ed4b1b0f83ad131bc36cec4698084f76a36a9cfb34d3a7ad43b2ba1cd
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8da605360456fc8108dbd2b8c5e72dec83a4cb1f816568a94bce50a444d2bcf3
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68671dabee6c04708f9fec5e949f8aae6e60b2fffe2c11950e744ec5c77019f9
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:565cdacd6a4cc471fc6af4e0689398e0d4345a2116b325f2b8b10a511238876e
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.13.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e8812f0990b2d8715f4c3bf3145f6dc1d35509342aac1a43711317133d2e61f
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f225e2c41666d3a45760cc781b76c9046e1674dab8b2b4b6af5653fa25b4d5e
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d06e5e0ee4bc1b9bf7eb7bfe257e83ecdf0263fa4c6b857c4355d2de36dd62c8
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72a8d218132ef0b1db886548598103a867760a62364f8f63ab0a791e780fe300
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e26355a3cf1398e98dfe075537e4415776b73d0c2baa4cce73f5d6b7c74cbc6d
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:194ba919cfc3ca35e6834911df3f357fedf9634f2e8c2e88a0c40d7037c9f47e
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.14.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86659081134506f38f60943883d406d2c737cb1670b82775d272960a7c544104
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ceea724edac1ba9edf7dce105b75be815da59d81446640aee70aacf796b4b6ae
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bfc6187691586143f2a0c31f5c101d7971526cb02f069a50e7a2d4856325094
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_q_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5d0fa8254b3c00386fb3fc932c65ad98f084a800c79cc823a662cf189fc88e1
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_q_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c49ed8eb274a1f18661406bd5656348298f421b5adf2c7bdf318c5524f57438
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_v_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44c3ff0956059de0c6fc04949d8a69509f2c675f23c15d5adb8ee181f1dfcc69
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.15.self_attn_v_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c327419bf9667a32ca2052f406c136051800fefd04faaf58dfa46bd6e9087e4b
3
+ size 17753
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.16.self_attn_k_low_rank_a.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfe66cd8024b907e6eb2b4a543b6c5002765208e9347f2e969f6bdbd77952673
3
+ size 66905
barc0/Llama-3.1-ARC-Potpourri-Transduction-8B/r_8/attn/layers.16.self_attn_k_low_rank_b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed4cab8f2430ce41b5d42ca40e305065243f760a2755605cc469f55eb3e9fb50
3
+ size 17753