Update README.md
Browse files
README.md
CHANGED
@@ -67,8 +67,11 @@ Results of the heuristic sub-network discoverd from the super-network:
|
|
67 |
|
68 |
## Model Sources
|
69 |
|
70 |
-
|
71 |
-
|
|
|
|
|
|
|
72 |
|
73 |
## Ethical Considerations
|
74 |
|
@@ -85,13 +88,25 @@ Intel is committed to respecting human rights and avoiding causing or contributi
|
|
85 |
## Citation
|
86 |
|
87 |
```bibtex
|
88 |
-
@inproceedings{
|
89 |
-
|
90 |
-
|
91 |
-
|
92 |
-
|
93 |
-
|
94 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
95 |
}
|
96 |
```
|
97 |
|
|
|
67 |
|
68 |
## Model Sources
|
69 |
|
70 |
+
**Repository:** [https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/LoNAS](https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/LoNAS)
|
71 |
+
|
72 |
+
**Paper:**
|
73 |
+
- [LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models](https://aclanthology.org/2024.lrec-main.940)
|
74 |
+
- [Low-Rank Adapters Meet Neural Architecture Search for LLM Compression](https://arxiv.org/abs/2501.16372)
|
75 |
|
76 |
## Ethical Considerations
|
77 |
|
|
|
88 |
## Citation
|
89 |
|
90 |
```bibtex
|
91 |
+
@inproceedings{munoz-etal-2024-lonas,
|
92 |
+
title = "{L}o{NAS}: Elastic Low-Rank Adapters for Efficient Large Language Models",
|
93 |
+
author = "Munoz, Juan Pablo and
|
94 |
+
Yuan, Jinjie and
|
95 |
+
Zheng, Yi and
|
96 |
+
Jain, Nilesh",
|
97 |
+
editor = "Calzolari, Nicoletta and
|
98 |
+
Kan, Min-Yen and
|
99 |
+
Hoste, Veronique and
|
100 |
+
Lenci, Alessandro and
|
101 |
+
Sakti, Sakriani and
|
102 |
+
Xue, Nianwen",
|
103 |
+
booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
|
104 |
+
month = may,
|
105 |
+
year = "2024",
|
106 |
+
address = "Torino, Italia",
|
107 |
+
publisher = "ELRA and ICCL",
|
108 |
+
url = "https://aclanthology.org/2024.lrec-main.940",
|
109 |
+
pages = "10760--10776",
|
110 |
}
|
111 |
```
|
112 |
|