Adding organization card and overview of the fine-tuned models
Browse files
README.md
CHANGED
@@ -1,10 +1,46 @@
|
|
1 |
---
|
2 |
title: README
|
3 |
-
emoji:
|
4 |
colorFrom: yellow
|
5 |
colorTo: gray
|
6 |
sdk: static
|
7 |
pinned: false
|
|
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
title: README
|
3 |
+
emoji: 馃搳
|
4 |
colorFrom: yellow
|
5 |
colorTo: gray
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
+
short_description: Organization card providing details on the fine-tuned models
|
9 |
---
|
10 |
|
11 |
+

|
12 |
+
|
13 |
+
Based on a government mandate, the Swiss National Science Foundation (SNSF) supports scientific research in all academic disciplines.
|
14 |
+
It is the leading organisation for the promotion of scientific research in Switzerland.
|
15 |
+
On the [Data Portal](https://data.snf.ch/), the SNSF publishes data on the evaluated projects and the persons involved in order to provide transparency and facilitate the analysis of funding activities.
|
16 |
+
|
17 |
+
In this space, the SNSF Data Team provides fine-tuned models for classifying grant peer review texts along 12 categories relevant to the evaluation criteria specified by the SNSF.
|
18 |
+
In particular, the models are based on the `allenai/specter2_base` model and fine-tuned for a binary classification task on a sentence level.
|
19 |
+
For more details, see the the following preprint:
|
20 |
+
|
21 |
+
**A Supervised Machine Learning Approach for Assessing Grant Peer Review Reports**
|
22 |
+
|
23 |
+
by [Gabriel Okasa](https://orcid.org/0000-0002-3573-7227),
|
24 |
+
[Alberto de Le贸n](https://orcid.org/0009-0002-0401-2618),
|
25 |
+
[Michaela Strinzel](https://orcid.org/0000-0003-3181-0623),
|
26 |
+
[Anne Jorstad](https://orcid.org/0000-0002-6438-1979),
|
27 |
+
[Katrin Milzow](https://orcid.org/0009-0002-8959-2534),
|
28 |
+
[Matthias Egger](https://orcid.org/0000-0001-7462-5132), and
|
29 |
+
[Stefan M眉ller](https://orcid.org/0000-0002-6315-4125), available on arXiv: https://arxiv.org/abs/2411.16662 .
|
30 |
+
|
31 |
+
The fine-tuned models are listed below together with the description of the respective classification category:
|
32 |
+
|
33 |
+
- `snsf-data/specter2-review-track-record`: *Does the sentence address the scientific qualifications of the applicant(s)/team?*
|
34 |
+
- `snsf-data/specter2-review-relevance-originality-topicality`: *Does the sentence address the scientific relevance/impact/originality of the proposed research project?*
|
35 |
+
- `snsf-data/specter2-review-suitability`: *Does the sentence address the suitability of the methods to be used within the proposed research project?*
|
36 |
+
- `snsf-data/specter2-review-feasibility`: *Does the sentence address the feasibility of the proposed research project?*
|
37 |
+
- `snsf-data/specter2-review-applicant`: *Does the sentence address the applicant(s)/team or their qualifications, without mentioning quantitative indicators?*
|
38 |
+
- `snsf-data/specter2-review-applicant-quantity`: *Does the sentence use quantitative indicators to describe the applicant(s)or team?*
|
39 |
+
- `snsf-data/specter2-review-proposal`: *Does the sentence address the proposal or specific parts of it, as opposed to the applicant(s) or context beyond the proposal (such as the research field or the funding scheme鈥檚 objectives etc.)?*
|
40 |
+
- `snsf-data/specter2-review-method`: *Does the sentence address the methods to be used in the proposed research project?*
|
41 |
+
- `snsf-data/specter2-review-positive`: *Is the sentence itself a positive statement or does it contain a positive statement?*
|
42 |
+
- `snsf-data/specter2-review-negative`: *Is the sentence itself a negative statement or does it contain a negative statement?*
|
43 |
+
- `snsf-data/specter2-review-suggestion`: *Does the sentence suggest how to improve the proposal?*
|
44 |
+
- `snsf-data/specter2-review-rationale`: *Does the sentence provide rationale supporting the positive or negative statement?*
|
45 |
+
|
46 |
+
The model cards provide further details on the fine-tuning procedure and evaluation metrics as well as minimal examples for usage of the models.
|