Upload folder using huggingface_hub

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+  "word_embedding_dimension": 768,
+  "pooling_mode_cls_token": false,
+  "pooling_mode_mean_tokens": true,
+  "pooling_mode_max_tokens": false,
+  "pooling_mode_mean_sqrt_len_tokens": false,
+  "pooling_mode_weightedmean_tokens": false,
+  "pooling_mode_lasttoken": false,
+  "include_prompt": true
+}

README.md

@@ -0,0 +1,693 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:8000
+- loss:MultipleNegativesRankingLoss
+base_model: sentence-transformers/all-distilroberta-v1
+widget:
+- source_sentence: Does inhibition of autophagy by 3-MA enhance the effect of 5-FU-induced
+    apoptosis in colon cancer cells?
+  sentences:
+  - Insulin- and insulin growth factor-1 stimulated signaling through the insulin
+    receptor substrate-1 (IRS-1) promotes hepatocellular proliferation and survival.
+    IRS-1 over-expression in transgenic (Tg) mouse livers caused constitutive activation
+    of Erk mitogen activated protein kinase (MAPK) and phosphatidylinositol-3 kinase
+    (PI3K) resulting in significantly increased levels of DNA synthesis and larger
+    hepatic masses relative to non-transgenic (non-Tg) littermates. However, the livers
+    eventually ceased to grow but remained approximately 25% larger than non-Tg livers.
+    We hypothesized that this growth homeostasis was achieved by parallel activation
+    of pro-apoptosis pathways. Since Fas-mediated apoptosis is a common mechanism
+    of hepatocyte destruction, we investigated the potential role of Fas receptor
+    as a regulator of hepatic mass in IRS-1 transgenic mice. Significantly increased
+    Fas-receptor levels were detected in the livers of IRS-1 Tg compared to non-Tg
+    mice by Western blot analysis. Functional activation of Fas-receptor in IRS-1
+    Tg livers was demonstrated by increased hepatocellular apoptosis caused by intravenous
+    injection of anti-Fas (Jo-2).
+  - 5-fluorouracil-(5-FU)-based adjuvant chemotherapy is widely used for the treatment
+    of colorectal cancer. However, 5-FU resistance in the course of treatment has
+    become more common. Therefore, new therapeutic strategies and/or new adjuvant
+    drugs still need to be explored. Two colon-cancer-derived cell lines, colon26
+    and HT29, were used to investigate the effect of 5-FU, 3-methyladenine (3-MA,
+    an autophagy inhibitor), or their combination on apoptotic cell death and autophagy.
+    MTT assay, Hochest plus propidium iodide (PI) staining, and DNA fragmentation
+    assay were used to observe apoptosis. Meanwhile, monodansylcadaverine (MDC) was
+    used to detect autophagy. Finally, immunoblotting assay was used to explore the
+    molecular change that occurred. We observed the apoptosis induced by 5-FU in colon
+    cancer cells. Meanwhile, autophagy was also stimulated. The combination treatment
+    of 3-MA and 5-FU significantly increased the apoptotic cell death. By isolating
+    the subcellular fractions of mitochondria and cytosol, we observed that the release
+    of cytochrome c was increased in combination-treated cells. Cytochrome c resulted
+    in the activation of caspase-3, thus activating PARP. Moreover, the anti-apoptotic
+    protein, Bcl-xL, was significantly downregulated by 3-MA.
+  - To measure the serum highly sensitive C-reactive protein (hs-CRP) and adiponectin
+    levels, assess insulin sensitivity index (SI) and acute insulin response (AIR)
+    in normal control (NC) subjects, patients with impaired glucose tolerance (IGT)
+    and newly diagnosed type 2 diabetes mellitus (DM), and further explore the possible
+    correlation between hs-CRP and SI, AIR and adiponectin in IGT and newly diagnosed
+    type 2 DM groups. Age and sex matched 28 normal subjects, 31 patients with IGT,
+    and 31 patients with newly diagnosed type 2 DM were included in the study. SI
+    and AIR were assessed by the reduced sample number of Bergman's minimal model
+    method with intravenous glucose tolerance test in subjects of each group. Compared
+    with NC group, serum hs-CRP was significantly increased in IGT and type 2 DM groups
+    (p < 0.001), although there was no significant difference between the latter groups.
+    Hs-CRP was negatively correlated with high density lipoprotein cholesterol (HDL-C),
+    SI and adiponectin levels (p < 0.05 to p < 0.001), and positively correlated with
+    systolic blood pressure (SBP), fasting plasma glucose (FPG), BMI, waist-to-hip
+    ratio (WHR), postprandial 2h plasma glucose (2hPG), fasting serum insulin (FINS)
+    and postprandial serum insulin (PSI) in IGT and newly diagnosed type 2 DM groups
+    (p < 0.05 to p < 0.001). In general multivariate regression, only adiponectin
+    was the significantly independent determinant for serum hs-CRP (regression coefficient
+    -1.380; 95% CI -2.062 to 0.698, p < 0.001); meanwhile, TG, SI, hs-CRP, FINS, 2hPG
+    and WHR were significantly independent determinants for serum adiponectin concentration
+    (p < 0.05 to p < 0.001).
+- source_sentence: Is myostatin expression altered by insulin deficiency and replacement
+    in streptozotocin-diabetic rat skeletal muscles?
+  sentences:
+  - 'Insulin is a major post-prandial muscle-anabolic hormone. A substantial loss
+    of skeletal muscle mass occurs in insulin-deprived diabetes and is reversed by
+    insulin treatment. Myostatin is a negative regulator of muscle mass upregulated
+    in several chronic catabolic conditions. Whether myostatin expression is altered
+    in insulin-deprived diabetes is unknown. In spite of opposite effects on muscle
+    mass the potential role of basal circulating insulin in the regulation of myostatin
+    expression is also undetermined. We measured (Northern Blot) myostatin transcript
+    levels in muscle groups with different fiber composition in streptozotocin-diabetic
+    male rats receiving one of the following treatments for eight weeks: (1) control
+    (C); (2) diabetes without treatment (DM); (3) diabetes with once-daily slow-acting
+    insulin treatment (INS). INS normalized plasma insulin and prevented weight reduction
+    observed in DM. In fast-twitch gastrocnemius muscle myostatin transcript levels
+    were unchanged (P>0.4) in both DM and INS compared to C. Myostatin transcripts
+    were not measurable in any group in slow-twitch soleus muscle.'
+  - A 'cannot intubate-cannot ventilate' situation requires emergency insertion of
+    an infraglottic surgical airway. We present a case of postoperative macroglossia
+    requiring emergency insertion of an uncuffed percutaneous cricothyroidotomy tube.
+    The supraglottic leak was eliminated by the insertion of a laryngeal mask airway
+    with an occluded 15-mm connector. A 49-yr-old man underwent clipping of a left
+    posterior inferior cerebellar artery aneurysm and his tracheal tube was removed
+    postoperatively. Two hours later, he became dyspneic and developed significant
+    macroglossia. After application of topical anesthesia, direct laryngoscopy, oral
+    fibreoptic bronchoscopy and laryngeal mask insertion were unsuccessful. The patient
+    became progressively hypoxemic, pulseless electrical activity ensued, and cardiopulmonary
+    resuscitation was initiated. An uncuffed percutaneous cricothyroidotomy tube was
+    inserted. Oxygenation and hemodynamics were restored. As the cricothyroidotomy
+    tube was uncuffed, there was a large supraglottic leak with manual ventilation.
+    A laryngeal mask airway was inserted and the cuff was inflated. The 15-mm connector
+    was occluded by a piece of tape. Subsequently, there was no further supraglottic
+    leak with manual ventilation. He was taken to operating room and a surgical tracheotomy
+    was performed.
+  - 'Sepsis is an emergency condition with high mortality and morbidity rate. There
+    are limited data on the association of cancer as a risk factor for mortality in
+    sepsis patients in the emergency department (ED). This retrospective study was
+    conducted at the ED, Faculty of Medicine, Ramathibodi Hospital, Bangkok, Thailand.
+    The study period was between January 1st and December 31st, 2014. The inclusion
+    criteria were as follows: adult patients over 15 years of age who presented at
+    the ED with suspicion of sepsis, received treatment at the ED, and whose blood
+    culture was found to be positive. Clinical data were recorded from medical records
+    including the Mortality in Emergency Department Sepsis score (MEDS score). The
+    primary outcome of this study was mortality at one month. Multivariate logistic
+    regression analysis was used to identify independent factors associated with death.
+    During the study period, there were 775 eligible patients. The two most common
+    pathogens identified from blood cultures were Staphylococcus aureus (193 patients;
+    24.9%) and Escherichia coli (158 patients; 20.4%). At one month after presenting
+    at the ED, 110 patients (14.2%) had died. There were four significant factors
+    for death, having cancer, being on an endotracheal tube, initial diagnosis of
+    bacteremia, and high MED scores. Having cancer had an adjusted OR of 2.12 (95%
+    CI of 1.29, 3.47).'
+- source_sentence: Is elevated plasma aldosterone an independent risk factor for erectile
+    dysfunction in men?
+  sentences:
+  - The aims of this study were to demonstrate the tumorigenicity of CD133+ colon
+    cancer cells in vitro, analyze the correlations between spheroid formation and
+    clinicopathologic variables, and screen for overexpressed genes in CD133+ colon
+    cancer stem cells. Moreover, the aim of this study was to establish a living tumor
+    tissue bank using surgically resected specimens. Using LoVo cell line, we isolated
+    CD133+ cells and performed clonogenic assay and animal experiment to test tumorigenicity
+    of CD133+ cells. Twenty-nine surgical samples were freshly collected from 27 patients
+    who received curative or palliative surgery, and the samples were mechanically
+    and enzymatically dissociated into single cells. We confirmed the enhanced tumorigenicity
+    of CD133+ cells isolated from LoVo cell line both in vitro and in vivo. Of these
+    29 samples, 8 (28%) contained >3% CD133+ cells. Sphere formation was significantly
+    higher in samples from patients with lymphatic invasion than in those without
+    lymphatic invasion [54.5% (6/11) vs. 12.5% (2/16); P=0.033] and in samples containing
+    >3% of CD133+ cells than in those containing ≤3% of CD133+ cells [36.4% (4/11)
+    vs. 0% (0/16); P=0.019].
+  - Erectile dysfunction (ED) and cardiovascular disease (CVD) share a great number
+    of common risk factors. There is growing evidence that aldosterone, an independent
+    CVD risk factor, is associated with ED. The purpose of this study was to determine
+    the relationship between plasma aldosterone and erectile dysfunction. This study
+    recruited 287 participants, ranging from 18 to 84 years old; 217 were suffering
+    from ED, diagnosed by the International Index of Erectile Function 5 (IIEF-5)
+    scores. Based on IIEF-5 scores, patients were divided into one control group and
+    three ED groups (mild ED; moderate ED; severe ED). The differences in principal
+    characteristics, blood routine, sexual hormone, adrenal hormone, thyroid hormone,
+    renal function, liver function and blood lipid were compared between ED and control
+    groups. Our study demonstrated that the difference of mean plasma aldosterone
+    levels between ED group and the control group was statistically significant (P < 0.05).
+    Stepwise logistic regression analysis of all the possible factors support the
+    role of aldosterone as an independent risk factor for ED (OR 1.011; 95 % CI 1.003-1.018;
+    P = 0.004). Similar statistical methods were applied to the comparison between
+    moderate to severe ED group and control to mild ED group (OR 1.017; 95 % CI 1.009-1.024;
+    P < 0.001). ROC curve and the area under the curve (0.718; 95 % CI 0.643-0.794;
+    P < 0.001) were performed to assess the diagnostic effect and to compare the severity
+    of risk with the known independent risk factors, such as age and cholesterol (0.704;
+    95 % CI 0.631-0.778; P < 0.001). When using a 374 pg/mL cut-off value from Youden
+    index, the OR of ED group versus controls is 3.106 (95 % CI 1.458-6.617), while
+    the OR of moderate to severe ED versus control and mild ED is 5.480 (95 % CI 3.108-9.662).
+  - 'The objective of this study was to examine clinical outcomes and recanalization
+    rates in a multicenter cohort of stroke patients receiving intravenous tissue
+    plasminogen activator by site of occlusion localized with bedside transcranial
+    Doppler. Angiographic studies with intraarterial thrombolysis suggest more proximal
+    occlusions carry greater thrombus burden and benefit less from local therapy.
+    Using validated transcranial Doppler criteria for specific arterial occlusion
+    (Thrombolysis in Brain Ischemia flow grades), we compared the rate of dramatic
+    recovery (National Institutes of Health Stroke Scale score < or =2 at 24 hours)
+    and favorable outcomes at 3 months (modified Rankin Scale < or =1) for each occlusion
+    site. We determined the likelihood of recanalization at various occlusion sites
+    and its predictors. Then, stepwise logistic regression was used to determine predictors
+    of complete recanalization. Three hundred thirty-five patients had a mean age
+    69+/-13 years and 48.5% were women (median baseline National Institutes of Health
+    Stroke Scale score 16 [range, 3 to 32], mean time to transcranial Doppler 140+/-84
+    minutes, and mean time to intravenous tissue plasminogen activator 145+/-68 minutes).
+    Distal middle cerebral artery occlusion had an OR of 2 for complete recanalization
+    (50 of 113 [44.2%], 95% CI: 1.1 to 3.1, P=0.005), proximal middle cerebral artery
+    0.7 (49 of 163 [30%], 95% CI: 0.4 to 1.1, P=0.13), terminal internal carotid artery
+    0.1 (one of 17 [5.9%], 95% CI: 0.015 to 0.8, P=0.015), tandem cervical internal
+    carotid artery/middle cerebral artery 0.7 (6 of 22 [27%], 95% CI: 0.3 to 1.9,
+    P=0.5), and basilar artery 0.96 (3 of 10 [30%], 95% CI: 0.2 to 4, P=0.9). Prerecombinant
+    tissue plasminogen activator National Institutes of Health Stroke Scale score,
+    systolic blood pressure, glucose, and Thrombolysis in Brain Ischemia flow grade
+    at the occlusion site were the negative independent predictors for complete recanalization
+    in the final model. There were no associations among time to treatment, stroke
+    mechanisms, or recanalization rate. Patients with no flow (Thrombolysis in Brain
+    Ischemia 0) at the occlusion site had less probability of complete recanalization
+    than patients with dampened flow (Thrombolysis in Brain Ischemia 3) (OR(adj):
+    0.256, 95% CI: 0.11 to 0.595, P=0.002). Continuous transcranial Doppler monitoring
+    (exposure to ultrasound) was a positive predictor for complete recanalization
+    (OR(adj): 3.02, 95% CI: 1.396 to 6.514, P=0.005). National Institutes of Health
+    Stroke Scale score < or =2 at 24 hours was achieved in 66 of 305 patients (22%):
+    distal middle cerebral artery 33% (35 of 107), tandem cervical internal carotid
+    artery/middle cerebral artery 24% (5 of 21), proximal middle cerebral artery 16%
+    (24 of 155), basilar artery 25% (2 of 8), and none of the patients with terminal
+    internal carotid artery had dramatic recovery (0%, n=14; P=0.003). Modified Rankin
+    Scale score < or =1 was achieved in 90 of 260 patients (35%): distal middle cerebral
+    artery 52% (50 of 96), proximal middle cerebral artery 25% (33 of 131), tandem
+    cervical internal carotid artery/middle cerebral artery 21% (3 of 14), terminal
+    internal carotid artery 18% (2 of 11), and basilar artery 25% (2 of 8) (P<0.001).
+    Patients with distal middle cerebral artery occlusion were twice as likely to
+    have a good long-term outcome as patients with proximal middle cerebral artery
+    (OR: 2.1, 95% CI: 1.1 to 4, P=0.025).'
+- source_sentence: Is the Artificial Urinary Sphincter Superior to a Secondary Transobturator
+    Male Sling in Cases of a Primary Sling Failure?
+  sentences:
+  - We compared continence outcomes in patients with post-prostatectomy stress urinary
+    incontinence treated with a salvage artificial urinary sphincter vs a secondary
+    transobturator sling. We retrospectively reviewed the records of patients undergoing
+    salvage procedures after sling failure from 2006 to 2012. Postoperative success
+    was defined as the use of 0 or 1 pad, a negative stress test and pad weight less
+    than 8 gm per day. We performed the Wilcoxon test and used a Cox regression model
+    and Kaplan-Meier survival analysis. A total of 61 men presenting with sling failure
+    were included in study, of whom 32 went directly to an artificial urinary sphincter
+    and 29 received a secondary sling. Of the artificial urinary sphincter cohort
+    47% underwent prior external beam radiation therapy vs 17% of the secondary sling
+    cohort (p = 0.01). Average preoperative 24 hour pad weight and pad number were
+    higher in the artificial urinary sphincter cohort. Median followup in artificial
+    urinary sphincter and secondary sling cases was 4.5 (IQR 4-12) and 4 months (IQR
+    1-5), respectively. Overall treatment failure was seen in 55% of patients (16
+    of 29) with a secondary sling vs 6% (2 of 32) with an artificial urinary sphincter
+    (unadjusted HR 7, 95% CI 2-32 and adjusted HR 6, 95% CI 1-31).
+  - Subcortical band heterotopia (SBH) is a cortical malformation formed when neocortical
+    neurons prematurely stop their migration in the white matter, forming a heterotopic
+    band below the normotopic cortex, and is generally associated with intractable
+    epilepsy. Although it is clear that the band heterotopia and the overlying cortex
+    both contribute to creating an abnormal circuit prone to generate epileptic discharges,
+    it is less understood which part of this circuitry is the most critical. Here,
+    we sought to identify the origin of epileptiform activity in a targeted genetic
+    model of SBH in rats. Rats with SBH (Dcx-KD rats) were generated by knocking down
+    the Dcx gene using shRNA vectors transfected into neocortical progenitors of rat
+    embryos. Origin, spatial extent, and laminar profile of bicuculline-induced interictal-like
+    activity on neocortical slices were analyzed by using extracellular recordings
+    from 60-channel microelectrode arrays. Susceptibility to pentylenetetrazole-induced
+    seizures was assessed by electrocorticography in head-restrained nonanesthetized
+    rats. We show that the band heterotopia does not constitute a primary origin for
+    interictal-like epileptiform activity in vitro and is dispensable for generating
+    induced seizures in vivo. Furthermore, we report that most interictal-like discharges
+    originating in the overlying cortex secondarily propagate to the band heterotopia.
+    Importantly, we found that in vivo suppression of neuronal excitability in SBH
+    does not alter the higher propensity of Dcx-KD rats to display seizures.
+  - 'Cardiac glycosides such as digoxin and their endogenous counterpart digoxin-like
+    immunoreactive factor (DLIF) may possess anti-inflammatory properties. Pro-inflammatory
+    cytokines from human peripheral blood mononuclear cells (PBMC) were measured by
+    ELISA using specific antibodies. Immunocytochemistry was used to localize NF-K:
+    B. Non-stimulated PBMC constitutively secreted minimum amounts of cytokines. LPS
+    (1 mg/L) stimulation lead to steep increases in TNF-alpha, IL-6 and IL-8 concentrations
+    with peak rises at 8 h. An 8 h delay was observed for IL-10. Increases in IL-10
+    were sustained for18 h period. Significant inhibition (P > 0.05) of TNF-alpha,
+    IL-6 and IL-8 at non-toxic of digoxin concentration (< 100 nM) and DLIF (10 nM
+    digoxin equivalent (de)) was observed whereas no such effect was seen for IL-10.
+    Inhibition of the degradation of activated NF-K: B in the PBMC was observed with
+    the indicated concentrations of digoxin, DLIF or Pyrrolidine dithiocarbamate (PDTC).'
+- source_sentence: Do transport properties of pancreatic cancer describe gemcitabine
+    delivery and response?
+  sentences:
+  - Hormone receptor-positive, pre-menopausal breast cancer patients can be treated
+    by chemotherapy and/or ovarian suppression therapy. We reported our experience
+    of gonadotropin-releasing hormone analogue plus tamoxifen (GnRHa+T) or adriamycin
+    and cyclophosphamide (AC) followed by tamoxifen (AC-->T) in pre-menopausal women
+    with hormone-response, node-negative breast cancer. We retrospectively reviewed
+    the records of 587 pre-menopausal women with hormone-responsive, node-negative
+    breast cancer. Of these, 269 were treated with adriamycin and cyclophosphamide
+    (AC) followed by tamoxifen (AC-->T), and 318 were treated with gonadotropin-releasing
+    hormone analogue plus tamoxifen (GnRHa+T). Among them, 151 patients were treated
+    by goserelin acetate 3.6 mg/kg and 125 patients were treated by leuprorelin acetate
+    3.75 mg/kg every 28 days subcutaneously. At a median follow-up time of 30 months,
+    eight patients had relapsed and three had died. DFS did not differ between the
+    AC-->T and GnRHa+T groups. Of the three deaths, two were not related to breast
+    cancer. The third patient, in the AC-->T group, died because of brain metastasis.
+    GnRHa+T treatment had no effect on blood profile and did not cause the development
+    of detrimental symptoms but decreased bone mineral density. The efficacy of leuprorelin
+    was similar to that of goserelin.
+  - Atopy and systemic onset juvenile idiopathic arthritis (SoJIA) are two potential
+    outcomes of a dysregulated immune system. Although rare, SoJIA causes 60% of the
+    morbidity of JIA patients which exhibit a wide heterogeneity of prognosis and
+    treatment. Co-morbidities can complicate the responses to therapy. To study the
+    influence of co-existing atopy on the prognosis of SoJIA. Patients diagnosed with
+    SoJIA between Jan 2006 and Sep 2010 were screened, enrolled in this prospective
+    cohort study, and followed for 2 years. Management of SoJIA patients was assessed
+    by ACR Pedi30/50/70 criteria, laboratory variables, and systemic feature score.
+    At disease onset, 61 SoJIA patients (34 male and 27 female) were enrolled and
+    were divided into SoJIA patients with atopy (n = 27) or those without atopy (n = 34).
+    Atopic group at disease onset had significantly higher numbers of affected joints,
+    ferritin levels and IgE serum levels than the non-atopic group. At 3 and 6 months,
+    fewer SoJIA patients with atopy reached the ACR Pedi50 criteria (p < 0.02). During
+    the 2 years of follow-up time, the number of infections and the number of flares
+    were significantly higher in the SoJIA with atopy group (p < 0.01).
+  - The therapeutic resistance of pancreatic ductal adenocarcinoma (PDAC) is partly
+    ascribed to ineffective delivery of chemotherapy to cancer cells. We hypothesized
+    that physical properties at vascular, extracellular, and cellular scales influence
+    delivery of and response to gemcitabine-based therapy. We developed a method to
+    measure mass transport properties during routine contrast-enhanced CT scans of
+    individual human PDAC tumors. Additionally, we evaluated gemcitabine infusion
+    during PDAC resection in 12 patients, measuring gemcitabine incorporation into
+    tumor DNA and correlating its uptake with human equilibrative nucleoside transporter
+    (hENT1) levels, stromal reaction, and CT-derived mass transport properties. We
+    also studied associations between CT-derived transport properties and clinical
+    outcomes in patients who received preoperative gemcitabine-based chemoradiotherapy
+    for resectable PDAC. Transport modeling of 176 CT scans illustrated striking differences
+    in transport properties between normal pancreas and tumor, with a wide array of
+    enhancement profiles. Reflecting the interpatient differences in contrast enhancement,
+    resected tumors exhibited dramatic differences in gemcitabine DNA incorporation,
+    despite similar intravascular pharmacokinetics. Gemcitabine incorporation into
+    tumor DNA was inversely related to CT-derived transport parameters and PDAC stromal
+    score, after accounting for hENT1 levels. Moreover, stromal score directly correlated
+    with CT-derived parameters. Among 110 patients who received preoperative gemcitabine-based
+    chemoradiotherapy, CT-derived parameters correlated with pathological response
+    and survival.
+datasets:
+- subhrajit-mohanty/PubMedQA_instruction_fotmatted
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+metrics:
+- cosine_accuracy
+model-index:
+- name: SentenceTransformer based on sentence-transformers/all-distilroberta-v1
+  results:
+  - task:
+      type: triplet
+      name: Triplet
+    dataset:
+      name: ai pubmed validation
+      type: ai-pubmed-validation
+    metrics:
+    - type: cosine_accuracy
+      value: 1.0
+      name: Cosine Accuracy
+---
+
+# SentenceTransformer based on sentence-transformers/all-distilroberta-v1
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-distilroberta-v1](https://huggingface.co/sentence-transformers/all-distilroberta-v1) on the [pub_med_qa_instruction_fotmatted](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [sentence-transformers/all-distilroberta-v1](https://huggingface.co/sentence-transformers/all-distilroberta-v1) <!-- at revision 842eaed40bee4d61673a81c92d5689a8fed7a09f -->
+- **Maximum Sequence Length:** 512 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [pub_med_qa_instruction_fotmatted](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: RobertaModel 
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    'Do transport properties of pancreatic cancer describe gemcitabine delivery and response?',
+    'The therapeutic resistance of pancreatic ductal adenocarcinoma (PDAC) is partly ascribed to ineffective delivery of chemotherapy to cancer cells. We hypothesized that physical properties at vascular, extracellular, and cellular scales influence delivery of and response to gemcitabine-based therapy. We developed a method to measure mass transport properties during routine contrast-enhanced CT scans of individual human PDAC tumors. Additionally, we evaluated gemcitabine infusion during PDAC resection in 12 patients, measuring gemcitabine incorporation into tumor DNA and correlating its uptake with human equilibrative nucleoside transporter (hENT1) levels, stromal reaction, and CT-derived mass transport properties. We also studied associations between CT-derived transport properties and clinical outcomes in patients who received preoperative gemcitabine-based chemoradiotherapy for resectable PDAC. Transport modeling of 176 CT scans illustrated striking differences in transport properties between normal pancreas and tumor, with a wide array of enhancement profiles. Reflecting the interpatient differences in contrast enhancement, resected tumors exhibited dramatic differences in gemcitabine DNA incorporation, despite similar intravascular pharmacokinetics. Gemcitabine incorporation into tumor DNA was inversely related to CT-derived transport parameters and PDAC stromal score, after accounting for hENT1 levels. Moreover, stromal score directly correlated with CT-derived parameters. Among 110 patients who received preoperative gemcitabine-based chemoradiotherapy, CT-derived parameters correlated with pathological response and survival.',
+    'Atopy and systemic onset juvenile idiopathic arthritis (SoJIA) are two potential outcomes of a dysregulated immune system. Although rare, SoJIA causes 60% of the morbidity of JIA patients which exhibit a wide heterogeneity of prognosis and treatment. Co-morbidities can complicate the responses to therapy. To study the influence of co-existing atopy on the prognosis of SoJIA. Patients diagnosed with SoJIA between Jan 2006 and Sep 2010 were screened, enrolled in this prospective cohort study, and followed for 2 years. Management of SoJIA patients was assessed by ACR Pedi30/50/70 criteria, laboratory variables, and systemic feature score. At disease onset, 61 SoJIA patients (34 male and 27 female) were enrolled and were divided into SoJIA patients with atopy (n\u2009=\u200927) or those without atopy (n\u2009=\u200934). Atopic group at disease onset had significantly higher numbers of affected joints, ferritin levels and IgE serum levels than the non-atopic group. At 3 and 6 months, fewer SoJIA patients with atopy reached the ACR Pedi50 criteria (p\u2009<\u20090.02). During the 2 years of follow-up time, the number of infections and the number of flares were significantly higher in the SoJIA with atopy group (p\u2009<\u20090.01).',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+## Evaluation
+
+### Metrics
+
+#### Triplet
+
+* Dataset: `ai-pubmed-validation`
+* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
+
+| Metric              | Value   |
+|:--------------------|:--------|
+| **cosine_accuracy** | **1.0** |
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### pub_med_qa_instruction_fotmatted
+
+* Dataset: [pub_med_qa_instruction_fotmatted](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted) at [66d9473](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted/tree/66d9473c747f2e73a050b733f8a871cf37281b93)
+* Size: 8,000 training samples
+* Columns: <code>instruction</code>, <code>context</code>, and <code>context_neg</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | instruction                                                                        | context                                                                              | context_neg                                                                          |
+  |:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                             | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 12 tokens</li><li>mean: 26.21 tokens</li><li>max: 56 tokens</li></ul> | <ul><li>min: 20 tokens</li><li>mean: 320.41 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 24 tokens</li><li>mean: 319.78 tokens</li><li>max: 512 tokens</li></ul> |
+* Samples:
+  | instruction                                                                                                                                                                              | context                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | context_neg                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
+  |:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>Do adipose-derived mesenchymal stem cells ameliorate STZ-induced pancreas damage in type 1 diabetes?</code>                                                                        | <code>To investigate the possibility of adipose-derived mesenchymal stem cells (ADSC) in the treatment of type 1 diabetes (T1D). ADSC were isolated from the adipotic tissue of abdomen in Sprague-Dawley rats (4-6 week-old,female) and expanded in vitro. Cells were then identified by testing their phenotypes through flow cytometry. Balb/c mice (8 week-old, male) were divided into 3 groups: T1D group, ADSC group and control group. Streptozocin (50 mg/kg·d) were injected intraperitoneally into mice of T1D group and ADSC group for 5 consecutive days to establish the T1D model. In ADSC group, ADSC were injected intravenously on day 3 of STZ injection. In control group, only PBS was injected. Fasting blood glucose (FGB) level was examined once a week. At the end of the 4th week, animals were killed. The pathological changes of islet were showed by histochemistry through hematoxylin-eosin staining (HE staining). β cell insulin expression was detected by quantum dots immunofluorescence histochemistry....</code> | <code>We conducted this pooled analysis to assess the prognostic value of pretreatment Quality of Life (QOL) assessments on overall survival (OS) in advanced non-small cell lung cancer (NSCLC). Four hundred twenty patients with advanced NSCLC (stages IIIB with pleural effusion and IV) from six North Central Cancer Treatment Group trials were included in this study. QOL assessments included the single-item Uniscale (355 patients), Lung Cancer Symptom Scale (217 patients), and Functional Assessment of Cancer Therapy-Lung (197 patients). QOL scores were transformed to a 0 to 100 scale with higher scores representing better status and categorized using the sample median or clinically deficient score (CDS, <or=50 versus >50). Cox proportional hazards models stratified by study were used to evaluate the prognostic importance of QOL on OS alone and in the presence of other prognostic factors such as performance status, age, gender, body mass index, and laboratory parameters. Pretreatment QOL access...</code> |
+  | <code>Is prevalence of asthma and allergic diseases in Croatian children increasing : survey study?</code>                                                                               | <code>To estimate the prevalence of asthma, allergic rhinitis, and atopic dermatitis among school children in the region of Primorsko-goranska County in Croatia, and compare the results with data from other countries. The study was conducted during the 2001-2002 school year, in complete adherence to the Phase One protocol of the International Study of Asthma and Allergies in Childhood (ISAAC). The target population comprised two age groups (6-7 and 13-14 years) in the region of Primorsko-Goranska County in Croatia. Data were collected using standardized ISAAC written questionnaire and asthma video questionnaire. There were 1,634 participating children in the 6-7 age group (response rate 80.3%) and 2,194 participating children in the 13-14 age group (response rate 89.8%). Estimated 12-month prevalence rates of symptoms were: wheezing 9.7% and 8.4%, allergic rhinitis symptoms 16.9% and 17.5%, allergic rhinoconjunctivitis symptoms 5.6% and 6.7%, and atopic dermatitis symptoms 5.4% and 3.4%, for...</code> | <code>Leaks of the blood-brain barrier can be detected on postcontrast-enhanced T1-weighted MRIs. Although early disruptions of the blood-brain barrier appear to be an important risk factor for tissue plasminogen activator-related hemorrhages in rodents, little is known about their incidence and consequences in human stroke. This is a retrospective analysis of a prospectively collected stroke database over the past 6 years. In 52 patients, multimodal MRI (including diffusion-weighted, perfusion-weighted, and postcontrast-enhanced T1-weighted MRI to detect blood-brain barrier changes) had been performed immediately before systemic thrombolysis and in 48 patients within a median of 30 minutes (interquartile range: 30 to 60 minutes) after recombinant tissue plasminogen activator treatment. The incidence of symptomatic hemorrhage (SICH), defined as any parenchymal hemorrhage leading to deterioration in the patient's clinical condition, was related to several clinical and imaging variables, inclu...</code> |
+  | <code>Does synovial fluid glycosaminoglycan concentration correlate with severity of chondropathy or predict progression of osteoarthritis in a canine cruciate deficiency model?</code> | <code>Considerable interest exists today in biochemical or immunochemical tests for monitoring the progression of osteoarthritis (OA). It has been suggested that measurements made on synovial fluid (SF) will more accurately reflect the magnitude of cartilage destruction in an index joint than those performed on serum. However, we have shown that the synovitis that occurs in OA affects the rate of protein clearance from the joint. We tested the hypothesis that if adjusted for clearance rate, the SF concentration of cartilage proteoglycans (PG) estimates severity of chondropathy and predicts progression of cartilage damage more accurately than if clearance is not taken into account. Clearance of radioiodinated serum albumin (RISA), a surrogate for the clearance of PG, was measured in 19 adult dogs at baseline and again 16 weeks and 32 weeks after anterior cruciate ligament transection (ACLT). Severity of chondropathy was determined arthroscopically after 16 weeks of instability and at postmort...</code> | <code>Previous research has demonstrated that chronic cigarette smoking and major depressive disorder (MDD) are each associated with cognitive decrements. Further, these conditions co-occur commonly, though mechanisms in the comorbid condition are poorly understood. There may be distinct, additive, or overlapping factors underlying comorbid cigarette smoking and MDD. The present study investigated the impact of smoking and MDD on executive function and emotion processing. Participants (N=198) were grouped by diagnostic category (MDD and healthy controls, HC) and smoking status (ever-smokers, ES and never-smokers, NS). Participants completed the Facial Emotion Perception Test (FEPT), a measure of emotional processing, and the parametric Go/No-go task (PGNG), a measure of executive function. FEPT performance was analyzed using ANCOVA with accuracy and reaction time as separate dependent variables. Repeated measures MANCOVA was conducted for PGNG with performance measure and task level as depen...</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Evaluation Dataset
+
+#### pub_med_qa_instruction_fotmatted
+
+* Dataset: [pub_med_qa_instruction_fotmatted](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted) at [66d9473](https://huggingface.co/datasets/subhrajit-mohanty/PubMedQA_instruction_fotmatted/tree/66d9473c747f2e73a050b733f8a871cf37281b93)
+* Size: 1,000 evaluation samples
+* Columns: <code>instruction</code>, <code>context</code>, and <code>context_neg</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | instruction                                                                        | context                                                                              | context_neg                                                                          |
+  |:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                             | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 11 tokens</li><li>mean: 26.49 tokens</li><li>max: 67 tokens</li></ul> | <ul><li>min: 70 tokens</li><li>mean: 317.54 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 45 tokens</li><li>mean: 317.42 tokens</li><li>max: 512 tokens</li></ul> |
+* Samples:
+  | instruction                                                                                                                         | context                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | context_neg                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
+  |:------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>Is serum 25-hydroxyvitamin D3 related to physical activity and ethnicity but not obesity in a multicultural workforce?</code> | <code>Recent research suggests that body vitamin D levels are decreased in coronary heart disease and diabetes, but it is unclear which cardiovascular risk factors are related to vitamin D status. To examine the relation between vitamin D status and major cardiovascular risk factors. Serum 25-hydroxyvitamin D3, a marker of recent sun exposure and vitamin D status, was measured in 390 New Zealand residents (95 Pacific Islanders, 74 Maori and 221 others mostly of European descent), who were part of a larger cross-sectional survey of a workforce (n = 5677) aged 40-64 years. Serum 25-hydroxyvitamin D3 levels were significantly lower in Pacific Islanders (mean (SE) = 56 (3) nmol/L; p = 0.0001) and Maoris (68 (3) nmol/L; p = 0.036) compared with Europeans (75 (2) nmol/L) after adjusting for age, sex and time of year. Also adjusting for ethnic group, 25-hydroxyvitamin D3 was higher in people doing vigorous (aerobic) leisure physical activities (71 (2) nmol/L; p = 0.0066) and moderate (non-aerobic) ...</code> | <code>Previous follow-up studies indicate that increased visual cortical, ventral cingulate and subcortical responses of depressed individuals to sad facial stimuli, but not happy stimuli could represent reversible markers of disease severity. We hypothesized that greater responses in these areas to sad stimuli, but not happy stimuli, would predict better subsequent clinical outcome. We also explored areas that would predict a poor outcome. Twelve melancholically depressed individuals in the early stages of antidepressant treatment in a secondary care setting participated in two experiments comparing responses to varying intensities of sad and happy facial stimuli, respectively, using event related functional MRI. They repeated the experiments after a mean delay of 12 weeks of treatment. There was a variation in response to treatment. Greater right visual cortex and right subgenual cingulate (R-BA25) responses to sad stimuli, but not happy stimuli, in the early stages of treatment were assoc...</code> |
+  | <code>Does image subtraction facilitate assessment of volume and density change in ground-glass opacities in chest CT?</code>       | <code>To study the impact of image subtraction of registered images on the detection of change in pulmonary ground-glass nodules identified on chest CT. A cohort of 33 individuals (25 men, 8 women; age range 51-75 years) with 37 focal ground-glass opacities (GGO) were recruited from a lung cancer screening trial. For every participant, 1 to 3 follow-up scans were available (total number of pairs, 84). Pairs of scans of the same nodule were registered nonrigidly and then subtracted to enhance differences in size and density. Four observers rated size and density change of the GGO between pairs of scans by visual comparison alone and with additional availability of a subtraction image and indicated their confidence. An independent experienced chest radiologist served as an arbiter having all reader data, clinical data, and follow-up examinations available. Nodule pairs for which the arbiter could not establish definite progression, regression, or stability were excluded from further evaluation...</code> | <code>Betaine serves as a methyl donor in a reaction converting homocysteine to methionine. It is commonly used for the treatment of hyperhomocysteinemia in humans, which indicates it may be associated with reduced risk of atherosclerosis. However, there have been few data regarding its vascular effect. To investigate the effect of betaine supplementation on atherosclerotic lesion in apolipoprotein (apo) E-deficient mice. Four groups of apoE-deficient mice were fed AIN-93G diets supplemented with 0, 1, 2, or 4 g betaine/100 g diet (no, 1, 2, and 4% betaine, respectively). Wild-type C57BL/6 J mice were fed AIN-93G diet (wild-type). Mice were sacrificed after 0, 7, or 14 weeks of the experimental diets. Atherosclerotic lesion area in the aortic sinus, levels of tumor necrosis factor (TNF)-alpha and monocyte chemoattractant protein (MCP)-1 in aorta and serum, serum lipids, and methylation status of TNF-alpha promoter in aorta were determined. Linear regression analysis showed that the higher do...</code> |
+  | <code>Is overexpression of peptidyl-prolyl isomerase-like 1 associated with the growth of colon cancer cells?</code>                | <code>To discover novel therapeutic targets for colon cancers, we previously surveyed expression patterns among 23,000 genes in colon cancer tissues using a cDNA microarray. Among the genes that were up-regulated in the tumors, we selected for this study peptidyl-prolyl isomerase-like 1 (PPIL1) encoding PPIL1, a cyclophilin-related protein. Western blot analysis and immunohistochemical staining using PPIL1-specific antibody showed that PPIL1 protein was frequently overexpressed in colon cancer cells compared with noncancerous epithelial cells of the colon mucosa. Colony formation assay showed a growth-promoting effect of wild-type PPIL1 on NIH3T3 and HEK293 cells. Consistently, transfection of short-interfering RNA specific to PPIL1 into SNUC4 and SNUC5 cells effectively reduced expression of the gene and retarded growth of the colon cancer cells. We further identified two PPIL1-interacting proteins, SNW1/SKIP (SKI-binding protein) and stathmin. SNW1/SKIP is involved in the regulation of tra...</code> | <code>Protocols call for the start of hormonal therapy with levothyroxine after the declaration of brain death. As the hormonal perturbations occur during the process of brain death, the role of the early initiation of levothyroxine therapy (LT) to salvage organs is not well defined. The aim of this study was to evaluate the impact of early LT (before the declaration of brain death) on the number of solid organs procured per donor. We performed an 8-year retrospective analysis of all trauma patients who progressed to brain death. Patients who consented for organ donation, received LT, and donated solid organs were included. Patients were dichotomized into two groups: early LT group, patients who received LT before the declaration of brain death, and late LT group, those who received LT after brain death. The two groups were compared for differences in demographics, clinical characteristics, need for vasopressor, and number of solid organ donation. A total of 100 solid organ donors were ident...</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: steps
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 1
+- `warmup_ratio`: 0.1
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: steps
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 1
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: False
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `dispatch_batches`: None
+- `split_batches`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+
+</details>
+
+### Training Logs
+| Epoch | Step | Training Loss | Validation Loss | ai-pubmed-validation_cosine_accuracy |
+|:-----:|:----:|:-------------:|:---------------:|:------------------------------------:|
+| -1    | -1   | -             | -               | 1.0                                  |
+| 0.2   | 100  | 0.0041        | 0.0031          | 1.0                                  |
+| 0.4   | 200  | 0.0023        | 0.0032          | 1.0                                  |
+| 0.6   | 300  | 0.0027        | 0.0033          | 1.0                                  |
+| 0.8   | 400  | 0.007         | 0.0030          | 1.0                                  |
+| 1.0   | 500  | 0.0024        | 0.0028          | 1.0                                  |
+
+
+### Framework Versions
+- Python: 3.11.11
+- Sentence Transformers: 3.4.1
+- Transformers: 4.48.3
+- PyTorch: 2.5.1+cu124
+- Accelerate: 1.3.0
+- Datasets: 3.3.2
+- Tokenizers: 0.21.0
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,28 @@
+{
+  "_name_or_path": "./models/distilroberta-PubMedQAinstruction-embeddings/checkpoint-500",
+  "architectures": [
+    "RobertaModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "eos_token_id": 2,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "roberta",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 6,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.48.3",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 50265
+}

config_sentence_transformers.json

@@ -0,0 +1,10 @@
+{
+  "__version__": {
+    "sentence_transformers": "3.4.1",
+    "transformers": "4.48.3",
+    "pytorch": "2.5.1+cu124"
+  },
+  "prompts": {},
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47d6c1ec9331bba76d6e15290188234f13239c84e3e62a2246a91a50409871ef
+size 328485128

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 512,
+  "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,51 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "<mask>",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,65 @@
+{
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50264": {
+      "content": "<mask>",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "mask_token": "<mask>",
+  "max_length": 128,
+  "model_max_length": 512,
+  "pad_to_multiple_of": null,
+  "pad_token": "<pad>",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
+  "sep_token": "</s>",
+  "stride": 0,
+  "tokenizer_class": "RobertaTokenizer",
+  "trim_offsets": true,
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "<unk>"
+}