sentence-transformers safetensors xlm-roberta sentence-similarity feature-extraction generated_from_trainer dataset_size:2119 loss:MultipleNegativesRankingLoss arxiv:1908.10084 arxiv:1705.00652 base_model:intfloat/multilingual-e5-large-instruct base_model:finetune:intfloat/multilingual-e5-large-instruct autotrain_compatible text-embeddings-inference endpoints_compatible region:us
---
base_model: intfloat/multilingual-e5-large-instruct
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:2119
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: "4) Where the effects due to lateral earth pressure, H, restraint\
    \ effects from \npre-stress, P, and imposed deformation, T, affect the structural\
    \ safety, they shall be \ntaken into account in the calculations, with load factors\
    \ of 1.5, 1.0 and 1.25 assigned to \nH, P and T respectively. (See Note A-4.1.3.2.(4).)\
    \ \n5) Except as provided in Sentence 4.1.8.16.(2), the counteracting factored\
    \ dead \nload—0.9D in load combination cases 2, 3 and 4 and 1.0D in load combination\
    \ case \n5 in Table 4.1.3.2.-A, and 0.9D in load combination cases 1 to 5 and\
    \ 1.0D in load \ncombination case 6 in Table 4.1.3.2.-B—shall be used when the\
    \ dead load acts to resist \noverturning, uplift, sliding, failure due to stress\
    \ reversal, and to determine anchorage \nrequirements and the factored resistance\
    \ of members. (See Note A-4.1.3.2.(5).) \n6) The principal-load factor 1.5 for\
    \ live loads L in Table 4.1.3.2.-A and LXC in \nTable 4.1.3.2.-B may be reduced\
    \ to 1.25 for liquids in tanks. \n7) The companion-load factor for live loads\
    \ L in Table 4.1.3.2.-A and LXC in \nTable 4.1.3.2.-B shall be increased by 0.5\
    \ for storage areas, and equipment areas and \nservice rooms referred to in Table\
    \ 4.1.5.3. \nTable 4.1.3.2.-A \nLoad Combinations Without Crane Loads for Ultimate\
    \ Limit States \nForming Part of Sentences 4.1.3.2.(2) and (5) to (10), and 4.2.4.1.(3)\
    \ \nCase \nLoad Combination(1) \nPrincipal Loads Companion Loads \n1 \n2 \n3 \n\
    4 \n5 \n1.4D(2) \n(1.25D(3) or 0.9D(4))+ 1 . "
  sentences:
  - "Interior Finishes, Furnishings and Decorative Materials \n1) Except as otherwise\
    \ provided by this Subsection, interior finishes, furnishings \nand decorative\
    \ materials shall conform to Section 2.3. of Division B of the NFC. \n2) Interior\
    \ finish material shall include any material that forms part of the interior \n\
    surface of a floor, wall, partition or ceiling, including \na) interior cladding\
    \ of plaster, wood or tile, \nb) surfacing of fabric, paint, plastic, veneer or\
    \ wallpaper, \nc) doors, windows and trim, \nd) lighting elements such as light\
    \ diffusers and lenses forming part of the \nfinished surface of the ceiling,\
    \ and \ne) carpet material that overlies a floor that is not intended as the finished\
    \ floor. \n3.1.13.2. Flame-Spread Rating \n1) Except as otherwise required or\
    \ permitted by this Subsection, the flame-spread \nrating of interior wall and\
    \ ceiling finishes, including glazing and skylights, shall be not \nmore than\
    \ 150 and shall conform to Table 3.1.13.2. \nTable 3.1.13.2. \n"
  - "4) Where the effects due to lateral earth pressure, H, restraint effects from\
    \ \npre-stress, P, and imposed deformation, T, affect the structural safety, they\
    \ shall be \ntaken into account in the calculations, with load factors of 1.5,\
    \ 1.0 and 1.25 assigned to \nH, P and T respectively. (See Note A-4.1.3.2.(4).)\
    \ \n5) Except as provided in Sentence 4.1.8.16.(2), the counteracting factored\
    \ dead \nload—0.9D in load combination cases 2, 3 and 4 and 1.0D in load combination\
    \ case \n5 in Table 4.1.3.2.-A, and 0.9D in load combination cases 1 to 5 and\
    \ 1.0D in load \ncombination case 6 in Table 4.1.3.2.-B—shall be used when the\
    \ dead load acts to resist \noverturning, uplift, sliding, failure due to stress\
    \ reversal, and to determine anchorage \nrequirements and the factored resistance\
    \ of members. (See Note A-4.1.3.2.(5).) \n6) The principal-load factor 1.5 for\
    \ live loads L in Table 4.1.3.2.-A and LXC in \nTable 4.1.3.2.-B may be reduced\
    \ to 1.25 for liquids in tanks. \n7) The companion-load factor for live loads\
    \ L in Table 4.1.3.2.-A and LXC in \nTable 4.1.3.2.-B shall be increased by 0.5\
    \ for storage areas, and equipment areas and \nservice rooms referred to in Table\
    \ 4.1.5.3. \nTable 4.1.3.2.-A \nLoad Combinations Without Crane Loads for Ultimate\
    \ Limit States \nForming Part of Sentences 4.1.3.2.(2) and (5) to (10), and 4.2.4.1.(3)\
    \ \nCase \nLoad Combination(1) \nPrincipal Loads Companion Loads \n1 \n2 \n3 \n\
    4 \n5 \n1.4D(2) \n(1.25D(3) or 0.9D(4))+ 1 . "
  - "(4) \n2.2.1.10.(1) \n3.1.5.7."
- source_sentence: "(1) \n3.4.6.15.(3) \n3.7.2.4.(1) \nTable 5.9.1.1. \n9.6.1.2."
  sentences:
  - "(4)(a) and Articles 3.4.6.19. and 3.8.2.10. shall \nbe not less than 200 lx.\
    \ \n8) Lighting outlets in a building of residential occupancy shall be provided\
    \ in \nconformance with Subsection 9.34.2. \n"
  - "(1) \n3.4.6.15.(3) \n3.7.2.4.(1) \nTable 5.9.1.1. \n9.6.1.2."
  - "zinc, \naluminum, magnesium); metallic hydride (e.g. sodium borohydride, germanium\
    \ tetrahydride, calcium \nhydride). \nThe following dangerously reactive materials,\
    \ among others, are known to release a toxic gas in reaction to \ncontact with\
    \ water or humidity: organic and inorganic chloride (e.g. phosphorus trichloride,\
    \ phosphorus oxide \ntrichloride, acetyl chloride); organic and inorganic bromide\
    \ (e.g. "
- source_sentence: "Specified Rain Load \n1) Except as provided in Sentence (4), the\
    \ specified load, S, due to the \naccumulation of rainwater on a surface whose\
    \ position, shape and deflection under \nload make such an accumulation possible,\
    \ is that resulting from the one-day rainfall \ndetermined in conformance with\
    \ Subsection 1.1.3. and applied over the horizontal \nprojection of the surface\
    \ and all tributary surfaces. "
  sentences:
  - "Specified Rain Load \n1) Except as provided in Sentence (4), the specified load,\
    \ S, due to the \naccumulation of rainwater on a surface whose position, shape\
    \ and deflection under \nload make such an accumulation possible, is that resulting\
    \ from the one-day rainfall \ndetermined in conformance with Subsection 1.1.3.\
    \ and applied over the horizontal \nprojection of the surface and all tributary\
    \ surfaces. "
  - "(2) \nD = distance from the narrow edge where the length of the landing is measured\
    \ \n= half the required length of the landing \nSee Sentences 3.4.6.4.(3) and\
    \ 9.8.6.3.(3). \nNational Building Code of Canada 2020 Volume 1 Division B 3-263\
    \ \nCopyright © NRC 1941 - 2022 World Rights Reserved © CNRC 1941-2022 Droits\
    \ réservés pour tous pays"
  - "Division B 3.1.5.2. \n2) Where a building is considered to face 1 street in accordance\
    \ with \nClause 3.2.2.10.(3)(b), the exterior cladding on each exterior wall of\
    \ buildings \nconforming to Article 3.2.2.51. or 3.2.2.60. shall consist of \n\
    a) noncombustible cladding, or \nb) except as provided in Sentence (4), a wall\
    \ assembly that satisfies the criteria \nof Clause 3.1.5.5.(1)(b). \n3) A wall\
    \ assembly conforming to Clause (1)(b) or (2)(b) that includes combustible \n\
    cladding made of fire-retardant-treated wood shall be tested for fire exposure\
    \ after the \ncladding has been subjected to the accelerated weathering test specified\
    \ in ASTM \nD2898, “Standard Practice for Accelerated Weathering of Fire-Retardant-Treated\
    \ \nWood for Fire Testing.” \n4) Exterior wall assemblies constructed in accordance\
    \ with Section D-6 of \nAppendix D are deemed to comply with Clauses (1)(b) and\
    \ (2)(b). \n3.1.5. Noncombustible Construction \n3.1.5.1. "
- source_sentence: "Sentence 3.2.4.4.(2) also allows the implementation of a “zoned\
    \ 2-stage” sequence of operation, whereby the \nalarm signal sounds in the zone\
    \ of key switch actuation (and perhaps in the adjacent zones, which may be \n\
    the storey above and the storey below) and the alert signal sounds throughout\
    \ the rest of the building. This \nsequencing would be created automatically by\
    \ the fire alarm control unit. \nNational Building Code of Canada 2020 Volume\
    \ 1 Division B 3-239 \nCopyright © NRC 1941 - 2022 World Rights Reserved © CNRC\
    \ 1941-2022 Droits réservés pour tous pays"
  sentences:
  - "Sentence 3.2.4.4.(2) also allows the implementation of a “zoned 2-stage” sequence\
    \ of operation, whereby the \nalarm signal sounds in the zone of key switch actuation\
    \ (and perhaps in the adjacent zones, which may be \nthe storey above and the\
    \ storey below) and the alert signal sounds throughout the rest of the building.\
    \ This \nsequencing would be created automatically by the fire alarm control unit.\
    \ \nNational Building Code of Canada 2020 Volume 1 Division B 3-239 \nCopyright\
    \ © NRC 1941 - 2022 World Rights Reserved © CNRC 1941-2022 Droits réservés pour\
    \ tous pays"
  - "2) Sentence (1) need not apply to agricultural occupancies where the welding\
    \ and \ncutting operations do not present a fire or explosion hazard to adjacent\
    \ areas. \n2.2.8.5. "
  - "5) The fire separation required by Sentence 3.3.5.6.(1) is not required between\
    \ a \ndwelling unit and an attached storage garage,s e r v i n g t h a t dwelling\
    \ unit only, provided \na) the dwelling unit and its attached storage garage are\
    \ separated from the \nremainder of the building in conformance with Sentences\
    \ (1) to (3), \nb) there are no air duct systems connecting the storage garage\
    \ and the dwelling \nunit, \n3-134 Division B National Building Code of Canada\
    \ 2020 Volume 1 \nCopyright © NRC 1941 - 2022 World Rights Reserved © CNRC 1941-2022\
    \ Droits réservés pour tous pays"
- source_sentence: "(1) \n2.2.8.1.(4) \n2.2.8.7.(1) \n2.4.2.3.(4) \nA-2.2.8.4.(1)\
    \ \n3.1.13.1.(1) \n3.2.3.21.(1) \n3.2.5.16."
  sentences:
  - "5) T h ec l e a r h e i g h ti na storage garage shall be not less than 2 m.\
    \ \n6) Where garage floors or ramps are 600 mm or more above the adjacent ground\
    \ \nor floor level, every opening through such floors and the perimeter of floors\
    \ and ramps \nshall be provided with \na) a continuous curb not less than 140\
    \ mm high, a guard not less than 1 070 mm \nhigh, and a vehicle guardrail not\
    \ less than 500 mm high conforming to \nSentence (7), or \nb) a full-height wall\
    \ conforming to Sentence (7). \n7) Vehicle guardrails and full-height walls required\
    \ in Sentence (6) shall \nbe designed and constructed to withstand the loading\
    \ values stipulated in \nSentence 4.1.5.15.(1). \n8) Except for open-air storeys,e\
    \ v e r y storey of a storage garage or repair garage located \nbelow grade shall\
    \ be sprinklered. \n3.3.5.5. Repair Garage Separation \n1) A repair garage and\
    \ any ancillary spaces serving it, including waiting rooms, \nreception rooms,\
    \ tool and parts storage areas and supervisory office space, shall be \nseparated\
    \ from other occupancies by a fire separation having a fire-resistance rating\
    \ not \nless than 2 h. \n3.3.5.6. "
  - "(1) \n2.2.8.1.(4) \n2.2.8.7.(1) \n2.4.2.3.(4) \nA-2.2.8.4.(1) \n3.1.13.1.(1)\
    \ \n3.2.3.21.(1) \n3.2.5.16."
  - "(1) and 3.2.2.18.(2), the building \nshall be sprinklered throughout, \nb) floor\
    \ assemblies shall be fire separations with a fire-resistance rating not less\
    \ \nthan 2 h, \nc) mezzanines shall have a fire-resistance rating not less than\
    \ 1 h, and \nd) loadbearing walls, columns and arches shall have a fire-resistance\
    \ rating not \nless than that required for the supported assembly. \n3.2.2.37.\
    \ Group B, Division 1, up to 3 Storeys, Sprinklered \n1) A building classified\
    \ as Group B, Division 1 is permitted to conform to \nSentence (2) provided \n\
    a) except as permitted by Sentences 3.2.2.7.(1) and 3.2.2.18.(2), the building\
    \ is \nsprinklered throughout, \nb) it is not more than 3 storeys in building\
    \ height,a n d \nc) it has a building area \ni) that is not limited if the building\
    \ is not more than 1 storey \nin building height, \nii) not more than 12 000 m2\
    \ if 2 storeys in building height,o r \niii) not more than 8 000 m2 if 3 storeys\
    \ in building height. \n2) Except as permitted by Article 3.2.2.16., the building\
    \ referred to in Sentence (1) \nshall be of noncombustible construction,a n d\
    \ \na) floor assemblies shall be fire separations with a fire-resistance rating\
    \ not less \nthan 1 h, \nb) mezzanines shall have a fire-resistance rating not\
    \ less than 1 h, and \nc) loadbearing walls, columns and arches shall have a fire-resistance\
    \ rating not \nless than that required for the supported assembly. \n3.2.2.38.\
    \ Group B, Division 2, Any Height, Any Area, Sprinklered \n1) Except as permitted\
    \ by Articles 3.2.2.39. to 3.2.2.41., a building classified as \nGroup B, Division\
    \ 2 shall conform to Sentence (2). \n2) Except as permitted by Article 3.2.2.16.,\
    \ the building referred to in Sentence (1) \nshall be of noncombustible construction,a\
    \ n d \na) except as permitted by Sentences 3.2.2.7."
---

# SentenceTransformer based on intfloat/multilingual-e5-large-instruct

This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [intfloat/multilingual-e5-large-instruct](https://huggingface.co/intfloat/multilingual-e5-large-instruct). It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

## Model Details

### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [intfloat/multilingual-e5-large-instruct](https://huggingface.co/intfloat/multilingual-e5-large-instruct) <!-- at revision c9e87c786ffac96aeaeb42863276930883923ecb -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 1024 dimensions
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->

### Model Sources

- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)

### Full Model Architecture

```
SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)
```

## Usage

### Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

```bash
pip install -U sentence-transformers
```

Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    '(1) \n2.2.8.1.(4) \n2.2.8.7.(1) \n2.4.2.3.(4) \nA-2.2.8.4.(1) \n3.1.13.1.(1) \n3.2.3.21.(1) \n3.2.5.16.',
    '(1) \n2.2.8.1.(4) \n2.2.8.7.(1) \n2.4.2.3.(4) \nA-2.2.8.4.(1) \n3.1.13.1.(1) \n3.2.3.21.(1) \n3.2.5.16.',
    '5) T h ec l e a r h e i g h ti na storage garage shall be not less than 2 m. \n6) Where garage floors or ramps are 600 mm or more above the adjacent ground \nor floor level, every opening through such floors and the perimeter of floors and ramps \nshall be provided with \na) a continuous curb not less than 140 mm high, a guard not less than 1 070 mm \nhigh, and a vehicle guardrail not less than 500 mm high conforming to \nSentence (7), or \nb) a full-height wall conforming to Sentence (7). \n7) Vehicle guardrails and full-height walls required in Sentence (6) shall \nbe designed and constructed to withstand the loading values stipulated in \nSentence 4.1.5.15.(1). \n8) Except for open-air storeys,e v e r y storey of a storage garage or repair garage located \nbelow grade shall be sprinklered. \n3.3.5.5. Repair Garage Separation \n1) A repair garage and any ancillary spaces serving it, including waiting rooms, \nreception rooms, tool and parts storage areas and supervisory office space, shall be \nseparated from other occupancies by a fire separation having a fire-resistance rating not \nless than 2 h. \n3.3.5.6. ',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```

<!--
### Direct Usage (Transformers)

<details><summary>Click to see the direct usage in Transformers</summary>

</details>
-->

<!--
### Downstream Usage (Sentence Transformers)

You can finetune this model on your own dataset.

<details><summary>Click to expand</summary>

</details>
-->

<!--
### Out-of-Scope Use

*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->

<!--
## Bias, Risks and Limitations

*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->

<!--
### Recommendations

*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->

## Training Details

### Training Dataset

#### Unnamed Dataset

* Size: 2,119 training samples
* Columns: <code>sentence_0</code> and <code>sentence_1</code>
* Approximate statistics based on the first 1000 samples:
  |         | sentence_0                                                                          | sentence_1                                                                          |
  |:--------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
  | type    | string                                                                              | string                                                                              |
  | details | <ul><li>min: 5 tokens</li><li>mean: 169.27 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 169.27 tokens</li><li>max: 512 tokens</li></ul> |
* Samples:
  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
  |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
  | <code>Barrier-Free Design Principles. This Section contains minimum requirements for the design <br>of buildings that accommodate people with diverse abilities, across their lifespan, including, but not limited <br>to, people who use wheelchairs or other assistive mobility devices (e.g., walking aids, canes, crutches, braces, <br>prosthetics), people with personal care providers, people with hearing or vision loss, and people with service <br>animals, so they can access and use buildings. <br></code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           | <code>Barrier-Free Design Principles. This Section contains minimum requirements for the design <br>of buildings that accommodate people with diverse abilities, across their lifespan, including, but not limited <br>to, people who use wheelchairs or other assistive mobility devices (e.g., walking aids, canes, crutches, braces, <br>prosthetics), people with personal care providers, people with hearing or vision loss, and people with service <br>animals, so they can access and use buildings. <br></code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
  | <code>(1) <br>and (2) could require installation of an automatic sprinkler system throughout all storeys of a building <br>regardless of options in Articles 3.2.2.20. to 3.2.2.92. to construct one or more storeys without installation of <br>sprinklers. It is the intent of the Code that all storeys below a storey in which an automatic sprinkler system <br>is installed should also be protected by an automatic sprinkler system to ensure that a fire in a lower storey <br>does not incapacitate the automatic sprinkler system or overwhelm an automatic sprinkler system in an upper <br>storey. Persons in an upper storey in which waivers or reductions of other fire safety systems are permitted <br>would be exposed to an increased risk from a fire on a lower storey. This concept also applies to situations <br>in which an automatic sprinkler system has been installed within a floor area in order to modify other safety <br>requirements applying within the floor area. If the uppermost storey or storeys of a building can be construc...</code> | <code>(1) <br>and (2) could require installation of an automatic sprinkler system throughout all storeys of a building <br>regardless of options in Articles 3.2.2.20. to 3.2.2.92. to construct one or more storeys without installation of <br>sprinklers. It is the intent of the Code that all storeys below a storey in which an automatic sprinkler system <br>is installed should also be protected by an automatic sprinkler system to ensure that a fire in a lower storey <br>does not incapacitate the automatic sprinkler system or overwhelm an automatic sprinkler system in an upper <br>storey. Persons in an upper storey in which waivers or reductions of other fire safety systems are permitted <br>would be exposed to an increased risk from a fire on a lower storey. This concept also applies to situations <br>in which an automatic sprinkler system has been installed within a floor area in order to modify other safety <br>requirements applying within the floor area. If the uppermost storey or storeys of a building can be construc...</code> |
  | <code>(4)(a) and Articles 3.4.6.19. and 3.8.2.10. shall <br>be not less than 200 lx. <br>8) Lighting outlets in a building of residential occupancy shall be provided in <br>conformance with Subsection 9.34.2. <br></code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        | <code>(4)(a) and Articles 3.4.6.19. and 3.8.2.10. shall <br>be not less than 200 lx. <br>8) Lighting outlets in a building of residential occupancy shall be provided in <br>conformance with Subsection 9.34.2. <br></code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
  ```json
  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  ```

### Training Hyperparameters
#### Non-Default Hyperparameters

- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `num_train_epochs`: 10
- `fp16`: True
- `multi_dataset_batch_sampler`: round_robin

#### All Hyperparameters
<details><summary>Click to expand</summary>

- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: no
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 10
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: None
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`: 
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: False
- `prompts`: None
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: round_robin

</details>

### Training Logs
| Epoch  | Step | Training Loss |
|:------:|:----:|:-------------:|
| 3.7594 | 500  | 0.0272        |
| 7.5188 | 1000 | 0.0007        |


### Framework Versions
- Python: 3.11.11
- Sentence Transformers: 3.4.1
- Transformers: 4.48.3
- PyTorch: 2.5.1+cu124
- Accelerate: 1.3.0
- Datasets: 3.3.0
- Tokenizers: 0.21.0

## Citation

### BibTeX

#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}
```

#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}
```

<!--
## Glossary

*Clearly define terms in order to be accessible across audiences.*
-->

<!--
## Model Card Authors

*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->

<!--
## Model Card Contact

*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->