sentence-transformers safetensors bert sentence-similarity feature-extraction generated_from_trainer dataset_size:375259 loss:CosineSimilarityLoss arxiv:1908.10084 base_model:sentence-transformers/all-MiniLM-L6-v2 base_model:finetune:sentence-transformers/all-MiniLM-L6-v2 model-index autotrain_compatible text-embeddings-inference endpoints_compatible region:us
---
base_model: sentence-transformers/all-MiniLM-L6-v2
datasets: []
language: []
library_name: sentence-transformers
metrics:
- pearson_cosine
- spearman_cosine
- pearson_manhattan
- spearman_manhattan
- pearson_euclidean
- spearman_euclidean
- pearson_dot
- spearman_dot
- pearson_max
- spearman_max
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:375259
- loss:CosineSimilarityLoss
widget:
- source_sentence: Experience with data warehousing solutions handling terabytes of
    data
  sentences:
  - As a data management consultant, I have worked with organizations to improve their
    data handling practices. I have conducted assessments to identify areas for improvement
    and provided recommendations for optimizing data usage. My experience includes
    developing training programs to enhance data literacy among staff. I have collaborated
    with teams to implement data management tools that support reporting and analysis.
    While I have a strong background in data management, my experience does not specifically
    include governance and compliance frameworks.
  - In my position as a human resources coordinator, I have focused on supporting
    recruitment and employee engagement initiatives. My experience includes coordinating
    interviews and onboarding processes for new hires. I have collaborated with hiring
    managers to develop job descriptions and assess candidate qualifications. My role
    involved maintaining employee records and assisting with performance management
    processes. I have a strong understanding of HR policies and procedures. My focus
    has always been on fostering a positive workplace culture and supporting employee
    development. I am passionate about helping organizations build strong teams.
  - In my capacity as a sales associate, I have focused on building relationships
    with customers and driving sales for the organization. My responsibilities included
    assisting customers with their purchases, providing product information, and maintaining
    store displays. While I have worked with sales data to inform strategies, my focus
    has been on sales rather than data management or warehousing. I have experience
    in using point-of-sale systems to track transactions and manage inventory. My
    ability to communicate effectively with customers has been a key asset in my role.
    Overall, my experience has equipped me with the skills necessary to succeed in
    a sales environment.
- source_sentence: Experience with low-latency database technologies such as Redis
    or Aerospike
  sentences:
  - In my previous role, I was responsible for managing customer relationships and
    ensuring satisfaction through effective communication and follow-ups. I utilized
    various tools to track customer interactions and sales pipelines, which significantly
    improved our team's efficiency. My experience includes analyzing customer data
    to identify trends and opportunities for upselling. I also collaborated with the
    marketing team to create targeted campaigns based on customer insights. Additionally,
    I have hands-on experience with CRM tools, particularly Salesforce, which I used
    to streamline our sales processes. My ability to generate reports and dashboards
    helped the management make informed decisions. I am skilled in training team members
    on best practices for using CRM systems to enhance productivity. Furthermore,
    I have a strong understanding of customer segmentation and how to leverage CRM
    data for personalized marketing efforts. Overall, my background in customer relationship
    management has equipped me with the skills necessary to drive sales and improve
    customer engagement.
  - In my previous role, I was responsible for optimizing data retrieval processes,
    which involved implementing caching strategies to enhance performance. I utilized
    various database technologies, including NoSQL solutions, to ensure quick access
    to data. My work included designing and maintaining high-performance applications
    that required real-time data processing. I also collaborated with cross-functional
    teams to integrate these solutions into existing systems. One of the key technologies
    I worked with was Redis, which significantly improved the application's response
    time. Additionally, I focused on ensuring data consistency and reliability across
    distributed systems. My experience also includes monitoring database performance
    and making necessary adjustments to maintain optimal speed. I have a strong understanding
    of data structures and algorithms, which helped in fine-tuning the database interactions.
    Overall, my background in database management and optimization has equipped me
    with the skills needed for low-latency environments.
  - In my capacity as a data engineer, I have designed and implemented data pipelines
    that interact with Oracle databases. My experience includes working with installations
    of various sizes, where I focused on data extraction, transformation, and loading
    (ETL) processes. I utilized Oracle SQL to create efficient queries that supported
    data analytics initiatives. My role also involved collaborating with data scientists
    to ensure data availability for machine learning models. I have implemented monitoring
    solutions to track database performance and identify bottlenecks. Additionally,
    I have experience in configuring Oracle environments to optimize resource usage.
    My technical skills are complemented by my ability to document processes and create
    user guides for team members. I have also participated in knowledge-sharing sessions
    to enhance the team's understanding of Oracle Database functionalities. Overall,
    my background in handling Oracle installations positions me well for similar challenges.
- source_sentence: Must have experience in conducting candidate assessments and evaluations
  sentences:
  - As a software engineer, I have worked on various projects that required the development
    of user-friendly interfaces. My role involved collaborating with designers to
    create visually appealing layouts. I utilized frameworks like Bootstrap and Foundation
    to ensure that the applications were accessible. My experience also includes optimizing
    performance for different screen sizes. I have a strong understanding of cross-browser
    compatibility issues and have successfully addressed them in my projects. Furthermore,
    I have integrated RESTful APIs to fetch data dynamically. My passion for front-end
    development drives me to stay updated with the latest trends and technologies
    in the field. Overall, my background in software engineering has equipped me with
    the skills necessary to create engaging user experiences.
  - As a project manager in a tech startup, I oversaw the development of a mobile
    application aimed at simplifying online payments for users. My role involved coordinating
    between developers and stakeholders to ensure that the project met its objectives.
    I focused on integrating various payment gateways to provide users with multiple
    options during checkout. My experience includes conducting market research and
    analyzing user feedback to improve the app's functionality. While I have worked
    with several payment systems, my experience with cryptocurrency transactions is
    limited. I have a solid understanding of payment processing and user experience
    design, which has been beneficial in my role.
  - In my capacity as an HR Consultant, I have worked with various organizations to
    enhance their recruitment strategies. A significant part of my role involved conducting
    candidate assessments to ensure a good match between candidates and organizational
    needs. I have designed customized evaluation frameworks that incorporate both
    technical skills and cultural fit. My experience includes training hiring teams
    on effective assessment techniques, which has led to improved hiring outcomes.
    I have also analyzed assessment data to identify trends and areas for improvement
    in our evaluation processes. My background in psychology has been instrumental
    in understanding candidate behaviors during assessments. I have facilitated workshops
    that focus on best practices in candidate evaluations. This comprehensive approach
    has helped organizations make more informed hiring decisions. I am passionate
    about creating a positive candidate experience throughout the assessment process.
- source_sentence: Must have experience with database backup and recovery strategies
  sentences:
  - In my previous role as a database administrator, I was responsible for managing
    large-scale databases and ensuring data integrity. I implemented various data
    management practices, including regular maintenance and performance tuning. My
    experience includes working with SQL Server and Oracle databases, where I developed
    and executed comprehensive backup plans. I also collaborated with the IT team
    to establish disaster recovery protocols, which included testing recovery scenarios
    to ensure minimal downtime. Additionally, I utilized monitoring tools to track
    database performance and identify potential issues before they escalated. My role
    required a strong understanding of data security measures, and I regularly updated
    our backup strategies to align with best practices. I also provided training to
    junior staff on the importance of data backups and recovery processes. Overall,
    my background in database management has equipped me with the skills necessary
    to handle backup and recovery effectively.
  - As a quality assurance engineer, I have been responsible for testing software
    applications to ensure they meet quality standards. My expertise lies in developing
    test plans and test cases to validate functionality and performance. I have experience
    with automated testing tools and have implemented testing frameworks to improve
    efficiency. My role involves collaborating with developers to identify and resolve
    defects early in the development process. I have a strong understanding of software
    development life cycles and have contributed to process improvements. Additionally,
    I have been involved in user acceptance testing, ensuring that applications meet
    user expectations. My focus on detail and thoroughness has led to high-quality
    deliverables. I am passionate about advocating for quality and continuously seek
    to enhance my testing skills. Overall, my background in quality assurance has
    equipped me with a comprehensive understanding of software testing.
  - As a systems engineer, I have worked extensively with various database systems,
    focusing on optimizing performance and ensuring data availability. My responsibilities
    included designing and implementing backup solutions tailored to the specific
    needs of the organization. I regularly conducted audits of backup processes to
    ensure compliance with industry standards. In addition, I developed documentation
    outlining recovery procedures, which served as a guide for the team during critical
    situations. My experience also involved collaborating with cross-functional teams
    to integrate backup solutions into existing workflows. I have a strong understanding
    of data lifecycle management and the importance of regular backups. Furthermore,
    I have participated in training sessions to educate staff on best practices for
    data recovery. This comprehensive approach has allowed me to contribute significantly
    to the organization's data management strategy.
- source_sentence: Experience in building materials industry
  sentences:
  - In my previous position, I was responsible for managing a team of developers focused
    on creating innovative software solutions. My role involved overseeing project
    timelines and ensuring that deliverables met quality standards. I frequently collaborated
    with stakeholders to gather requirements and translate them into actionable tasks
    for the team. My experience includes conducting code reviews and providing feedback
    to enhance the development process. I also organized team-building activities
    to foster collaboration and improve morale. My background in software engineering
    has equipped me with a strong understanding of development methodologies. I have
    a passion for technology and enjoy staying updated on industry trends. My focus
    has always been on delivering high-quality products that meet user needs. Overall,
    my experience has been centered around team management and software development.
  - As a software developer, I have worked on various applications that streamline
    project management processes. My experience includes developing user-friendly
    interfaces and integrating third-party APIs to enhance functionality. I have collaborated
    with cross-functional teams to gather requirements and deliver solutions that
    meet client needs. My role involved conducting code reviews and ensuring adherence
    to best practices in software development. I have a strong understanding of programming
    languages such as JavaScript, Python, and Ruby, which I have utilized to build
    robust applications. Additionally, I have experience in database management and
    optimization, ensuring that data is stored efficiently. My background includes
    working in Agile environments, where I have participated in sprint planning and
    retrospectives. I have also contributed to documentation efforts to ensure that
    all project details are captured accurately. Overall, my software development
    experience has equipped me with the skills necessary to create effective solutions
    for various industries.
  - In my role as a quality assurance engineer, I was responsible for testing software
    applications to ensure they met quality standards. I collaborated with development
    teams to understand application functionality and create test plans. My work involved
    executing test cases and documenting results to identify defects. I also implemented
    automated testing strategies to improve efficiency in the testing process. My
    experience with various testing tools allowed me to streamline testing efforts
    and ensure comprehensive coverage. I regularly participated in team meetings to
    discuss testing progress and address any issues that arose. Additionally, I provided
    feedback to developers to help improve application quality. My strong attention
    to detail helped in identifying potential issues before deployment. I also contributed
    to documentation that outlined testing processes and best practices.
model-index:
- name: SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
  results:
  - task:
      type: semantic-similarity
      name: Semantic Similarity
    dataset:
      name: validation
      type: validation
    metrics:
    - type: pearson_cosine
      value: 0.9471273487497113
      name: Pearson Cosine
    - type: spearman_cosine
      value: 0.9123854426425835
      name: Spearman Cosine
    - type: pearson_manhattan
      value: 0.9357657929990708
      name: Pearson Manhattan
    - type: spearman_manhattan
      value: 0.9118392690450344
      name: Spearman Manhattan
    - type: pearson_euclidean
      value: 0.9343758217004137
      name: Pearson Euclidean
    - type: spearman_euclidean
      value: 0.9123854478135449
      name: Spearman Euclidean
    - type: pearson_dot
      value: 0.947127349268295
      name: Pearson Dot
    - type: spearman_dot
      value: 0.9123854374716222
      name: Spearman Dot
    - type: pearson_max
      value: 0.947127349268295
      name: Pearson Max
    - type: spearman_max
      value: 0.9123854478135449
      name: Spearman Max
---

# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

## Model Details

### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision 8b3219a92973c328a8e22fadcfa821b5dc75636a -->
- **Maximum Sequence Length:** 256 tokens
- **Output Dimensionality:** 384 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->

### Model Sources

- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)

### Full Model Architecture

```
SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)
```

## Usage

### Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

```bash
pip install -U sentence-transformers
```

Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Experience in building materials industry',
    'As a software developer, I have worked on various applications that streamline project management processes. My experience includes developing user-friendly interfaces and integrating third-party APIs to enhance functionality. I have collaborated with cross-functional teams to gather requirements and deliver solutions that meet client needs. My role involved conducting code reviews and ensuring adherence to best practices in software development. I have a strong understanding of programming languages such as JavaScript, Python, and Ruby, which I have utilized to build robust applications. Additionally, I have experience in database management and optimization, ensuring that data is stored efficiently. My background includes working in Agile environments, where I have participated in sprint planning and retrospectives. I have also contributed to documentation efforts to ensure that all project details are captured accurately. Overall, my software development experience has equipped me with the skills necessary to create effective solutions for various industries.',
    'In my role as a quality assurance engineer, I was responsible for testing software applications to ensure they met quality standards. I collaborated with development teams to understand application functionality and create test plans. My work involved executing test cases and documenting results to identify defects. I also implemented automated testing strategies to improve efficiency in the testing process. My experience with various testing tools allowed me to streamline testing efforts and ensure comprehensive coverage. I regularly participated in team meetings to discuss testing progress and address any issues that arose. Additionally, I provided feedback to developers to help improve application quality. My strong attention to detail helped in identifying potential issues before deployment. I also contributed to documentation that outlined testing processes and best practices.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```

<!--
### Direct Usage (Transformers)

<details><summary>Click to see the direct usage in Transformers</summary>

</details>
-->

<!--
### Downstream Usage (Sentence Transformers)

You can finetune this model on your own dataset.

<details><summary>Click to expand</summary>

</details>
-->

<!--
### Out-of-Scope Use

*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->

## Evaluation

### Metrics

#### Semantic Similarity
* Dataset: `validation`
* Evaluated with [<code>EmbeddingSimilarityEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.EmbeddingSimilarityEvaluator)

| Metric             | Value      |
|:-------------------|:-----------|
| pearson_cosine     | 0.9471     |
| spearman_cosine    | 0.9124     |
| pearson_manhattan  | 0.9358     |
| spearman_manhattan | 0.9118     |
| pearson_euclidean  | 0.9344     |
| spearman_euclidean | 0.9124     |
| pearson_dot        | 0.9471     |
| spearman_dot       | 0.9124     |
| pearson_max        | 0.9471     |
| **spearman_max**   | **0.9124** |

<!--
## Bias, Risks and Limitations

*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->

<!--
### Recommendations

*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->

## Training Details

### Training Dataset

#### Unnamed Dataset


* Size: 375,259 training samples
* Columns: <code>text1</code>, <code>text2</code>, and <code>label</code>
* Approximate statistics based on the first 1000 samples:
  |         | text1                                                                             | text2                                                                               | label                                                          |
  |:--------|:----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:---------------------------------------------------------------|
  | type    | string                                                                            | string                                                                              | float                                                          |
  | details | <ul><li>min: 6 tokens</li><li>mean: 13.95 tokens</li><li>max: 22 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 152.64 tokens</li><li>max: 224 tokens</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.48</li><li>max: 1.0</li></ul> |
* Samples:
  | text1                             | text2                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | label            |
  |:----------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
  | <code>Experience with APIs</code> | <code>In my previous role, I was responsible for developing and maintaining a robust e-commerce platform that integrated various third-party services. This involved creating seamless connections between our application and external payment gateways, ensuring secure transactions. I utilized RESTful services to facilitate communication between the front-end and back-end systems, which significantly improved the user experience. Additionally, I implemented OAuth for secure authentication, allowing users to log in using their social media accounts. My work also included writing comprehensive documentation for the API endpoints, which helped other developers understand how to interact with our services. I collaborated closely with the QA team to ensure that all API functionalities were thoroughly tested before deployment. My experience with APIs has equipped me with the skills to troubleshoot and optimize performance issues effectively. I also participated in code reviews, providing feedback on best practices for API development. Overall, my background in API integration has been crucial in delivering high-quality software solutions.</code> | <code>1.0</code> |
  | <code>Experience with APIs</code> | <code>As a software engineer, I played a key role in a project that involved building a mobile application for a healthcare provider. My responsibilities included designing the architecture of the application, which required extensive use of APIs to connect with various health data sources. I ensured that the application could retrieve patient information securely and efficiently through well-defined API calls. My experience with APIs allowed me to implement error handling and data validation mechanisms, which enhanced the application's reliability. I also worked on creating a user-friendly interface that displayed data fetched from the APIs in a meaningful way. Collaborating with cross-functional teams, I gathered requirements and translated them into technical specifications for the API development. I conducted performance testing to ensure that the API responses were quick and met user expectations. Additionally, I provided training sessions for junior developers on best practices for API usage and integration. This experience has solidified my understanding of API-driven development.</code>                                           | <code>1.0</code> |
  | <code>Experience with APIs</code> | <code>In my role as a backend developer, I was tasked with creating a microservices architecture for a large-scale application. This involved developing multiple APIs that allowed different services to communicate with each other efficiently. I focused on ensuring that the APIs were RESTful and followed industry standards for data exchange. My experience with APIs included implementing versioning strategies to maintain backward compatibility as the application evolved. I also utilized tools like Postman for testing the APIs and ensuring they met the required specifications. My work required close collaboration with front-end developers to ensure that the APIs provided the necessary data for the user interface. I also monitored API performance and made optimizations to reduce latency and improve response times. Additionally, I documented the API endpoints thoroughly, which facilitated easier onboarding for new team members. This experience has been invaluable in my career as it has deepened my understanding of service-oriented architecture.</code>                                                                                            | <code>1.0</code> |
* Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
  ```json
  {
      "loss_fct": "torch.nn.modules.loss.MSELoss"
  }
  ```

### Evaluation Dataset

#### Unnamed Dataset


* Size: 20,089 evaluation samples
* Columns: <code>text1</code>, <code>text2</code>, and <code>label</code>
* Approximate statistics based on the first 1000 samples:
  |         | text1                                                                             | text2                                                                              | label                                                          |
  |:--------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:---------------------------------------------------------------|
  | type    | string                                                                            | string                                                                             | float                                                          |
  | details | <ul><li>min: 7 tokens</li><li>mean: 14.41 tokens</li><li>max: 32 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 146.8 tokens</li><li>max: 226 tokens</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.48</li><li>max: 1.0</li></ul> |
* Samples:
  | text1                                                                     | text2                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | label            |
  |:--------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
  | <code>Experience with API security protocols such as OAuth2 or JWT</code> | <code>In my previous role as a software engineer, I was responsible for developing secure web applications that required robust authentication mechanisms. I implemented various security measures, including encryption and secure data transmission. My work involved integrating third-party services, which necessitated a deep understanding of API security protocols. I successfully utilized OAuth2 for user authentication, ensuring that sensitive data was protected during transactions. Additionally, I collaborated with the security team to conduct regular audits and vulnerability assessments. My experience also includes designing RESTful APIs that adhere to best practices in security. I have a strong foundation in web application security principles, which I applied to enhance the overall security posture of our applications. My ability to communicate complex security concepts to non-technical stakeholders was crucial in fostering a security-aware culture within the team.</code> | <code>1.0</code> |
  | <code>Experience with API security protocols such as OAuth2 or JWT</code> | <code>As a backend developer, I focused on creating scalable microservices that interacted with various external APIs. A key aspect of my role involved ensuring that these services were secure and compliant with industry standards. I implemented token-based authentication using JWT, which streamlined the user experience while maintaining high security. My responsibilities included writing comprehensive documentation for API endpoints, detailing the security measures in place. I also participated in code reviews, where I emphasized the importance of secure coding practices. Collaborating with cross-functional teams, I contributed to the development of a security framework that guided our API development. My experience in this area has equipped me with the skills to identify potential security risks and implement effective mitigation strategies. I am passionate about staying updated on the latest security trends and best practices.</code>                                      | <code>1.0</code> |
  | <code>Experience with API security protocols such as OAuth2 or JWT</code> | <code>In my role as a systems architect, I was tasked with designing a secure infrastructure for our cloud-based applications. This involved selecting appropriate security protocols to protect user data and ensure compliance with regulations. I chose to implement OAuth2 for authorization, which allowed for secure access to our APIs. My work included developing a comprehensive security policy that outlined the use of various protocols and best practices. I also led training sessions for the development team on the importance of API security and how to implement these protocols effectively. My experience in threat modeling helped identify potential vulnerabilities in our architecture. I collaborated closely with the DevOps team to automate security checks in our CI/CD pipeline. This proactive approach significantly reduced the risk of security breaches in our applications.</code>                                                                                                  | <code>1.0</code> |
* Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
  ```json
  {
      "loss_fct": "torch.nn.modules.loss.MSELoss"
  }
  ```

### Training Hyperparameters
#### Non-Default Hyperparameters

- `eval_strategy`: steps
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `num_train_epochs`: 10.0
- `warmup_ratio`: 0.1
- `fp16`: True
- `load_best_model_at_end`: True
- `batch_sampler`: no_duplicates

#### All Hyperparameters
<details><summary>Click to expand</summary>

- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 10.0
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.1
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: True
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`: 
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `eval_use_gather_object`: False
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: proportional

</details>

### Training Logs
| Epoch  | Step  | Training Loss | loss   | validation_spearman_max |
|:------:|:-----:|:-------------:|:------:|:-----------------------:|
| 0.1705 | 500   | 0.0737        | -      | -                       |
| 0.3411 | 1000  | 0.0407        | 0.0377 | 0.8736                  |
| 0.5116 | 1500  | 0.0346        | -      | -                       |
| 0.6821 | 2000  | 0.0289        | 0.0260 | 0.8932                  |
| 0.8527 | 2500  | 0.0275        | -      | -                       |
| 1.0201 | 3000  | 0.0279        | 0.0317 | 0.8718                  |
| 1.1907 | 3500  | 0.026         | -      | -                       |
| 1.3612 | 4000  | 0.0241        | 0.0233 | 0.9000                  |
| 1.5317 | 4500  | 0.0231        | -      | -                       |
| 1.7023 | 5000  | 0.0203        | 0.0206 | 0.9045                  |
| 1.8728 | 5500  | 0.0197        | -      | -                       |
| 2.0402 | 6000  | 0.0212        | 0.0218 | 0.9018                  |
| 2.2108 | 6500  | 0.0187        | -      | -                       |
| 2.3813 | 7000  | 0.0192        | 0.0188 | 0.9062                  |
| 2.5518 | 7500  | 0.0185        | -      | -                       |
| 2.7224 | 8000  | 0.0163        | 0.0185 | 0.9083                  |
| 2.8929 | 8500  | 0.0164        | -      | -                       |
| 3.0604 | 9000  | 0.0169        | 0.0205 | 0.9075                  |
| 3.2309 | 9500  | 0.0156        | -      | -                       |
| 3.4014 | 10000 | 0.0161        | 0.0179 | 0.9087                  |
| 3.5720 | 10500 | 0.016         | -      | -                       |
| 3.7425 | 11000 | 0.0139        | 0.0179 | 0.9101                  |
| 3.9130 | 11500 | 0.0143        | -      | -                       |
| 4.0805 | 12000 | 0.0143        | 0.0190 | 0.9104                  |
| 4.2510 | 12500 | 0.0136        | -      | -                       |
| 4.4216 | 13000 | 0.0144        | 0.0212 | 0.9093                  |
| 4.5921 | 13500 | 0.0139        | -      | -                       |
| 4.7626 | 14000 | 0.0123        | 0.0174 | 0.9116                  |
| 4.9332 | 14500 | 0.0126        | -      | -                       |
| 5.1006 | 15000 | 0.0129        | 0.0181 | 0.9109                  |
| 5.2711 | 15500 | 0.0122        | -      | -                       |
| 5.4417 | 16000 | 0.0128        | 0.0210 | 0.9100                  |
| 5.6122 | 16500 | 0.0123        | -      | -                       |
| 5.7827 | 17000 | 0.011         | 0.0178 | 0.9116                  |
| 5.9533 | 17500 | 0.0114        | -      | -                       |
| 6.1207 | 18000 | 0.0115        | 0.0175 | 0.9124                  |


### Framework Versions
- Python: 3.12.3
- Sentence Transformers: 3.0.1
- Transformers: 4.44.2
- PyTorch: 2.4.0+cu121
- Accelerate: 0.33.0
- Datasets: 2.21.0
- Tokenizers: 0.19.1

## Citation

### BibTeX

#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}
```

<!--
## Glossary

*Clearly define terms in order to be accessible across audiences.*
-->

<!--
## Model Card Authors

*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->

<!--
## Model Card Contact

*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->