sentence-transformers safetensors roberta sentence-similarity feature-extraction generated_from_trainer dataset_size:4693 loss:MultipleNegativesRankingLoss arxiv:1908.10084 arxiv:1705.00652 base_model:sentence-transformers/all-distilroberta-v1 base_model:finetune:sentence-transformers/all-distilroberta-v1 autotrain_compatible text-embeddings-inference endpoints_compatible region:us
---
base_model: sentence-transformers/all-distilroberta-v1
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:4693
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: I'm looking for a protective summer accessory for my little girl
    that has a wide brim to shield her from the sun. It should be adjustable for a
    perfect fit and made from breathable, soft material. A variety of colors would
    be great too!
  sentences:
  - "Title: Goodthreads Men's Lightweight French Terry Crewneck Sweatshirt Descripion:\
    \ ['An Amazon brand - This lightweight French terry cotton crewneck sweatshirt\
    \ is a go-to layer for workouts and lounging'\n \"Goodthreads' collection of men's\
    \ clothing crafted with care takes wear-everywhere apparel to the next level.\
    \ Create can't-miss pairings with long- and short-sleeve button-down shirts in\
    \ standard and slim fits, plus chino pants and shorts made from wrinkle-free non-iron\
    \ fabric. With these classics-and T-shirts, polo shirts, and outerwear to round\
    \ out your look-Goodthreads is your go-to for wardrobe staples with the style\
    \ you want.\"]"
  - "Title: Baby Sun Hat UPF 50+ for Girls Wide Brim Toddler Sun Hat Adjustable Summer\
    \ Hat Descripion: ['Features' \"High sun protection factor to protect children's\
    \ safety\"\n 'The material is safe and will not cause any harm to children'\n\
    \ 'Convenient to carry, you can easily tuck the hat into the bag'\n 'Good breathability,\
    \ prevent the child from sultry, maintain a refreshing feeling'\n 'Size Adjustment'\n\
    \ \"Features a cord tie to help the hat fit perfectly with each child. You can\
    \ adjust the size of the hat to make sure it doesn't come off.\"\n 'multicolor'\n\
    \ 'We have prepared variety different colors for the baby sun hat, comfortable\
    \ and soft material, a must-have protective tool for the baby to go out'\n 'Note:'\n\
    \ '1.If you have any doubts, please contact customer service for suggestions;'\n\
    \ '2.Colors may appear slightly different via website due to computer picture\
    \ resolution and monitor settings;'\n '3.There is 0.79\"-1.18\" difference according\
    \ to manual measurement.']"
  - 'Title: Uber Eats Washed Adjustable Baseball Cap Peaked Cap Dad Hat Unisex Breathable
    Quick-Drying Top Hat Baseball Cap Men''s Hat… Black Descripion: [''Men Women Cotton
    Adjustable Washed Twill Baseball Cap Hat.A Personalized Cowboy Cap Is Great Fun
    And A Perfect Gift For Yourself/Friends/Lover.'']'
- source_sentence: I'm looking for a cute summer outfit for a little girl that includes
    a stylish top and matching pants. It should be comfortable and perfect for warm
    weather, ideally with a playful design.
  sentences:
  - "Title: Toddler Baby Girl Clothes Baby Girl Crop Top + Leopard Flare Long Pants 2PCS Little\
    \ Girl Summer Outfits Sets Descripion: ['Size\\xa0Chart'\n 'Size\\xa090:\\xa0Top\\\
    xa0Length\\xa010.6inch，Bust\\xa0*11.8inch，Pants Length\\xa018.9inch,\\xa0For\\\
    xa0Age\\xa02-3\\xa0T.'\n 'Size\\xa0100:\\xa0Top\\xa0Length\\xa011.4inch，Bust\\\
    xa0*12.2inch，Pants Length\\xa020.4inch, For\\xa0Age\\xa03-4\\xa0T.'\n 'Size\\\
    xa0110:\\xa0Top\\xa0Length\\xa012.2inch，Bust\\xa0*12.6inch，Pants Length\\xa022.0inch,\
    \ For\\xa0Age\\xa04-5\\xa0T.'\n 'Size\\xa0120:\\xa0Top\\xa0Length\\xa013.0inch，Bust\\\
    xa0*13.0inch，Pants Length\\xa023.6inch, For\\xa0Age\\xa05-6\\xa0T.'\n 'Customer\\\
    xa0Service'\n 'If\\xa0you\\xa0encounter\\xa0any\\xa0problems,\\xa0please\\xa0contact\\\
    xa0us,\\xa0we\\xa0will\\xa0actively\\xa0deal\\xa0with\\xa0your\\xa0problem\\xa0within\\\
    xa024\\xa0hours'\n 'Wish\\xa0your\\xa0baby\\xa0a\\xa0happy\\xa0and\\xa0healthy\\\
    xa0growth!\\xa0!\\xa0!']"
  - 'Title: Dad EST Keychain Gifts for First Time Dad, New Daddy Soon Promoted To
    Be Pregnancy Gift for Men Fathers Day Dad Birthday Descripion: [''Dad EST Keychain
    Gifts for First Time Dad, New Daddy Soon Promoted To Be Pregnancy Gift for Men
    Fathers Day Dad Birthday Present'']'
  - "Title: Goodthreads Men's Lightweight French Terry Crewneck Sweatshirt Descripion:\
    \ ['An Amazon brand - This lightweight French terry cotton crewneck sweatshirt\
    \ is a go-to layer for workouts and lounging'\n \"Goodthreads' collection of men's\
    \ clothing crafted with care takes wear-everywhere apparel to the next level.\
    \ Create can't-miss pairings with long- and short-sleeve button-down shirts in\
    \ standard and slim fits, plus chino pants and shorts made from wrinkle-free non-iron\
    \ fabric. With these classics-and T-shirts, polo shirts, and outerwear to round\
    \ out your look-Goodthreads is your go-to for wardrobe staples with the style\
    \ you want.\"]"
- source_sentence: I'm looking for a comprehensive kit that can help maintain the
    sparkle and shine of my precious jewelry, particularly for items made of gold
    and diamonds. It should be easy to use and include various tools for cleaning
    and polishing, making it suitable for regular upkeep and travel.
  sentences:
  - "Title: Connoisseurs Jewelry Cleaning Kit for Gold, Platinum, Diamonds & Precious\
    \ Stones. Includes Dip-in Solution, Polishing Cloth for Gold and Diamond Dazzle\
    \ Stik for mounts and settings. Bundle of 3 items. Descripion: ['Daily wear can\
    \ take a toll and cause your jewelry to look dull and opaque, that’s why we have\
    \ one of the most trustworthy and convenient jewelry cleaning kits available to\
    \ make your pieces shine for a long time.'\n 'Includes:' '1 x Fine Jewelry Cleaner'\n\
    \ 'Advanced cleaning formula that reduces the appearance of tiny scratches caused\
    \ by regular use. Brings shine to gold as well as platinum, diamonds and other\
    \ precious stones. Includes a dipping tray. Ammonia-Free.'\n '1 x UltraSoft Jewelry\
    \ Polishing Cloth for Gold'\n 'Easy 2-step cleaning and polishing system that\
    \ removes tarnish and helps prevent further buildup by creating an anti-tarnish\
    \ shield. This cloth leaves your pieces soft and shiny. Also great for polishing\
    \ watches. Made with 100% renewable cotton fiber.'\n '1 x Diamond Dazzle Stik'\n\
    \ 'The Stik is a cleaning pen that delivers a micro-fine cleansing and polishing\
    \ solution to an anti-scratch brush. The brush was designed to clean mountings\
    \ and settings. Turns dull and dirty diamonds to sparkling diamonds. Regular use\
    \ reduces the appearance of tiny scratches in settings. Safe to use on Diamonds\
    \ and precious and semi-precious gems, including platinum and gold settings. Cosmetic\
    \ pen-sized. Great for travel. Do not use on Pearls.'\n 'Directions:'\n 'Use the\
    \ Fine Jewelry Cleaner to dip in your most tarnished jewelry for 30 seconds. Remove\
    \ using the included tray and rinse with warm water. Dry with a lint-free cloth.\
    \ Once dry, buff your jewelry with the included cloth. First, gently rub your\
    \ jewelry with the lighter colored side of the cloth to remove any remaining dirt\
    \ and tarnish. Second, use the darker side of the cloth to buff and polish to\
    \ shine. The cloth can be used on gold and platinum. Use the Diamond Dazzle Stik\
    \ for detailing and cleaning behind stones and other mounting areas. Do not use\
    \ the Stik on pearls.']"
  - 'Title: Grip Boost Boys Yellow Peace Youth Football Gloves Pro Elite - Youth Kids
    Sizes - $44.95 Youth Large Descripion: [''IMPROVED GRIP: With our proprietary
    formula, Grip Boost youth football glove grip is made from crab shells. This unique
    layer is made with advanced suspended polymerization technology that provides
    the #1 grip in football performance gear. PEACE: Patented palm design is used
    to show your Cheetah speed on the field. ADJUSTABLE FOR PERFECT FIT: The back-of-hand
    has a unique compression material that is designed to conform to the contour of
    your hand, with a large gusset to provide a custom fit football glove. Grip Boost
    Stealth Pro Elite Football Gloves fit like a second skin. ALL WEATHER: Grip Boost
    Football Gloves is specially formulated to react and stick in any weather. Play
    like the pros, rain-or-shine. These football receiver gloves mens and youth are
    perfect for bringing in a clean catch without fumble. COMFORTABLE FEEL: Keep control
    with precision thanks to the thin, barely-there feel material with grip and support
    when you need it most. Moisture-wicking and ventilation prevent chafing and reduce
    distraction. These receiver gloves offer optimal function thats fit for the pros,
    designed by the pros, yet perfect for every player. Grip Boost Stealth Pro Elite
    Solid Color youth kids football gloves is a product that you can rely on for seasons
    to come. Designed to enhance overall performance, Grip Boost Youth football gloves
    provide the #1 Grip In Footballtechnology in the game. Â\xa0A formula conceptualized
    through a blend of passion for both performance and science, these football gloves
    provide the best grip for professional athletes, youth football gloves, and high
    school football players.Â'']'
  - 'Title: Kids Full-Coverage Tube FaceMask Bandanas, UV Protection Neck Gaiter Headband,
    boy and girl breathable elastic FaceMask dustproof towel neck leggings multifunctional
    headband boy and girl balaclava Descripion: [''100% Microfiber Polyester with
    high UV protection,Highly stretchable and Seamless keep you comfortable in any
    position,They are soft,breathable fabric. LIGHTWEIGHT & BREATHABLE - The moisture
    wicking fabric of our face covers transfer heat and humidity away from your body
    and outside of the mouth cover, keeping you cool. The quick dry fabric technology
    lets your facemask bandana dry in minutes, instead of hours. Wear it as a face
    facemask to protect your face from getting burned from the sun! STRONG PROTECTION:These
    neck gaiter protects you from the harmful elements, like dust, dirt, sand, UV,
    When you are running or riding in outdoor, these neck gaiters are a need to wear
    and they can help keep your nose and mouth clean PERFECT ACCESSORY - These festival
    rave facemask are great for dusty music festivals, concerts, biking, raves, and
    outdoor sports like paintball, hiking, yoga, exercising, yard work, riding or
    whenever you want to live dust free! ONE SIZE FITS MOST - These facemask bandanas
    feature a super stretchy fabric that accommodates most head sizes (men, women
    & kids).'']'
- source_sentence: I'm looking for a charming accessory that can be a thoughtful present.
    It should feature a unique design and be durable enough to withstand occasional
    exposure to water.
  sentences:
  - 'Title: Tokyo Ghoul Costume Woman Men Trucker Jacket Classic Ripped Slim Denim
    Jacket with Holes Kaneki Ken Hooded Jacket Cosplay Descripion: ["Women''s Ripped
    Distressed Casual Denim Jacket Men''s Classic Trucker Jacket Women''s Stretch
    Denim Jacket Anime men and women couple denim clothes Cartoon character print
    zipper, pocket, fashion coat 1piece set: jacket With or without liner: No liner
    Sleeve length: long sleeve Whether Hooded: Hooded Thickness: General Error range:
    2-3CM Suitable for the season: four seasons Main fabric composition:polyester
    Pattern: cartoon Style details: printing Edition type: Loose Process: hot stamping
    About size: (S):  Suitable for height 57-59 inches,bust 44 inches (M):  Suitable
    for height 59-63 inches,bust 45inches (L):  Suitable for height 63-65 inches,bust
    47 inches (XL):  Suitable for height 65-67inches,bust 48.5 inches (2XL):  Suitable
    for height 67-68 inches,bust 50 inches (3XL):  Suitable for height 68-70 inches,bust
    51 inches"]'
  - 'Title: CD Projekt Red Samurai Cyberpunk 2077 Logo T-Shirt for Men - Official
    Apparel Inspired by The Hit Video Game Descripion: ["Wash inside out in cold water
    with similar colors, don''t use a dryer, don''t iron decorative parts. Tee comes
    with its clothing tag and yellow collar. THICKNESS 170 GSM"]'
  - 'Title: Star Singer Double Sided Bezel Pendant Key Chain for Gift Descripion:
    [''This pendant is water resistant but not waterproof. The key chain is very beautiful
    and can be used as a gift.'']'
- source_sentence: I'm looking for a versatile and comfortable outerwear option that
    can provide warmth and protection from the wind. It should be suitable for both
    adults and kids, easy to clean, and made from a soft and breathable material.
  sentences:
  - 'Title: Cover Custom Western Texas Stars Washable and Reusable Warm Windproof
    for Women Men Boys Girls Kids Descripion: [''Our Products Are Made Of High-Quality
    100% Polyester Fiber, Which Is Very Soft, Breathable And Washable.'']'
  - "Title: Goodthreads Men's Soft Cotton Long-Sleeve Pullover Hoodie T-Shirt Descripion:\
    \ ['An Amazon brand - This pullover hoodie in soft cotton features a self-tie\
    \ drawstring and a kangaroo pocket. Made in our Signature Tumbled Cotton for a\
    \ soft, yet sturdy, hand. We utilize a unique Heritage Wash to give our garments\
    \ a custom, lived-in feel right away'\n \"Goodthreads' collection of men's clothing\
    \ crafted with care takes wear-everywhere apparel to the next level. Create can't-miss\
    \ pairings with long- and short-sleeve button-down shirts in standard and slim\
    \ fits, plus chino pants and shorts made from wrinkle-free non-iron fabric. With\
    \ these classics-and T-shirts, polo shirts, and outerwear to round out your look-Goodthreads\
    \ is your go-to for wardrobe staples with the style you want.\"]"
  - 'Title: Sicilia Mini Boxing Gloves - Perfect To Hang in Car Mirror | Sicily Flag
    Gloves Descripion: [''Made with pride from high-quality materials, these tiny
    gloves sporting the Sicilian flag are the ultimate invitation to celebrate your
    heritage. Hang them from your rear view mirror, or on your new vintage backpack
    for a celebratory impact of attention.'']'
---

# SentenceTransformer based on sentence-transformers/all-distilroberta-v1

This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-distilroberta-v1](https://huggingface.co/sentence-transformers/all-distilroberta-v1). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

## Model Details

### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [sentence-transformers/all-distilroberta-v1](https://huggingface.co/sentence-transformers/all-distilroberta-v1) <!-- at revision 8d88b92a34345fd6a139aa47768c9881720006ce -->
- **Maximum Sequence Length:** 128 tokens
- **Output Dimensionality:** 768 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->

### Model Sources

- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)

### Full Model Architecture

```
SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: RobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
```

## Usage

### Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

```bash
pip install -U sentence-transformers
```

Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("knguyennguyen/distill_fashion_5k")
# Run inference
sentences = [
    "I'm looking for a versatile and comfortable outerwear option that can provide warmth and protection from the wind. It should be suitable for both adults and kids, easy to clean, and made from a soft and breathable material.",
    "Title: Cover Custom Western Texas Stars Washable and Reusable Warm Windproof for Women Men Boys Girls Kids Descripion: ['Our Products Are Made Of High-Quality 100% Polyester Fiber, Which Is Very Soft, Breathable And Washable.']",
    'Title: Goodthreads Men\'s Soft Cotton Long-Sleeve Pullover Hoodie T-Shirt Descripion: [\'An Amazon brand - This pullover hoodie in soft cotton features a self-tie drawstring and a kangaroo pocket. Made in our Signature Tumbled Cotton for a soft, yet sturdy, hand. We utilize a unique Heritage Wash to give our garments a custom, lived-in feel right away\'\n "Goodthreads\' collection of men\'s clothing crafted with care takes wear-everywhere apparel to the next level. Create can\'t-miss pairings with long- and short-sleeve button-down shirts in standard and slim fits, plus chino pants and shorts made from wrinkle-free non-iron fabric. With these classics-and T-shirts, polo shirts, and outerwear to round out your look-Goodthreads is your go-to for wardrobe staples with the style you want."]',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```

<!--
### Direct Usage (Transformers)

<details><summary>Click to see the direct usage in Transformers</summary>

</details>
-->

<!--
### Downstream Usage (Sentence Transformers)

You can finetune this model on your own dataset.

<details><summary>Click to expand</summary>

</details>
-->

<!--
### Out-of-Scope Use

*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->

<!--
## Bias, Risks and Limitations

*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->

<!--
### Recommendations

*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->

## Training Details

### Training Dataset

#### Unnamed Dataset


* Size: 4,693 training samples
* Columns: <code>sentence_0</code> and <code>sentence_1</code>
* Approximate statistics based on the first 1000 samples:
  |         | sentence_0                                                                         | sentence_1                                                                           |
  |:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
  | type    | string                                                                             | string                                                                               |
  | details | <ul><li>min: 26 tokens</li><li>mean: 44.67 tokens</li><li>max: 88 tokens</li></ul> | <ul><li>min: 19 tokens</li><li>mean: 107.26 tokens</li><li>max: 128 tokens</li></ul> |
* Samples:
  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                   | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
  |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
  | <code>I'm looking for a bulk selection of decorative pieces that can be used to create unique jewelry and craft projects. They should come in a variety of styles, with a classic gold finish, and be suitable for personalizing items like necklaces or bracelets. These accessories should also be versatile enough for various crafting applications and make a lovely gift for special occasions.</code> | <code>Title: Wholesale Bulk 50PCS Mixed Gold Charms Pendants DIY for Jewelry Making and Crafting Descripion: ['50pcs Mixed KC Gold Charms Pendants for Jewelry Making, DIY Craft Charms Bulk for Necklace Bracelet Jewelry Making Crafting'<br> 'Color:' 'KC Gold.' 'Size:' '0.42" - 1.15" (11 - 28 mm).'<br> 'Main Material:' 'Alloy, Metal.' 'Package Include:'<br> "50pcs gold charm. 1 pcs chamois cloth of SUNEEY.(Suitable for cleaning and polishing jewelry.)  Gold charm, it's fashion, creative, full of special means, is a very useful accessory,Exquisite and classical design charms.It can be used in all kinds of decoration.  A good gift for yourself or friends, or birthday gift, anniversary present. Suit for key chain, bag pendant, sweater chain pendants, ornaments, escort cards, scrapbooking, and other crafts etc. These charm can be used to create earrings, necklaces, charm bracelets, and all kinds of jewelry making and craft projects. Perfect for scrapbooking project, necklace pendant drop, jewelry making accessories. Jewelry Making Accessory Mixed wholesale metal charms Assorted themes great array of subjects and styles for all kinds of interests Great for parties or groups. This gold pendant set is very charming with the unique design. It is simple and understated but gorgeous and classy. This pretty design can highlight your appearance, grasp everyone's eyes in the crowd. We’re confident that you will love them,as it will make you stand out."]</code> |
  | <code>I'm looking for a stylish and comfortable cropped top that I can easily throw on after my workouts. It should be versatile enough for casual outings and have a fit that flatters the figure.</code>                                                                                                                                                                                                   | <code>Title: Core 10 Women's Soft Workout Cropped Hoodie Sweatshirt Descripion: ['An Amazon brand - This cropped Hoodie is a wardrobe-essential sweatshirt that features an easy, flattering fit for all your post-workout, layering, or everyday styling needs'<br> 'Empowering women to reach their full potential is at the heart of what we do. Because when you’re wearing Core 10, you’re ready to experience more. Be more. Live more.']</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
  | <code>I'm looking for a comfortable and stylish top for women that has a relaxed fit and a hood. It should come in trendy colors and allow for easy movement, making it perfect for casual outings or workouts.</code>                                                                                                                                                                                       | <code>Title: PUMA Ladies' Hooded Tee Descripion: ['Features: PUMA Colors: Black, Pink, and Purple Dropped shoulder seams Side slits for enhanced range of motion Mesh interior lined hood Puma Branded taping inside of neckline Content: 60% Cotton | 40% Modal Sizing: S-XL Relaxed fit Size Conversion: S = 4-6 | M = 8-10 | L = 12-14 | XL = 16-18 Model is wearing a size small Color & size subject to availability Care Instructions: Machine wash in cool water Permanent press cycle Do not bleach Do not tumble dry Drying horizontally Cool iron Do not dry clean']</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
  ```json
  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  ```

### Training Hyperparameters
#### Non-Default Hyperparameters

- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `num_train_epochs`: 5
- `multi_dataset_batch_sampler`: round_robin

#### All Hyperparameters
<details><summary>Click to expand</summary>

- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: no
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 5
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`: 
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `eval_use_gather_object`: False
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: round_robin

</details>

### Framework Versions
- Python: 3.11.11
- Sentence Transformers: 3.1.1
- Transformers: 4.45.2
- PyTorch: 2.5.1+cu121
- Accelerate: 1.2.1
- Datasets: 3.2.0
- Tokenizers: 0.20.3

## Citation

### BibTeX

#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}
```

#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}
```

<!--
## Glossary

*Clearly define terms in order to be accessible across audiences.*
-->

<!--
## Model Card Authors

*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->

<!--
## Model Card Contact

*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->