Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,17 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoint-1044/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-116/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1160/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1276/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1392/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1508/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-1624/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-232/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-348/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-464/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-580/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-696/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-812/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoint-928/tokenizer.json filter=lfs diff=lfs merge=lfs -text

checkpoint-1044/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1044/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1044/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b785da1310d15c1456c9c5d1242a6286afff1828d307776ec8b5241a8876a542
+size 7395706784

checkpoint-1044/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1044/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-1044/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-116/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-116/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-116/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0753d2ef470d9e5c922c659908e5545b37947edae439d0fa8aaaaf6f5749bec8
+size 7395706784

checkpoint-116/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-116/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-116/trainer_state.json

@@ -0,0 +1,962 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.9925133689839573,
+  "eval_steps": 500,
+  "global_step": 116,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.008556149732620321,
+      "grad_norm": 0.7822043299674988,
+      "learning_rate": 0.0,
+      "loss": 1.0074,
+      "num_tokens": 55968.0,
+      "step": 1
+    },
+    {
+      "epoch": 0.017112299465240642,
+      "grad_norm": 0.7544397711753845,
+      "learning_rate": 2.0000000000000003e-06,
+      "loss": 1.027,
+      "num_tokens": 99820.0,
+      "step": 2
+    },
+    {
+      "epoch": 0.025668449197860963,
+      "grad_norm": 0.8617167472839355,
+      "learning_rate": 4.000000000000001e-06,
+      "loss": 1.1232,
+      "num_tokens": 135107.0,
+      "step": 3
+    },
+    {
+      "epoch": 0.034224598930481284,
+      "grad_norm": 0.7228104472160339,
+      "learning_rate": 6e-06,
+      "loss": 1.0942,
+      "num_tokens": 179951.0,
+      "step": 4
+    },
+    {
+      "epoch": 0.0427807486631016,
+      "grad_norm": 0.7234599590301514,
+      "learning_rate": 8.000000000000001e-06,
+      "loss": 1.3189,
+      "num_tokens": 221105.0,
+      "step": 5
+    },
+    {
+      "epoch": 0.051336898395721926,
+      "grad_norm": 0.5197210907936096,
+      "learning_rate": 1e-05,
+      "loss": 1.0848,
+      "num_tokens": 268136.0,
+      "step": 6
+    },
+    {
+      "epoch": 0.059893048128342244,
+      "grad_norm": 0.5464422702789307,
+      "learning_rate": 1.2e-05,
+      "loss": 0.9819,
+      "num_tokens": 302811.0,
+      "step": 7
+    },
+    {
+      "epoch": 0.06844919786096257,
+      "grad_norm": 0.5724830031394958,
+      "learning_rate": 1.4e-05,
+      "loss": 1.0455,
+      "num_tokens": 359411.0,
+      "step": 8
+    },
+    {
+      "epoch": 0.07700534759358289,
+      "grad_norm": 0.7138378620147705,
+      "learning_rate": 1.6000000000000003e-05,
+      "loss": 1.1014,
+      "num_tokens": 404375.0,
+      "step": 9
+    },
+    {
+      "epoch": 0.0855614973262032,
+      "grad_norm": 0.616796612739563,
+      "learning_rate": 1.8e-05,
+      "loss": 1.0832,
+      "num_tokens": 450958.0,
+      "step": 10
+    },
+    {
+      "epoch": 0.09411764705882353,
+      "grad_norm": 0.6159569621086121,
+      "learning_rate": 2e-05,
+      "loss": 1.016,
+      "num_tokens": 488096.0,
+      "step": 11
+    },
+    {
+      "epoch": 0.10267379679144385,
+      "grad_norm": 0.5561163425445557,
+      "learning_rate": 2.2000000000000003e-05,
+      "loss": 0.9676,
+      "num_tokens": 542372.0,
+      "step": 12
+    },
+    {
+      "epoch": 0.11122994652406418,
+      "grad_norm": 0.5765581130981445,
+      "learning_rate": 2.4e-05,
+      "loss": 0.9847,
+      "num_tokens": 572854.0,
+      "step": 13
+    },
+    {
+      "epoch": 0.11978609625668449,
+      "grad_norm": 0.48102205991744995,
+      "learning_rate": 2.6000000000000002e-05,
+      "loss": 0.8962,
+      "num_tokens": 618720.0,
+      "step": 14
+    },
+    {
+      "epoch": 0.12834224598930483,
+      "grad_norm": 0.5598361492156982,
+      "learning_rate": 2.8e-05,
+      "loss": 0.9171,
+      "num_tokens": 655700.0,
+      "step": 15
+    },
+    {
+      "epoch": 0.13689839572192514,
+      "grad_norm": 0.5238959193229675,
+      "learning_rate": 3.0000000000000004e-05,
+      "loss": 0.9228,
+      "num_tokens": 692583.0,
+      "step": 16
+    },
+    {
+      "epoch": 0.14545454545454545,
+      "grad_norm": 0.5219410061836243,
+      "learning_rate": 3.2000000000000005e-05,
+      "loss": 0.9557,
+      "num_tokens": 726403.0,
+      "step": 17
+    },
+    {
+      "epoch": 0.15401069518716579,
+      "grad_norm": 0.8473337888717651,
+      "learning_rate": 3.4e-05,
+      "loss": 0.9237,
+      "num_tokens": 753116.0,
+      "step": 18
+    },
+    {
+      "epoch": 0.1625668449197861,
+      "grad_norm": 0.4146762490272522,
+      "learning_rate": 3.6e-05,
+      "loss": 0.869,
+      "num_tokens": 801272.0,
+      "step": 19
+    },
+    {
+      "epoch": 0.1711229946524064,
+      "grad_norm": 0.4924302399158478,
+      "learning_rate": 3.8e-05,
+      "loss": 0.7645,
+      "num_tokens": 860945.0,
+      "step": 20
+    },
+    {
+      "epoch": 0.17967914438502675,
+      "grad_norm": 0.5741301774978638,
+      "learning_rate": 4e-05,
+      "loss": 0.9683,
+      "num_tokens": 887977.0,
+      "step": 21
+    },
+    {
+      "epoch": 0.18823529411764706,
+      "grad_norm": 0.4793049991130829,
+      "learning_rate": 3.9988439306358385e-05,
+      "loss": 0.8273,
+      "num_tokens": 929076.0,
+      "step": 22
+    },
+    {
+      "epoch": 0.19679144385026737,
+      "grad_norm": 0.44812819361686707,
+      "learning_rate": 3.9976878612716766e-05,
+      "loss": 0.8625,
+      "num_tokens": 979053.0,
+      "step": 23
+    },
+    {
+      "epoch": 0.2053475935828877,
+      "grad_norm": 0.4587875008583069,
+      "learning_rate": 3.996531791907515e-05,
+      "loss": 0.7091,
+      "num_tokens": 1017067.0,
+      "step": 24
+    },
+    {
+      "epoch": 0.21390374331550802,
+      "grad_norm": 0.5536704659461975,
+      "learning_rate": 3.995375722543353e-05,
+      "loss": 0.8177,
+      "num_tokens": 1057323.0,
+      "step": 25
+    },
+    {
+      "epoch": 0.22245989304812835,
+      "grad_norm": 0.5225799083709717,
+      "learning_rate": 3.994219653179191e-05,
+      "loss": 0.8511,
+      "num_tokens": 1093227.0,
+      "step": 26
+    },
+    {
+      "epoch": 0.23101604278074866,
+      "grad_norm": 0.5399086475372314,
+      "learning_rate": 3.993063583815029e-05,
+      "loss": 0.9186,
+      "num_tokens": 1128164.0,
+      "step": 27
+    },
+    {
+      "epoch": 0.23957219251336898,
+      "grad_norm": 0.5645356178283691,
+      "learning_rate": 3.991907514450867e-05,
+      "loss": 0.8247,
+      "num_tokens": 1170135.0,
+      "step": 28
+    },
+    {
+      "epoch": 0.24812834224598931,
+      "grad_norm": 0.5938252210617065,
+      "learning_rate": 3.9907514450867054e-05,
+      "loss": 0.7784,
+      "num_tokens": 1208970.0,
+      "step": 29
+    },
+    {
+      "epoch": 0.25668449197860965,
+      "grad_norm": 0.4818040132522583,
+      "learning_rate": 3.9895953757225436e-05,
+      "loss": 0.9013,
+      "num_tokens": 1253154.0,
+      "step": 30
+    },
+    {
+      "epoch": 0.26524064171122996,
+      "grad_norm": 0.5642525553703308,
+      "learning_rate": 3.988439306358382e-05,
+      "loss": 0.7517,
+      "num_tokens": 1282369.0,
+      "step": 31
+    },
+    {
+      "epoch": 0.2737967914438503,
+      "grad_norm": 0.6214815378189087,
+      "learning_rate": 3.98728323699422e-05,
+      "loss": 0.8867,
+      "num_tokens": 1311162.0,
+      "step": 32
+    },
+    {
+      "epoch": 0.2823529411764706,
+      "grad_norm": 0.5425256490707397,
+      "learning_rate": 3.986127167630058e-05,
+      "loss": 0.7303,
+      "num_tokens": 1356636.0,
+      "step": 33
+    },
+    {
+      "epoch": 0.2909090909090909,
+      "grad_norm": 0.5215423703193665,
+      "learning_rate": 3.984971098265896e-05,
+      "loss": 0.6155,
+      "num_tokens": 1391754.0,
+      "step": 34
+    },
+    {
+      "epoch": 0.2994652406417112,
+      "grad_norm": 0.5118246674537659,
+      "learning_rate": 3.983815028901734e-05,
+      "loss": 0.6078,
+      "num_tokens": 1437280.0,
+      "step": 35
+    },
+    {
+      "epoch": 0.30802139037433157,
+      "grad_norm": 0.44412943720817566,
+      "learning_rate": 3.9826589595375724e-05,
+      "loss": 0.601,
+      "num_tokens": 1487807.0,
+      "step": 36
+    },
+    {
+      "epoch": 0.3165775401069519,
+      "grad_norm": 0.4552980065345764,
+      "learning_rate": 3.9815028901734105e-05,
+      "loss": 0.7573,
+      "num_tokens": 1529597.0,
+      "step": 37
+    },
+    {
+      "epoch": 0.3251336898395722,
+      "grad_norm": 0.4453286826610565,
+      "learning_rate": 3.980346820809249e-05,
+      "loss": 0.5348,
+      "num_tokens": 1579239.0,
+      "step": 38
+    },
+    {
+      "epoch": 0.3336898395721925,
+      "grad_norm": 0.4977327585220337,
+      "learning_rate": 3.979190751445087e-05,
+      "loss": 0.6736,
+      "num_tokens": 1618540.0,
+      "step": 39
+    },
+    {
+      "epoch": 0.3422459893048128,
+      "grad_norm": 0.4571434557437897,
+      "learning_rate": 3.978034682080925e-05,
+      "loss": 0.515,
+      "num_tokens": 1667794.0,
+      "step": 40
+    },
+    {
+      "epoch": 0.3508021390374332,
+      "grad_norm": 0.5822021961212158,
+      "learning_rate": 3.976878612716763e-05,
+      "loss": 0.4761,
+      "num_tokens": 1713564.0,
+      "step": 41
+    },
+    {
+      "epoch": 0.3593582887700535,
+      "grad_norm": 0.5507885217666626,
+      "learning_rate": 3.975722543352602e-05,
+      "loss": 0.679,
+      "num_tokens": 1753268.0,
+      "step": 42
+    },
+    {
+      "epoch": 0.3679144385026738,
+      "grad_norm": 0.5112994313240051,
+      "learning_rate": 3.97456647398844e-05,
+      "loss": 0.6231,
+      "num_tokens": 1796128.0,
+      "step": 43
+    },
+    {
+      "epoch": 0.3764705882352941,
+      "grad_norm": 0.5448322892189026,
+      "learning_rate": 3.973410404624278e-05,
+      "loss": 0.6077,
+      "num_tokens": 1832575.0,
+      "step": 44
+    },
+    {
+      "epoch": 0.3850267379679144,
+      "grad_norm": 0.37897467613220215,
+      "learning_rate": 3.9722543352601156e-05,
+      "loss": 0.3906,
+      "num_tokens": 1877561.0,
+      "step": 45
+    },
+    {
+      "epoch": 0.39358288770053473,
+      "grad_norm": 0.5131210088729858,
+      "learning_rate": 3.971098265895954e-05,
+      "loss": 0.565,
+      "num_tokens": 1922400.0,
+      "step": 46
+    },
+    {
+      "epoch": 0.4021390374331551,
+      "grad_norm": 0.3850463330745697,
+      "learning_rate": 3.969942196531792e-05,
+      "loss": 0.348,
+      "num_tokens": 1984298.0,
+      "step": 47
+    },
+    {
+      "epoch": 0.4106951871657754,
+      "grad_norm": 0.5372320413589478,
+      "learning_rate": 3.96878612716763e-05,
+      "loss": 0.466,
+      "num_tokens": 2021643.0,
+      "step": 48
+    },
+    {
+      "epoch": 0.4192513368983957,
+      "grad_norm": 0.49307167530059814,
+      "learning_rate": 3.967630057803468e-05,
+      "loss": 0.601,
+      "num_tokens": 2069445.0,
+      "step": 49
+    },
+    {
+      "epoch": 0.42780748663101603,
+      "grad_norm": 0.506504476070404,
+      "learning_rate": 3.966473988439307e-05,
+      "loss": 0.4431,
+      "num_tokens": 2108944.0,
+      "step": 50
+    },
+    {
+      "epoch": 0.43636363636363634,
+      "grad_norm": 0.6762319803237915,
+      "learning_rate": 3.965317919075145e-05,
+      "loss": 0.6603,
+      "num_tokens": 2134146.0,
+      "step": 51
+    },
+    {
+      "epoch": 0.4449197860962567,
+      "grad_norm": 0.44689473509788513,
+      "learning_rate": 3.964161849710983e-05,
+      "loss": 0.3806,
+      "num_tokens": 2180787.0,
+      "step": 52
+    },
+    {
+      "epoch": 0.453475935828877,
+      "grad_norm": 0.5198652744293213,
+      "learning_rate": 3.9630057803468214e-05,
+      "loss": 0.4244,
+      "num_tokens": 2226330.0,
+      "step": 53
+    },
+    {
+      "epoch": 0.46203208556149733,
+      "grad_norm": 0.508412778377533,
+      "learning_rate": 3.9618497109826596e-05,
+      "loss": 0.5549,
+      "num_tokens": 2267965.0,
+      "step": 54
+    },
+    {
+      "epoch": 0.47058823529411764,
+      "grad_norm": 0.38534849882125854,
+      "learning_rate": 3.960693641618497e-05,
+      "loss": 0.3559,
+      "num_tokens": 2324409.0,
+      "step": 55
+    },
+    {
+      "epoch": 0.47914438502673795,
+      "grad_norm": 0.5111398696899414,
+      "learning_rate": 3.959537572254335e-05,
+      "loss": 0.4472,
+      "num_tokens": 2367817.0,
+      "step": 56
+    },
+    {
+      "epoch": 0.48770053475935826,
+      "grad_norm": 0.6590611338615417,
+      "learning_rate": 3.958381502890173e-05,
+      "loss": 0.6616,
+      "num_tokens": 2396789.0,
+      "step": 57
+    },
+    {
+      "epoch": 0.49625668449197863,
+      "grad_norm": 0.5207543969154358,
+      "learning_rate": 3.957225433526012e-05,
+      "loss": 0.4503,
+      "num_tokens": 2438063.0,
+      "step": 58
+    },
+    {
+      "epoch": 0.5048128342245989,
+      "grad_norm": 0.6006039977073669,
+      "learning_rate": 3.95606936416185e-05,
+      "loss": 0.4818,
+      "num_tokens": 2469648.0,
+      "step": 59
+    },
+    {
+      "epoch": 0.5133689839572193,
+      "grad_norm": 0.5470290184020996,
+      "learning_rate": 3.9549132947976884e-05,
+      "loss": 0.5743,
+      "num_tokens": 2503908.0,
+      "step": 60
+    },
+    {
+      "epoch": 0.5219251336898396,
+      "grad_norm": 0.5730227828025818,
+      "learning_rate": 3.9537572254335265e-05,
+      "loss": 0.5661,
+      "num_tokens": 2534812.0,
+      "step": 61
+    },
+    {
+      "epoch": 0.5304812834224599,
+      "grad_norm": 0.6346086859703064,
+      "learning_rate": 3.9526011560693647e-05,
+      "loss": 0.5686,
+      "num_tokens": 2561085.0,
+      "step": 62
+    },
+    {
+      "epoch": 0.5390374331550802,
+      "grad_norm": 0.49484145641326904,
+      "learning_rate": 3.951445086705203e-05,
+      "loss": 0.4337,
+      "num_tokens": 2606297.0,
+      "step": 63
+    },
+    {
+      "epoch": 0.5475935828877005,
+      "grad_norm": 0.6020484566688538,
+      "learning_rate": 3.950289017341041e-05,
+      "loss": 0.5837,
+      "num_tokens": 2653948.0,
+      "step": 64
+    },
+    {
+      "epoch": 0.5561497326203209,
+      "grad_norm": 0.5568578243255615,
+      "learning_rate": 3.949132947976879e-05,
+      "loss": 0.5058,
+      "num_tokens": 2686481.0,
+      "step": 65
+    },
+    {
+      "epoch": 0.5647058823529412,
+      "grad_norm": 0.6906923055648804,
+      "learning_rate": 3.947976878612717e-05,
+      "loss": 0.5532,
+      "num_tokens": 2720143.0,
+      "step": 66
+    },
+    {
+      "epoch": 0.5732620320855615,
+      "grad_norm": 0.511943519115448,
+      "learning_rate": 3.9468208092485553e-05,
+      "loss": 0.584,
+      "num_tokens": 2765521.0,
+      "step": 67
+    },
+    {
+      "epoch": 0.5818181818181818,
+      "grad_norm": 0.6922094225883484,
+      "learning_rate": 3.9456647398843935e-05,
+      "loss": 0.5696,
+      "num_tokens": 2795607.0,
+      "step": 68
+    },
+    {
+      "epoch": 0.5903743315508021,
+      "grad_norm": 0.6023969650268555,
+      "learning_rate": 3.9445086705202316e-05,
+      "loss": 0.6339,
+      "num_tokens": 2825652.0,
+      "step": 69
+    },
+    {
+      "epoch": 0.5989304812834224,
+      "grad_norm": 0.5391364693641663,
+      "learning_rate": 3.94335260115607e-05,
+      "loss": 0.389,
+      "num_tokens": 2868421.0,
+      "step": 70
+    },
+    {
+      "epoch": 0.6074866310160428,
+      "grad_norm": 0.6358250975608826,
+      "learning_rate": 3.942196531791908e-05,
+      "loss": 0.4764,
+      "num_tokens": 2907908.0,
+      "step": 71
+    },
+    {
+      "epoch": 0.6160427807486631,
+      "grad_norm": 0.6710934638977051,
+      "learning_rate": 3.941040462427746e-05,
+      "loss": 0.4537,
+      "num_tokens": 2938836.0,
+      "step": 72
+    },
+    {
+      "epoch": 0.6245989304812835,
+      "grad_norm": 0.5638974905014038,
+      "learning_rate": 3.939884393063584e-05,
+      "loss": 0.4395,
+      "num_tokens": 2974310.0,
+      "step": 73
+    },
+    {
+      "epoch": 0.6331550802139038,
+      "grad_norm": 0.6120519042015076,
+      "learning_rate": 3.938728323699422e-05,
+      "loss": 0.4819,
+      "num_tokens": 3010438.0,
+      "step": 74
+    },
+    {
+      "epoch": 0.6417112299465241,
+      "grad_norm": 0.47333046793937683,
+      "learning_rate": 3.9375722543352604e-05,
+      "loss": 0.2298,
+      "num_tokens": 3069470.0,
+      "step": 75
+    },
+    {
+      "epoch": 0.6502673796791444,
+      "grad_norm": 0.5838622450828552,
+      "learning_rate": 3.9364161849710986e-05,
+      "loss": 0.5259,
+      "num_tokens": 3107544.0,
+      "step": 76
+    },
+    {
+      "epoch": 0.6588235294117647,
+      "grad_norm": 1.0287554264068604,
+      "learning_rate": 3.935260115606937e-05,
+      "loss": 0.5845,
+      "num_tokens": 3140462.0,
+      "step": 77
+    },
+    {
+      "epoch": 0.667379679144385,
+      "grad_norm": 0.6893025040626526,
+      "learning_rate": 3.934104046242775e-05,
+      "loss": 0.3978,
+      "num_tokens": 3174213.0,
+      "step": 78
+    },
+    {
+      "epoch": 0.6759358288770053,
+      "grad_norm": 0.46106499433517456,
+      "learning_rate": 3.932947976878613e-05,
+      "loss": 0.3339,
+      "num_tokens": 3216113.0,
+      "step": 79
+    },
+    {
+      "epoch": 0.6844919786096256,
+      "grad_norm": 0.5351307988166809,
+      "learning_rate": 3.931791907514451e-05,
+      "loss": 0.3216,
+      "num_tokens": 3249566.0,
+      "step": 80
+    },
+    {
+      "epoch": 0.6930481283422459,
+      "grad_norm": 0.8270958065986633,
+      "learning_rate": 3.930635838150289e-05,
+      "loss": 0.4257,
+      "num_tokens": 3281603.0,
+      "step": 81
+    },
+    {
+      "epoch": 0.7016042780748664,
+      "grad_norm": 0.539527952671051,
+      "learning_rate": 3.9294797687861274e-05,
+      "loss": 0.3643,
+      "num_tokens": 3313887.0,
+      "step": 82
+    },
+    {
+      "epoch": 0.7101604278074867,
+      "grad_norm": 0.6848272085189819,
+      "learning_rate": 3.9283236994219656e-05,
+      "loss": 0.6028,
+      "num_tokens": 3356535.0,
+      "step": 83
+    },
+    {
+      "epoch": 0.718716577540107,
+      "grad_norm": 0.5897014737129211,
+      "learning_rate": 3.927167630057804e-05,
+      "loss": 0.4041,
+      "num_tokens": 3398543.0,
+      "step": 84
+    },
+    {
+      "epoch": 0.7272727272727273,
+      "grad_norm": 0.5014194846153259,
+      "learning_rate": 3.926011560693642e-05,
+      "loss": 0.2815,
+      "num_tokens": 3438701.0,
+      "step": 85
+    },
+    {
+      "epoch": 0.7358288770053476,
+      "grad_norm": 0.6459265947341919,
+      "learning_rate": 3.92485549132948e-05,
+      "loss": 0.4525,
+      "num_tokens": 3477898.0,
+      "step": 86
+    },
+    {
+      "epoch": 0.7443850267379679,
+      "grad_norm": 0.4868873059749603,
+      "learning_rate": 3.923699421965318e-05,
+      "loss": 0.3367,
+      "num_tokens": 3515789.0,
+      "step": 87
+    },
+    {
+      "epoch": 0.7529411764705882,
+      "grad_norm": 0.42306777834892273,
+      "learning_rate": 3.922543352601156e-05,
+      "loss": 0.2785,
+      "num_tokens": 3565730.0,
+      "step": 88
+    },
+    {
+      "epoch": 0.7614973262032085,
+      "grad_norm": 0.6114925146102905,
+      "learning_rate": 3.9213872832369944e-05,
+      "loss": 0.4127,
+      "num_tokens": 3599811.0,
+      "step": 89
+    },
+    {
+      "epoch": 0.7700534759358288,
+      "grad_norm": 0.6191623210906982,
+      "learning_rate": 3.920231213872833e-05,
+      "loss": 0.3512,
+      "num_tokens": 3637175.0,
+      "step": 90
+    },
+    {
+      "epoch": 0.7786096256684492,
+      "grad_norm": 0.632534384727478,
+      "learning_rate": 3.9190751445086707e-05,
+      "loss": 0.3937,
+      "num_tokens": 3667755.0,
+      "step": 91
+    },
+    {
+      "epoch": 0.7871657754010695,
+      "grad_norm": 0.6782515645027161,
+      "learning_rate": 3.917919075144509e-05,
+      "loss": 0.3507,
+      "num_tokens": 3702113.0,
+      "step": 92
+    },
+    {
+      "epoch": 0.7957219251336899,
+      "grad_norm": 0.6971613764762878,
+      "learning_rate": 3.916763005780347e-05,
+      "loss": 0.4304,
+      "num_tokens": 3740995.0,
+      "step": 93
+    },
+    {
+      "epoch": 0.8042780748663102,
+      "grad_norm": 0.6003340482711792,
+      "learning_rate": 3.915606936416185e-05,
+      "loss": 0.4957,
+      "num_tokens": 3781151.0,
+      "step": 94
+    },
+    {
+      "epoch": 0.8128342245989305,
+      "grad_norm": 0.582608163356781,
+      "learning_rate": 3.914450867052023e-05,
+      "loss": 0.3527,
+      "num_tokens": 3811389.0,
+      "step": 95
+    },
+    {
+      "epoch": 0.8213903743315508,
+      "grad_norm": 0.5392261147499084,
+      "learning_rate": 3.9132947976878613e-05,
+      "loss": 0.3698,
+      "num_tokens": 3863861.0,
+      "step": 96
+    },
+    {
+      "epoch": 0.8299465240641711,
+      "grad_norm": 0.7214500904083252,
+      "learning_rate": 3.9121387283236995e-05,
+      "loss": 0.459,
+      "num_tokens": 3909626.0,
+      "step": 97
+    },
+    {
+      "epoch": 0.8385026737967914,
+      "grad_norm": 0.5125982761383057,
+      "learning_rate": 3.910982658959538e-05,
+      "loss": 0.2708,
+      "num_tokens": 3960465.0,
+      "step": 98
+    },
+    {
+      "epoch": 0.8470588235294118,
+      "grad_norm": 0.5990884900093079,
+      "learning_rate": 3.9098265895953764e-05,
+      "loss": 0.4309,
+      "num_tokens": 3994412.0,
+      "step": 99
+    },
+    {
+      "epoch": 0.8556149732620321,
+      "grad_norm": 1.1086792945861816,
+      "learning_rate": 3.9086705202312146e-05,
+      "loss": 0.361,
+      "num_tokens": 4030895.0,
+      "step": 100
+    },
+    {
+      "epoch": 0.8641711229946524,
+      "grad_norm": 0.7328159809112549,
+      "learning_rate": 3.907514450867053e-05,
+      "loss": 0.3986,
+      "num_tokens": 4060296.0,
+      "step": 101
+    },
+    {
+      "epoch": 0.8727272727272727,
+      "grad_norm": 0.6571171879768372,
+      "learning_rate": 3.90635838150289e-05,
+      "loss": 0.3789,
+      "num_tokens": 4096562.0,
+      "step": 102
+    },
+    {
+      "epoch": 0.881283422459893,
+      "grad_norm": 0.4391584098339081,
+      "learning_rate": 3.905202312138728e-05,
+      "loss": 0.2509,
+      "num_tokens": 4131803.0,
+      "step": 103
+    },
+    {
+      "epoch": 0.8898395721925134,
+      "grad_norm": 0.6193268299102783,
+      "learning_rate": 3.9040462427745664e-05,
+      "loss": 0.2635,
+      "num_tokens": 4171063.0,
+      "step": 104
+    },
+    {
+      "epoch": 0.8983957219251337,
+      "grad_norm": 0.5041255950927734,
+      "learning_rate": 3.9028901734104046e-05,
+      "loss": 0.295,
+      "num_tokens": 4208820.0,
+      "step": 105
+    },
+    {
+      "epoch": 0.906951871657754,
+      "grad_norm": 0.47196730971336365,
+      "learning_rate": 3.9017341040462434e-05,
+      "loss": 0.2896,
+      "num_tokens": 4251325.0,
+      "step": 106
+    },
+    {
+      "epoch": 0.9155080213903743,
+      "grad_norm": 0.39218226075172424,
+      "learning_rate": 3.9005780346820815e-05,
+      "loss": 0.1879,
+      "num_tokens": 4299351.0,
+      "step": 107
+    },
+    {
+      "epoch": 0.9240641711229947,
+      "grad_norm": 0.5704814791679382,
+      "learning_rate": 3.89942196531792e-05,
+      "loss": 0.2874,
+      "num_tokens": 4345747.0,
+      "step": 108
+    },
+    {
+      "epoch": 0.932620320855615,
+      "grad_norm": 0.5757870674133301,
+      "learning_rate": 3.898265895953758e-05,
+      "loss": 0.386,
+      "num_tokens": 4378671.0,
+      "step": 109
+    },
+    {
+      "epoch": 0.9411764705882353,
+      "grad_norm": 0.5471145510673523,
+      "learning_rate": 3.897109826589596e-05,
+      "loss": 0.2393,
+      "num_tokens": 4419094.0,
+      "step": 110
+    },
+    {
+      "epoch": 0.9497326203208556,
+      "grad_norm": 0.47205623984336853,
+      "learning_rate": 3.895953757225434e-05,
+      "loss": 0.1884,
+      "num_tokens": 4469825.0,
+      "step": 111
+    },
+    {
+      "epoch": 0.9582887700534759,
+      "grad_norm": 0.5538665652275085,
+      "learning_rate": 3.8947976878612715e-05,
+      "loss": 0.2097,
+      "num_tokens": 4507147.0,
+      "step": 112
+    },
+    {
+      "epoch": 0.9668449197860962,
+      "grad_norm": 0.6102054715156555,
+      "learning_rate": 3.89364161849711e-05,
+      "loss": 0.2525,
+      "num_tokens": 4546270.0,
+      "step": 113
+    },
+    {
+      "epoch": 0.9754010695187165,
+      "grad_norm": 0.6256245970726013,
+      "learning_rate": 3.8924855491329485e-05,
+      "loss": 0.4263,
+      "num_tokens": 4579477.0,
+      "step": 114
+    },
+    {
+      "epoch": 0.983957219251337,
+      "grad_norm": 0.5945616960525513,
+      "learning_rate": 3.8913294797687866e-05,
+      "loss": 0.2419,
+      "num_tokens": 4612466.0,
+      "step": 115
+    },
+    {
+      "epoch": 0.9925133689839573,
+      "grad_norm": 0.5300187468528748,
+      "learning_rate": 3.890173410404625e-05,
+      "loss": 0.3137,
+      "num_tokens": 4653875.0,
+      "step": 116
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 3480,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 30,
+  "save_steps": 116,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 3.412296412241592e+17,
+  "train_batch_size": 1,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-116/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-1160/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1160/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1160/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb0c9bae3d945ed998b336dd249277765093690f035342981ac235bae0fa846a
+size 7395706784

checkpoint-1160/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1160/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-1160/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-1276/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1276/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1276/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58c2a59f72062b22d6c20756cad4276206c6fbcb1500ac071b5bcf14c58111c5
+size 7395706784

checkpoint-1276/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1276/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-1276/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-1392/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1392/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1392/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9de802b34db2b1455948f360f3d7b8792a20ff5f943cc83c99aa0eab7bf57cd
+size 7395706784

checkpoint-1392/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1392/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-1392/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-1508/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0

checkpoint-1508/adapter_config.json

@@ -0,0 +1,35 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "whitecircle-ai/mistral-clear-small-2504",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 256,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "gate_proj",
+    "lm_head",
+    "up_proj",
+    "v_proj",
+    "q_proj",
+    "o_proj",
+    "down_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-1508/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ac4015b855073ec208b7ee4ffb171c6dd80659a79a0c7e523fc34429f056712
+size 7395706784

checkpoint-1508/special_tokens_map.json

@@ -0,0 +1,46 @@
+{
+  "additional_special_tokens": [
+    {
+      "content": "<|start_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    },
+    {
+      "content": "<|end_header_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-1508/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3355246fc9d84bcf9fc198002c967813366fab6e8df304d90b8c3d106bfb208f
+size 17078427

checkpoint-1508/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c44953cdd5578a90f788ccf74156572094f13c29c836c13c196c93bf1b3d8855
+size 5752

checkpoint-1624/README.md

@@ -0,0 +1,202 @@
+---
+base_model: whitecircle-ai/mistral-clear-small-2504
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.12.0