Model save

README.md

@@ -1,199 +1,57 @@
 ---
 library_name: transformers
-tags: []
+model_name: Qwen2-VL-2B-Instruct-SFT
+tags:
+- generated_from_trainer
+- trl
+- sft
+licence: license
 ---
 
-# Model Card for Model ID
+# Model Card for Qwen2-VL-2B-Instruct-SFT
 
-<!-- Provide a quick summary of what the model is/does. -->
+This model is a fine-tuned version of [None](https://huggingface.co/None).
+It has been trained using [TRL](https://github.com/huggingface/trl).
 
+## Quick start
 
+```python
+from transformers import pipeline
 
-## Model Details
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="russellyq/Qwen2-VL-2B-Instruct-SFT", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
 
-### Model Description
+## Training procedure
 
-<!-- Provide a longer summary of what this model is. -->
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/1155225591-the-chinese-university-of-hong-kong/R1-V/runs/lm442bwr) 
 
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
+This model was trained with SFT.
 
-### Model Sources [optional]
+### Framework versions
 
-<!-- Provide the basic links for the model. -->
+- TRL: 0.14.0
+- Transformers: 4.49.0.dev0
+- Pytorch: 2.5.1+cu121
+- Datasets: 3.4.1
+- Tokenizers: 0.21.1
 
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
+## Citations
 
-## Uses
 
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

all_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 1.0,
+    "total_flos": 2.0883561485697024e+16,
+    "train_loss": 1.0576730417826818,
+    "train_runtime": 852.991,
+    "train_samples": 2011,
+    "train_samples_per_second": 2.358,
+    "train_steps_per_second": 0.074
+}

config.json

@@ -0,0 +1,49 @@
+{
+  "_name_or_path": "/mnt/petrelfs/huxiaowei/Qiao/Qwen-VL/pretrained/Qwen2-VL-2B-Instruct",
+  "architectures": [
+    "Qwen2VLForConditionalGeneration"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 151643,
+  "eos_token_id": 151645,
+  "hidden_act": "silu",
+  "hidden_size": 1536,
+  "image_token_id": 151655,
+  "initializer_range": 0.02,
+  "intermediate_size": 8960,
+  "max_position_embeddings": 32768,
+  "max_window_layers": 28,
+  "model_type": "qwen2_vl",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 28,
+  "num_key_value_heads": 2,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": {
+    "mrope_section": [
+      16,
+      24,
+      24
+    ],
+    "rope_type": "default",
+    "type": "default"
+  },
+  "rope_theta": 1000000.0,
+  "sliding_window": 32768,
+  "tie_word_embeddings": true,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.49.0.dev0",
+  "use_cache": false,
+  "use_sliding_window": false,
+  "video_token_id": 151656,
+  "vision_config": {
+    "hidden_size": 1536,
+    "in_chans": 3,
+    "model_type": "qwen2_vl",
+    "spatial_patch_size": 14,
+    "torch_dtype": "bfloat16"
+  },
+  "vision_end_token_id": 151653,
+  "vision_start_token_id": 151652,
+  "vision_token_id": 151654,
+  "vocab_size": 151936
+}

generation_config.json

@@ -0,0 +1,15 @@
+{
+  "attn_implementation": null,
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "temperature": 0.01,
+  "top_k": 1,
+  "top_p": 0.001,
+  "transformers_version": "4.49.0.dev0",
+  "use_cache": false
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:405f10a78e74320258f05ed02b51876007223e6b56d617776ce53880fb724fe8
+size 4884798456

tokenizer_config.json

@@ -138,7 +138,6 @@
   "model_max_length": 32768,
   "pad_token": "<|endoftext|>",
   "padding_side": "left",
-  "processor_class": "Qwen2VLProcessor",
   "split_special_tokens": false,
   "tokenizer_class": "Qwen2Tokenizer",
   "unk_token": null

train_results.json

@@ -0,0 +1,9 @@
+{
+    "epoch": 1.0,
+    "total_flos": 2.0883561485697024e+16,
+    "train_loss": 1.0576730417826818,
+    "train_runtime": 852.991,
+    "train_samples": 2011,
+    "train_samples_per_second": 2.358,
+    "train_steps_per_second": 0.074
+}

trainer_state.json

@@ -0,0 +1,126 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 63,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.07936507936507936,
+      "grad_norm": 7.816065311431885,
+      "learning_rate": 1.4285714285714287e-05,
+      "loss": 2.1099,
+      "step": 5
+    },
+    {
+      "epoch": 0.15873015873015872,
+      "grad_norm": 3.8316564559936523,
+      "learning_rate": 1.985871018518236e-05,
+      "loss": 1.2551,
+      "step": 10
+    },
+    {
+      "epoch": 0.23809523809523808,
+      "grad_norm": 2.3298184871673584,
+      "learning_rate": 1.900968867902419e-05,
+      "loss": 1.0135,
+      "step": 15
+    },
+    {
+      "epoch": 0.31746031746031744,
+      "grad_norm": 2.625717878341675,
+      "learning_rate": 1.7456421648831658e-05,
+      "loss": 0.9708,
+      "step": 20
+    },
+    {
+      "epoch": 0.3968253968253968,
+      "grad_norm": 2.078977108001709,
+      "learning_rate": 1.5320320765153367e-05,
+      "loss": 0.9623,
+      "step": 25
+    },
+    {
+      "epoch": 0.47619047619047616,
+      "grad_norm": 2.326897382736206,
+      "learning_rate": 1.2768355114248493e-05,
+      "loss": 0.9482,
+      "step": 30
+    },
+    {
+      "epoch": 0.5555555555555556,
+      "grad_norm": 2.4574167728424072,
+      "learning_rate": 1e-05,
+      "loss": 0.9567,
+      "step": 35
+    },
+    {
+      "epoch": 0.6349206349206349,
+      "grad_norm": 1.8684089183807373,
+      "learning_rate": 7.2316448857515076e-06,
+      "loss": 0.9282,
+      "step": 40
+    },
+    {
+      "epoch": 0.7142857142857143,
+      "grad_norm": 2.163802146911621,
+      "learning_rate": 4.679679234846636e-06,
+      "loss": 0.9101,
+      "step": 45
+    },
+    {
+      "epoch": 0.7936507936507936,
+      "grad_norm": 2.871716260910034,
+      "learning_rate": 2.5435783511683444e-06,
+      "loss": 0.9134,
+      "step": 50
+    },
+    {
+      "epoch": 0.873015873015873,
+      "grad_norm": 2.999484062194824,
+      "learning_rate": 9.903113209758098e-07,
+      "loss": 0.9192,
+      "step": 55
+    },
+    {
+      "epoch": 0.9523809523809523,
+      "grad_norm": 3.2795374393463135,
+      "learning_rate": 1.4128981481764115e-07,
+      "loss": 0.913,
+      "step": 60
+    },
+    {
+      "epoch": 1.0,
+      "step": 63,
+      "total_flos": 2.0883561485697024e+16,
+      "train_loss": 1.0576730417826818,
+      "train_runtime": 852.991,
+      "train_samples_per_second": 2.358,
+      "train_steps_per_second": 0.074
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 63,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": false,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2.0883561485697024e+16,
+  "train_batch_size": 4,
+  "trial_name": null,
+  "trial_params": null
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1ebad1910e531cf1fa2b12150dc018c1c74b7c34cc9849146cd295023befa68
+size 7160