Update README.md
Browse files
README.md
CHANGED
@@ -19,20 +19,28 @@ pipeline_tag: image-text-to-text
|
|
19 |
We introduce OS-Genesis, an interaction-driven pipeline that synthesizes high-quality and diverse GUI agent trajectory data without human supervision. By leveraging reverse task synthesis, OS-Genesis enables effective training of GUI agents to achieve superior performance on dynamic benchmarks such as AndroidWorld and WebArena.
|
20 |
|
21 |
## Quick Start
|
22 |
-
OS-Genesis-8B-AC is a mobile action model finetuned from [InternVL2-
|
23 |
|
24 |
-
###
|
|
|
25 |
|
|
|
|
|
|
|
|
|
|
|
26 |
|
27 |
|
28 |
### Inference Example
|
29 |
First, install the `transformers` library:
|
|
|
30 |
```
|
31 |
pip install transformers
|
32 |
```
|
33 |
-
For additional dependencies, please refer to the [InternVL2 documentation](https://internvl.readthedocs.io/en/latest/get_started/installation.html)
|
34 |
|
35 |
-
|
|
|
|
|
36 |
|
37 |
Inference code example:
|
38 |
```python
|
|
|
19 |
We introduce OS-Genesis, an interaction-driven pipeline that synthesizes high-quality and diverse GUI agent trajectory data without human supervision. By leveraging reverse task synthesis, OS-Genesis enables effective training of GUI agents to achieve superior performance on dynamic benchmarks such as AndroidWorld and WebArena.
|
20 |
|
21 |
## Quick Start
|
22 |
+
OS-Genesis-8B-AC is a mobile action model finetuned from [InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B).
|
23 |
|
24 |
+
### OS-Genesis AC Family Models
|
25 |
+
In the following table, we provide an overview of the OS-Genesis AC Family Models used for evaluating the AndroidControl Benchmark.
|
26 |
|
27 |
+
| Model Name | Base Model | Training Data | HF Link |
|
28 |
+
| :-------------: | :-------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------: | :---------------------------------------------------------: |
|
29 |
+
| OS-Genesis-4B-AC | [InternVL2-4B](https://huggingface.co/OpenGVLab/InternVL2-4B) | [OS-Genesis-mobile-data](https://huggingface.co/datasets/OS-Copilot/OS-Genesis-mobile-data) | [🤗 link](https://huggingface.co/OS-Copilot/OS-Genesis-4B-AC) |
|
30 |
+
| OS-Genesis-7B-AC | [Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct) | [OS-Genesis-mobile-data](https://huggingface.co/datasets/OS-Copilot/OS-Genesis-mobile-data) | [🤗 link](https://huggingface.co/OS-Copilot/OS-Genesis-7B-AC) |
|
31 |
+
| OS-Genesis-8B-AC | [InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B) | [OS-Genesis-mobile-data](https://huggingface.co/datasets/OS-Copilot/OS-Genesis-mobile-data) | [🤗 link](https://huggingface.co/OS-Copilot/OS-Genesis-8B-AC) |
|
32 |
|
33 |
|
34 |
### Inference Example
|
35 |
First, install the `transformers` library:
|
36 |
+
|
37 |
```
|
38 |
pip install transformers
|
39 |
```
|
|
|
40 |
|
41 |
+
For additional dependencies, please refer to the [InternVL2 documentation](https://internvl.readthedocs.io/en/latest/get_started/installation.html).
|
42 |
+
|
43 |
+
For evaluating the AndroidControl Benchmark, please refer to the [**evaluation code**](https://github.com/OS-Copilot/OS-Genesis/tree/main/evaluation/android_control).
|
44 |
|
45 |
Inference code example:
|
46 |
```python
|