Update README.md
Browse files
README.md
CHANGED
@@ -5,19 +5,21 @@ pipeline_tag: robotics
|
|
5 |
---
|
6 |
|
7 |
# π RoboRefer
|
|
|
|
|
|
|
|
|
8 |
> This is the official checkpoint of our work: **RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics**
|
9 |
|
10 |
-
#### Paper: https://arxiv.org/pdf/2506.04308
|
11 |
-
#### Code: https://github.com/Zhoues/RoboRefer
|
12 |
-
#### Website: https://zhoues.github.io/RoboRefer/
|
13 |
|
|
|
|
|
|
|
|
|
14 |
|
15 |
## Date
|
16 |
This model was trained in June 2025.
|
17 |
|
18 |
-
## How to use
|
19 |
-
|
20 |
-
This is the RoboRefer SFT trained on a mixture of RefSpatial, instruction tuning, and referring datasets. For more details, please visit our [official repo](https://github.com/Zhoues/RoboRefer).
|
21 |
|
22 |
## π Citation
|
23 |
If you find our code or models useful in your work, please cite [our paper](https://arxiv.org/pdf/2505.06111):
|
|
|
5 |
---
|
6 |
|
7 |
# π RoboRefer
|
8 |
+
|
9 |
+
[](https://zhoues.github.io/RoboRefer/)
|
10 |
+
[](https://arxiv.org/abs/2506.04308)
|
11 |
+
[](https://github.com/Zhoues/RoboRefer)
|
12 |
> This is the official checkpoint of our work: **RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics**
|
13 |
|
|
|
|
|
|
|
14 |
|
15 |
+
## Overview
|
16 |
+
RoboRefer-2B-SFT is an open-source vision-language model that is instruction-tuned on a mixture of RefSpatial datasets, instruction tuning, and referring datasets.
|
17 |
+
|
18 |
+
RoboRefer-2B-SFT has strong spatial understanding capability and achieves state-of-the-art performance across diverse benchmarks. Given an image with language instructions, it can not only answer your questions in both qualitative and quantitative ways using its spatial knowledge, but also output precise points for spatial referring to guide robotic control. For more details, please visit our [official repo](https://github.com/Zhoues/RoboRefer).
|
19 |
|
20 |
## Date
|
21 |
This model was trained in June 2025.
|
22 |
|
|
|
|
|
|
|
23 |
|
24 |
## π Citation
|
25 |
If you find our code or models useful in your work, please cite [our paper](https://arxiv.org/pdf/2505.06111):
|