Hugging Face's logo

openvla
/
openvla-7b

Image-Text-to-Text
Transformers
Safetensors
English
openvla
image-to-text
robotics
vla
multimodal
pretraining
custom_code
Model card Files
xet
Community
7
skaramcheti commited on
Commit
43a4a81
·
verified ·
1 Parent(s): 8f441e0

Upload config

Browse files
Files changed (3) hide show
  1. README.md +199 -0
  2. config.json +3167 -0
  3. configuration_prismatic.py +140 -0
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags: []
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
config.json ADDED
@@ -0,0 +1,3167 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "arch_specifier": "no-align+fused-gelu-mlp",
3
+ "architectures": [
4
+ "OpenVLAForActionPrediction"
5
+ ],
6
+ "auto_map": {
7
+ "AutoConfig": "configuration_prismatic.OpenVLAConfig"
8
+ },
9
+ "hf_llm_id": "meta-llama/Llama-2-7b-hf",
10
+ "image_resize_strategy": "resize-naive",
11
+ "image_sizes": [
12
+ 224,
13
+ 224
14
+ ],
15
+ "llm_backbone_id": "llama2-7b-pure",
16
+ "llm_max_length": 2048,
17
+ "model_type": "openvla",
18
+ "n_action_bins": 256,
19
+ "norm_stats": {
20
+ "austin_buds_dataset_converted_externally_to_rlds": {
21
+ "action": {
22
+ "mask": [
23
+ true,
24
+ true,
25
+ true,
26
+ true,
27
+ true,
28
+ true,
29
+ false
30
+ ],
31
+ "max": [
32
+ 1.0,
33
+ 1.0,
34
+ 1.0,
35
+ 0.0,
36
+ 0.0,
37
+ 0.0,
38
+ 1.0
39
+ ],
40
+ "mean": [
41
+ -0.07678354531526566,
42
+ 0.0036849044263362885,
43
+ 0.05644911900162697,
44
+ 0.0,
45
+ 0.0,
46
+ 0.0,
47
+ 0.3510494828224182
48
+ ],
49
+ "min": [
50
+ -1.0,
51
+ -1.0,
52
+ -1.0,
53
+ 0.0,
54
+ 0.0,
55
+ 0.0,
56
+ 0.0
57
+ ],
58
+ "q01": [
59
+ -1.0,
60
+ -0.9599999785423279,
61
+ -0.8714285492897034,
62
+ 0.0,
63
+ 0.0,
64
+ 0.0,
65
+ 0.0
66
+ ],
67
+ "q99": [
68
+ 1.0,
69
+ 0.8600000143051147,
70
+ 1.0,
71
+ 0.0,
72
+ 0.0,
73
+ 0.0,
74
+ 1.0
75
+ ],
76
+ "std": [
77
+ 0.6367740631103516,
78
+ 0.37889179587364197,
79
+ 0.47796326875686646,
80
+ 0.0,
81
+ 0.0,
82
+ 0.0,
83
+ 0.47721168398857117
84
+ ]
85
+ },
86
+ "num_trajectories": 50,
87
+ "num_transitions": 34112,
88
+ "proprio": {
89
+ "max": [
90
+ 0.0,
91
+ 0.0,
92
+ 0.0,
93
+ 0.0,
94
+ 0.0,
95
+ 0.0,
96
+ 0.0
97
+ ],
98
+ "mean": [
99
+ 0.0,
100
+ 0.0,
101
+ 0.0,
102
+ 0.0,
103
+ 0.0,
104
+ 0.0,
105
+ 0.0
106
+ ],
107
+ "min": [
108
+ 0.0,
109
+ 0.0,
110
+ 0.0,
111
+ 0.0,
112
+ 0.0,
113
+ 0.0,
114
+ 0.0
115
+ ],
116
+ "q01": [
117
+ 0.0,
118
+ 0.0,
119
+ 0.0,
120
+ 0.0,
121
+ 0.0,
122
+ 0.0,
123
+ 0.0
124
+ ],
125
+ "q99": [
126
+ 0.0,
127
+ 0.0,
128
+ 0.0,
129
+ 0.0,
130
+ 0.0,
131
+ 0.0,
132
+ 0.0
133
+ ],
134
+ "std": [
135
+ 0.0,
136
+ 0.0,
137
+ 0.0,
138
+ 0.0,
139
+ 0.0,
140
+ 0.0,
141
+ 0.0
142
+ ]
143
+ }
144
+ },
145
+ "austin_sailor_dataset_converted_externally_to_rlds": {
146
+ "action": {
147
+ "mask": [
148
+ true,
149
+ true,
150
+ true,
151
+ true,
152
+ true,
153
+ true,
154
+ false
155
+ ],
156
+ "max": [
157
+ 1.0,
158
+ 1.0,
159
+ 1.0,
160
+ 0.0,
161
+ 0.0,
162
+ 0.375,
163
+ 1.0
164
+ ],
165
+ "mean": [
166
+ 0.011825348250567913,
167
+ 0.006461074110120535,
168
+ 0.06023626774549484,
169
+ 0.0,
170
+ 0.0,
171
+ 0.0016465914668515325,
172
+ 0.5260950326919556
173
+ ],
174
+ "min": [
175
+ -1.0,
176
+ -1.0,
177
+ -1.0,
178
+ 0.0,
179
+ 0.0,
180
+ -0.375,
181
+ 0.0
182
+ ],
183
+ "q01": [
184
+ -1.0,
185
+ -0.9828571677207947,
186
+ -0.6000000238418579,
187
+ 0.0,
188
+ 0.0,
189
+ -0.17249999940395355,
190
+ 0.0
191
+ ],
192
+ "q99": [
193
+ 1.0,
194
+ 0.9457142949104309,
195
+ 1.0,
196
+ 0.0,
197
+ 0.0,
198
+ 0.17892856895923615,
199
+ 1.0
200
+ ],
201
+ "std": [
202
+ 0.46348899602890015,
203
+ 0.41240179538726807,
204
+ 0.411862850189209,
205
+ 0.0,
206
+ 0.0,
207
+ 0.0578610822558403,
208
+ 0.49894046783447266
209
+ ]
210
+ },
211
+ "num_trajectories": 240,
212
+ "num_transitions": 353094,
213
+ "proprio": {
214
+ "max": [
215
+ 0.0,
216
+ 0.0,
217
+ 0.0,
218
+ 0.0,
219
+ 0.0,
220
+ 0.0,
221
+ 0.0
222
+ ],
223
+ "mean": [
224
+ 0.0,
225
+ 0.0,
226
+ 0.0,
227
+ 0.0,
228
+ 0.0,
229
+ 0.0,
230
+ 0.0
231
+ ],
232
+ "min": [
233
+ 0.0,
234
+ 0.0,
235
+ 0.0,
236
+ 0.0,
237
+ 0.0,
238
+ 0.0,
239
+ 0.0
240
+ ],
241
+ "q01": [
242
+ 0.0,
243
+ 0.0,
244
+ 0.0,
245
+ 0.0,
246
+ 0.0,
247
+ 0.0,
248
+ 0.0
249
+ ],
250
+ "q99": [
251
+ 0.0,
252
+ 0.0,
253
+ 0.0,
254
+ 0.0,
255
+ 0.0,
256
+ 0.0,
257
+ 0.0
258
+ ],
259
+ "std": [
260
+ 0.0,
261
+ 0.0,
262
+ 0.0,
263
+ 0.0,
264
+ 0.0,
265
+ 0.0,
266
+ 0.0
267
+ ]
268
+ }
269
+ },
270
+ "austin_sirius_dataset_converted_externally_to_rlds": {
271
+ "action": {
272
+ "mask": [
273
+ true,
274
+ true,
275
+ true,
276
+ true,
277
+ true,
278
+ true,
279
+ false
280
+ ],
281
+ "max": [
282
+ 1.0002285242080688,
283
+ 0.960608720779419,
284
+ 1.105179786682129,
285
+ 0.0,
286
+ 0.0,
287
+ 0.341785728931427,
288
+ 1.0
289
+ ],
290
+ "mean": [
291
+ 0.07747682929039001,
292
+ 0.03195561468601227,
293
+ 0.04244732856750488,
294
+ 0.0,
295
+ 0.0,
296
+ -0.01603456400334835,
297
+ 0.43260177969932556
298
+ ],
299
+ "min": [
300
+ -1.0183025598526,
301
+ -0.9800000190734863,
302
+ -0.9774575233459473,
303
+ 0.0,
304
+ 0.0,
305
+ -0.34607142210006714,
306
+ 0.0
307
+ ],
308
+ "q01": [
309
+ -0.780905865430832,
310
+ -0.5667179036140442,
311
+ -0.5254343223571777,
312
+ 0.0,
313
+ 0.0,
314
+ -0.28495091378688814,
315
+ 0.0
316
+ ],
317
+ "q99": [
318
+ 0.9569637751579284,
319
+ 0.6971374487876891,
320
+ 0.8124888157844541,
321
+ 0.0,
322
+ 0.0,
323
+ 0.1971428543329239,
324
+ 1.0
325
+ ],
326
+ "std": [
327
+ 0.3906329572200775,
328
+ 0.2998155355453491,
329
+ 0.2782271206378937,
330
+ 0.0,
331
+ 0.0,
332
+ 0.08120622485876083,
333
+ 0.49528297781944275
334
+ ]
335
+ },
336
+ "num_trajectories": 559,
337
+ "num_transitions": 279939,
338
+ "proprio": {
339
+ "max": [
340
+ 0.0,
341
+ 0.0,
342
+ 0.0,
343
+ 0.0,
344
+ 0.0,
345
+ 0.0,
346
+ 0.0
347
+ ],
348
+ "mean": [
349
+ 0.0,
350
+ 0.0,
351
+ 0.0,
352
+ 0.0,
353
+ 0.0,
354
+ 0.0,
355
+ 0.0
356
+ ],
357
+ "min": [
358
+ 0.0,
359
+ 0.0,
360
+ 0.0,
361
+ 0.0,
362
+ 0.0,
363
+ 0.0,
364
+ 0.0
365
+ ],
366
+ "q01": [
367
+ 0.0,
368
+ 0.0,
369
+ 0.0,
370
+ 0.0,
371
+ 0.0,
372
+ 0.0,
373
+ 0.0
374
+ ],
375
+ "q99": [
376
+ 0.0,
377
+ 0.0,
378
+ 0.0,
379
+ 0.0,
380
+ 0.0,
381
+ 0.0,
382
+ 0.0
383
+ ],
384
+ "std": [
385
+ 0.0,
386
+ 0.0,
387
+ 0.0,
388
+ 0.0,
389
+ 0.0,
390
+ 0.0,
391
+ 0.0
392
+ ]
393
+ }
394
+ },
395
+ "bc_z": {
396
+ "action": {
397
+ "mask": [
398
+ true,
399
+ true,
400
+ true,
401
+ true,
402
+ true,
403
+ true,
404
+ false
405
+ ],
406
+ "max": [
407
+ 0.2165454924106598,
408
+ 0.1251407265663147,
409
+ 0.10772687941789627,
410
+ 0.33544227480888367,
411
+ 0.28117990493774414,
412
+ 0.40614867210388184,
413
+ 1.0
414
+ ],
415
+ "mean": [
416
+ -0.009958467446267605,
417
+ 0.0008958321413956583,
418
+ 0.004995597992092371,
419
+ 0.00029755113064311445,
420
+ -0.008735382929444313,
421
+ -0.030693737789988518,
422
+ 0.8344562649726868
423
+ ],
424
+ "min": [
425
+ -0.1677047461271286,
426
+ -0.14630407094955444,
427
+ -0.10066790133714676,
428
+ -0.29421567916870117,
429
+ -0.32101404666900635,
430
+ -0.4635624885559082,
431
+ 0.0
432
+ ],
433
+ "q01": [
434
+ -0.09220654994249344,
435
+ -0.06456145539879798,
436
+ -0.049121275544166565,
437
+ -0.11594625547528267,
438
+ -0.14152548640966414,
439
+ -0.2251061636209488,
440
+ 0.0
441
+ ],
442
+ "q99": [
443
+ 0.07628866866230968,
444
+ 0.058019736707210584,
445
+ 0.052540797740221024,
446
+ 0.11740604028105736,
447
+ 0.11703975558280955,
448
+ 0.16729306846857078,
449
+ 1.0
450
+ ],
451
+ "std": [
452
+ 0.03053455986082554,
453
+ 0.0231423731893301,
454
+ 0.020641816779971123,
455
+ 0.04155943542718887,
456
+ 0.046427831053733826,
457
+ 0.0769818127155304,
458
+ 0.3610210120677948
459
+ ]
460
+ },
461
+ "num_trajectories": 43264,
462
+ "num_transitions": 6015535,
463
+ "proprio": {
464
+ "max": [
465
+ 0.0,
466
+ 0.0,
467
+ 0.0,
468
+ 0.0,
469
+ 0.0,
470
+ 0.0,
471
+ 0.0
472
+ ],
473
+ "mean": [
474
+ 0.0,
475
+ 0.0,
476
+ 0.0,
477
+ 0.0,
478
+ 0.0,
479
+ 0.0,
480
+ 0.0
481
+ ],
482
+ "min": [
483
+ 0.0,
484
+ 0.0,
485
+ 0.0,
486
+ 0.0,
487
+ 0.0,
488
+ 0.0,
489
+ 0.0
490
+ ],
491
+ "q01": [
492
+ 0.0,
493
+ 0.0,
494
+ 0.0,
495
+ 0.0,
496
+ 0.0,
497
+ 0.0,
498
+ 0.0
499
+ ],
500
+ "q99": [
501
+ 0.0,
502
+ 0.0,
503
+ 0.0,
504
+ 0.0,
505
+ 0.0,
506
+ 0.0,
507
+ 0.0
508
+ ],
509
+ "std": [
510
+ 0.0,
511
+ 0.0,
512
+ 0.0,
513
+ 0.0,
514
+ 0.0,
515
+ 0.0,
516
+ 0.0
517
+ ]
518
+ }
519
+ },
520
+ "berkeley_autolab_ur5": {
521
+ "action": {
522
+ "mask": [
523
+ true,
524
+ true,
525
+ true,
526
+ true,
527
+ true,
528
+ true,
529
+ false
530
+ ],
531
+ "max": [
532
+ 0.019999999552965164,
533
+ 0.019999999552965164,
534
+ 0.019999999552965164,
535
+ 0.06666667014360428,
536
+ 0.06666667014360428,
537
+ 0.06666667014360428,
538
+ 1.0
539
+ ],
540
+ "mean": [
541
+ 0.0005683620693162084,
542
+ 0.001217700308188796,
543
+ -0.0005296372692100704,
544
+ 0.00021029810886830091,
545
+ 6.0695128922816366e-05,
546
+ 0.001204986940138042,
547
+ 0.6298308372497559
548
+ ],
549
+ "min": [
550
+ -0.019999999552965164,
551
+ -0.019999999552965164,
552
+ -0.019999999552965164,
553
+ -0.06666667014360428,
554
+ -0.06666667014360428,
555
+ -0.06666667014360428,
556
+ 0.0
557
+ ],
558
+ "q01": [
559
+ -0.019999999552965164,
560
+ -0.019999999552965164,
561
+ -0.019999999552965164,
562
+ -0.02628571353852749,
563
+ -0.06666667014360428,
564
+ -0.03847619146108627,
565
+ 0.0
566
+ ],
567
+ "q99": [
568
+ 0.019999999552965164,
569
+ 0.019999999552965164,
570
+ 0.019999999552965164,
571
+ 0.031809523701667786,
572
+ 0.06666667014360428,
573
+ 0.036571428179740906,
574
+ 1.0
575
+ ],
576
+ "std": [
577
+ 0.0115329809486866,
578
+ 0.007990492507815361,
579
+ 0.009577835910022259,
580
+ 0.009432995691895485,
581
+ 0.016427582129836082,
582
+ 0.011053967289626598,
583
+ 0.48267969489097595
584
+ ]
585
+ },
586
+ "num_trajectories": 1000,
587
+ "num_transitions": 97939,
588
+ "proprio": {
589
+ "max": [
590
+ 0.0,
591
+ 0.0,
592
+ 0.0,
593
+ 0.0,
594
+ 0.0,
595
+ 0.0,
596
+ 0.0
597
+ ],
598
+ "mean": [
599
+ 0.0,
600
+ 0.0,
601
+ 0.0,
602
+ 0.0,
603
+ 0.0,
604
+ 0.0,
605
+ 0.0
606
+ ],
607
+ "min": [
608
+ 0.0,
609
+ 0.0,
610
+ 0.0,
611
+ 0.0,
612
+ 0.0,
613
+ 0.0,
614
+ 0.0
615
+ ],
616
+ "q01": [
617
+ 0.0,
618
+ 0.0,
619
+ 0.0,
620
+ 0.0,
621
+ 0.0,
622
+ 0.0,
623
+ 0.0
624
+ ],
625
+ "q99": [
626
+ 0.0,
627
+ 0.0,
628
+ 0.0,
629
+ 0.0,
630
+ 0.0,
631
+ 0.0,
632
+ 0.0
633
+ ],
634
+ "std": [
635
+ 0.0,
636
+ 0.0,
637
+ 0.0,
638
+ 0.0,
639
+ 0.0,
640
+ 0.0,
641
+ 0.0
642
+ ]
643
+ }
644
+ },
645
+ "berkeley_cable_routing": {
646
+ "action": {
647
+ "mask": [
648
+ true,
649
+ true,
650
+ true,
651
+ true,
652
+ true,
653
+ true,
654
+ false
655
+ ],
656
+ "max": [
657
+ 0.9633283019065857,
658
+ 1.0,
659
+ 1.0,
660
+ 0.0,
661
+ 0.0,
662
+ 1.0,
663
+ 0.0
664
+ ],
665
+ "mean": [
666
+ -0.07139874249696732,
667
+ 0.023609008640050888,
668
+ 0.10241943597793579,
669
+ 0.0,
670
+ 0.0,
671
+ 0.049671024084091187,
672
+ 0.0
673
+ ],
674
+ "min": [
675
+ -0.9809081554412842,
676
+ -0.9554349184036255,
677
+ -0.9994775056838989,
678
+ 0.0,
679
+ 0.0,
680
+ -1.0,
681
+ 0.0
682
+ ],
683
+ "q01": [
684
+ -0.5534318816661835,
685
+ -0.4797285574674606,
686
+ -0.5314934802055359,
687
+ 0.0,
688
+ 0.0,
689
+ -0.8855219376087189,
690
+ 0.0
691
+ ],
692
+ "q99": [
693
+ 0.42652835428714786,
694
+ 0.5000944086909298,
695
+ 0.639823433756829,
696
+ 0.0,
697
+ 0.0,
698
+ 0.984243879914284,
699
+ 0.0
700
+ ],
701
+ "std": [
702
+ 0.1815500408411026,
703
+ 0.1810990273952484,
704
+ 0.21220779418945312,
705
+ 0.0,
706
+ 0.0,
707
+ 0.3475511968135834,
708
+ 0.0
709
+ ]
710
+ },
711
+ "num_trajectories": 1647,
712
+ "num_transitions": 42328,
713
+ "proprio": {
714
+ "max": [
715
+ 0.0,
716
+ 0.0,
717
+ 0.0,
718
+ 0.0,
719
+ 0.0,
720
+ 0.0,
721
+ 0.0
722
+ ],
723
+ "mean": [
724
+ 0.0,
725
+ 0.0,
726
+ 0.0,
727
+ 0.0,
728
+ 0.0,
729
+ 0.0,
730
+ 0.0
731
+ ],
732
+ "min": [
733
+ 0.0,
734
+ 0.0,
735
+ 0.0,
736
+ 0.0,
737
+ 0.0,
738
+ 0.0,
739
+ 0.0
740
+ ],
741
+ "q01": [
742
+ 0.0,
743
+ 0.0,
744
+ 0.0,
745
+ 0.0,
746
+ 0.0,
747
+ 0.0,
748
+ 0.0
749
+ ],
750
+ "q99": [
751
+ 0.0,
752
+ 0.0,
753
+ 0.0,
754
+ 0.0,
755
+ 0.0,
756
+ 0.0,
757
+ 0.0
758
+ ],
759
+ "std": [
760
+ 0.0,
761
+ 0.0,
762
+ 0.0,
763
+ 0.0,
764
+ 0.0,
765
+ 0.0,
766
+ 0.0
767
+ ]
768
+ }
769
+ },
770
+ "berkeley_fanuc_manipulation": {
771
+ "action": {
772
+ "mask": [
773
+ true,
774
+ true,
775
+ true,
776
+ true,
777
+ true,
778
+ true,
779
+ false
780
+ ],
781
+ "max": [
782
+ 0.009999999776482582,
783
+ 0.009999999776482582,
784
+ 0.009999999776482582,
785
+ 0.03490658476948738,
786
+ 0.03490658476948738,
787
+ 0.03490658476948738,
788
+ 1.0
789
+ ],
790
+ "mean": [
791
+ 0.0007744057802483439,
792
+ -0.00031240080716088414,
793
+ -0.0015001941937953234,
794
+ -0.0007515158504247665,
795
+ -0.00015832878125365824,
796
+ 0.00014327642566058785,
797
+ 0.699295699596405
798
+ ],
799
+ "min": [
800
+ -0.009999999776482582,
801
+ -0.009999999776482582,
802
+ -0.009999999776482582,
803
+ -0.03490658476948738,
804
+ -0.03490658476948738,
805
+ -0.03490658476948738,
806
+ 0.0
807
+ ],
808
+ "q01": [
809
+ -0.009999999776482582,
810
+ -0.009999999776482582,
811
+ -0.009999999776482582,
812
+ -0.03490658476948738,
813
+ 0.0,
814
+ -0.03490658476948738,
815
+ 0.0
816
+ ],
817
+ "q99": [
818
+ 0.009999999776482582,
819
+ 0.009999999776482582,
820
+ 0.009999999776482582,
821
+ 0.03490658476948738,
822
+ 0.0,
823
+ 0.03490658476948738,
824
+ 1.0
825
+ ],
826
+ "std": [
827
+ 0.0034070091787725687,
828
+ 0.0049921851605176926,
829
+ 0.005344334989786148,
830
+ 0.00759894959628582,
831
+ 0.004081866703927517,
832
+ 0.008568956516683102,
833
+ 0.4586937427520752
834
+ ]
835
+ },
836
+ "num_trajectories": 415,
837
+ "num_transitions": 62613,
838
+ "proprio": {
839
+ "max": [
840
+ 0.0,
841
+ 0.0,
842
+ 0.0,
843
+ 0.0,
844
+ 0.0,
845
+ 0.0,
846
+ 0.0
847
+ ],
848
+ "mean": [
849
+ 0.0,
850
+ 0.0,
851
+ 0.0,
852
+ 0.0,
853
+ 0.0,
854
+ 0.0,
855
+ 0.0
856
+ ],
857
+ "min": [
858
+ 0.0,
859
+ 0.0,
860
+ 0.0,
861
+ 0.0,
862
+ 0.0,
863
+ 0.0,
864
+ 0.0
865
+ ],
866
+ "q01": [
867
+ 0.0,
868
+ 0.0,
869
+ 0.0,
870
+ 0.0,
871
+ 0.0,
872
+ 0.0,
873
+ 0.0
874
+ ],
875
+ "q99": [
876
+ 0.0,
877
+ 0.0,
878
+ 0.0,
879
+ 0.0,
880
+ 0.0,
881
+ 0.0,
882
+ 0.0
883
+ ],
884
+ "std": [
885
+ 0.0,
886
+ 0.0,
887
+ 0.0,
888
+ 0.0,
889
+ 0.0,
890
+ 0.0,
891
+ 0.0
892
+ ]
893
+ }
894
+ },
895
+ "bridge_orig": {
896
+ "action": {
897
+ "mask": [
898
+ true,
899
+ true,
900
+ true,
901
+ true,
902
+ true,
903
+ true,
904
+ false
905
+ ],
906
+ "max": [
907
+ 0.41691166162490845,
908
+ 0.25864794850349426,
909
+ 0.21218234300613403,
910
+ 3.122201919555664,
911
+ 1.8618112802505493,
912
+ 6.280478477478027,
913
+ 1.0
914
+ ],
915
+ "mean": [
916
+ 0.0002334194869035855,
917
+ 0.00013004911306779832,
918
+ -0.00012762474943883717,
919
+ -0.0001556558854645118,
920
+ -0.0004039328487124294,
921
+ 0.00023557482927571982,
922
+ 0.5764579176902771
923
+ ],
924
+ "min": [
925
+ -0.4007510244846344,
926
+ -0.13874775171279907,
927
+ -0.22553899884223938,
928
+ -3.2010786533355713,
929
+ -1.8618112802505493,
930
+ -6.279075622558594,
931
+ 0.0
932
+ ],
933
+ "q01": [
934
+ -0.02872725307941437,
935
+ -0.04170349963009357,
936
+ -0.026093858778476715,
937
+ -0.08092105075716972,
938
+ -0.09288699507713317,
939
+ -0.20718276381492615,
940
+ 0.0
941
+ ],
942
+ "q99": [
943
+ 0.028309678435325586,
944
+ 0.040855254605412394,
945
+ 0.040161586627364146,
946
+ 0.08192047759890528,
947
+ 0.07792850524187081,
948
+ 0.20382574498653397,
949
+ 1.0
950
+ ],
951
+ "std": [
952
+ 0.009765930473804474,
953
+ 0.013689135201275349,
954
+ 0.012667362578213215,
955
+ 0.028534092009067535,
956
+ 0.030637972056865692,
957
+ 0.07691419124603271,
958
+ 0.4973701536655426
959
+ ]
960
+ },
961
+ "num_trajectories": 60064,
962
+ "num_transitions": 2135463,
963
+ "proprio": {
964
+ "max": [
965
+ 0.0,
966
+ 0.0,
967
+ 0.0,
968
+ 0.0,
969
+ 0.0,
970
+ 0.0,
971
+ 0.0
972
+ ],
973
+ "mean": [
974
+ 0.0,
975
+ 0.0,
976
+ 0.0,
977
+ 0.0,
978
+ 0.0,
979
+ 0.0,
980
+ 0.0
981
+ ],
982
+ "min": [
983
+ 0.0,
984
+ 0.0,
985
+ 0.0,
986
+ 0.0,
987
+ 0.0,
988
+ 0.0,
989
+ 0.0
990
+ ],
991
+ "q01": [
992
+ 0.0,
993
+ 0.0,
994
+ 0.0,
995
+ 0.0,
996
+ 0.0,
997
+ 0.0,
998
+ 0.0
999
+ ],
1000
+ "q99": [
1001
+ 0.0,
1002
+ 0.0,
1003
+ 0.0,
1004
+ 0.0,
1005
+ 0.0,
1006
+ 0.0,
1007
+ 0.0
1008
+ ],
1009
+ "std": [
1010
+ 0.0,
1011
+ 0.0,
1012
+ 0.0,
1013
+ 0.0,
1014
+ 0.0,
1015
+ 0.0,
1016
+ 0.0
1017
+ ]
1018
+ }
1019
+ },
1020
+ "cmu_stretch": {
1021
+ "action": {
1022
+ "mask": [
1023
+ true,
1024
+ true,
1025
+ true,
1026
+ true,
1027
+ true,
1028
+ true,
1029
+ false
1030
+ ],
1031
+ "max": [
1032
+ 0.02338407188653946,
1033
+ 0.0,
1034
+ 0.023404927924275398,
1035
+ 0.0,
1036
+ 0.0,
1037
+ 0.0,
1038
+ 1.0
1039
+ ],
1040
+ "mean": [
1041
+ 0.00036304505192674696,
1042
+ 0.0,
1043
+ 0.0016466958913952112,
1044
+ 0.0,
1045
+ 0.0,
1046
+ 0.0,
1047
+ 0.3987048268318176
1048
+ ],
1049
+ "min": [
1050
+ -0.019353797659277916,
1051
+ 0.0,
1052
+ -0.02019215188920498,
1053
+ 0.0,
1054
+ 0.0,
1055
+ 0.0,
1056
+ 0.0
1057
+ ],
1058
+ "q01": [
1059
+ -0.011175686959177256,
1060
+ 0.0,
1061
+ -0.0032206363626755773,
1062
+ 0.0,
1063
+ 0.0,
1064
+ 0.0,
1065
+ 0.0
1066
+ ],
1067
+ "q99": [
1068
+ 0.014501785952597848,
1069
+ 0.0,
1070
+ 0.015056106168776728,
1071
+ 0.0,
1072
+ 0.0,
1073
+ 0.0,
1074
+ 1.0
1075
+ ],
1076
+ "std": [
1077
+ 0.004081828519701958,
1078
+ 0.0,
1079
+ 0.0037743328139185905,
1080
+ 0.0,
1081
+ 0.0,
1082
+ 0.0,
1083
+ 0.48963725566864014
1084
+ ]
1085
+ },
1086
+ "num_trajectories": 135,
1087
+ "num_transitions": 25016,
1088
+ "proprio": {
1089
+ "max": [
1090
+ 0.0,
1091
+ 0.0,
1092
+ 0.0,
1093
+ 0.0,
1094
+ 0.0,
1095
+ 0.0,
1096
+ 0.0
1097
+ ],
1098
+ "mean": [
1099
+ 0.0,
1100
+ 0.0,
1101
+ 0.0,
1102
+ 0.0,
1103
+ 0.0,
1104
+ 0.0,
1105
+ 0.0
1106
+ ],
1107
+ "min": [
1108
+ 0.0,
1109
+ 0.0,
1110
+ 0.0,
1111
+ 0.0,
1112
+ 0.0,
1113
+ 0.0,
1114
+ 0.0
1115
+ ],
1116
+ "q01": [
1117
+ 0.0,
1118
+ 0.0,
1119
+ 0.0,
1120
+ 0.0,
1121
+ 0.0,
1122
+ 0.0,
1123
+ 0.0
1124
+ ],
1125
+ "q99": [
1126
+ 0.0,
1127
+ 0.0,
1128
+ 0.0,
1129
+ 0.0,
1130
+ 0.0,
1131
+ 0.0,
1132
+ 0.0
1133
+ ],
1134
+ "std": [
1135
+ 0.0,
1136
+ 0.0,
1137
+ 0.0,
1138
+ 0.0,
1139
+ 0.0,
1140
+ 0.0,
1141
+ 0.0
1142
+ ]
1143
+ }
1144
+ },
1145
+ "dlr_edan_shared_control_converted_externally_to_rlds": {
1146
+ "action": {
1147
+ "mask": [
1148
+ true,
1149
+ true,
1150
+ true,
1151
+ true,
1152
+ true,
1153
+ true,
1154
+ false
1155
+ ],
1156
+ "max": [
1157
+ 0.18991442024707794,
1158
+ 0.0739002525806427,
1159
+ 0.18064819276332855,
1160
+ 0.0866486132144928,
1161
+ 0.13464981317520142,
1162
+ 0.16910280287265778,
1163
+ 1.0
1164
+ ],
1165
+ "mean": [
1166
+ 0.006647810339927673,
1167
+ -0.0007657372043468058,
1168
+ 0.006522852927446365,
1169
+ 0.0011679717572405934,
1170
+ -0.006395625416189432,
1171
+ -0.011902998201549053,
1172
+ 0.6985887289047241
1173
+ ],
1174
+ "min": [
1175
+ -0.10054297000169754,
1176
+ -0.08427435159683228,
1177
+ -0.13533438742160797,
1178
+ -0.17556548118591309,
1179
+ -0.18485672771930695,
1180
+ -0.2680685818195343,
1181
+ 0.0
1182
+ ],
1183
+ "q01": [
1184
+ -0.02987122368067503,
1185
+ -0.06013262912631035,
1186
+ -0.08286409199237824,
1187
+ -0.05924444157630205,
1188
+ -0.15986866518855095,
1189
+ -0.15636983573436739,
1190
+ 0.0
1191
+ ],
1192
+ "q99": [
1193
+ 0.08832092039287087,
1194
+ 0.042126184627413736,
1195
+ 0.11311905644834042,
1196
+ 0.0643695573508739,
1197
+ 0.03941855944693088,
1198
+ 0.156646853685379,
1199
+ 1.0
1200
+ ],
1201
+ "std": [
1202
+ 0.021393608301877975,
1203
+ 0.01814231649041176,
1204
+ 0.03374375030398369,
1205
+ 0.01743541844189167,
1206
+ 0.03394376486539841,
1207
+ 0.04641875624656677,
1208
+ 0.4588589072227478
1209
+ ]
1210
+ },
1211
+ "num_trajectories": 104,
1212
+ "num_transitions": 8928,
1213
+ "proprio": {
1214
+ "max": [
1215
+ 0.0,
1216
+ 0.0,
1217
+ 0.0,
1218
+ 0.0,
1219
+ 0.0,
1220
+ 0.0,
1221
+ 0.0
1222
+ ],
1223
+ "mean": [
1224
+ 0.0,
1225
+ 0.0,
1226
+ 0.0,
1227
+ 0.0,
1228
+ 0.0,
1229
+ 0.0,
1230
+ 0.0
1231
+ ],
1232
+ "min": [
1233
+ 0.0,
1234
+ 0.0,
1235
+ 0.0,
1236
+ 0.0,
1237
+ 0.0,
1238
+ 0.0,
1239
+ 0.0
1240
+ ],
1241
+ "q01": [
1242
+ 0.0,
1243
+ 0.0,
1244
+ 0.0,
1245
+ 0.0,
1246
+ 0.0,
1247
+ 0.0,
1248
+ 0.0
1249
+ ],
1250
+ "q99": [
1251
+ 0.0,
1252
+ 0.0,
1253
+ 0.0,
1254
+ 0.0,
1255
+ 0.0,
1256
+ 0.0,
1257
+ 0.0
1258
+ ],
1259
+ "std": [
1260
+ 0.0,
1261
+ 0.0,
1262
+ 0.0,
1263
+ 0.0,
1264
+ 0.0,
1265
+ 0.0,
1266
+ 0.0
1267
+ ]
1268
+ }
1269
+ },
1270
+ "dobbe": {
1271
+ "action": {
1272
+ "mask": [
1273
+ true,
1274
+ true,
1275
+ true,
1276
+ true,
1277
+ true,
1278
+ true,
1279
+ false
1280
+ ],
1281
+ "max": [
1282
+ 38.590423583984375,
1283
+ 17.932697296142578,
1284
+ 4.843764305114746,
1285
+ 1.4372116327285767,
1286
+ 0.4340403974056244,
1287
+ 1.2057193517684937,
1288
+ 0.9998947381973267
1289
+ ],
1290
+ "mean": [
1291
+ -0.0001120665911003016,
1292
+ 0.0011229600058868527,
1293
+ -0.00010194431524723768,
1294
+ -7.371398532995954e-05,
1295
+ -0.00067531579406932,
1296
+ -5.6643435527803376e-05,
1297
+ 0.6318281888961792
1298
+ ],
1299
+ "min": [
1300
+ -5.700923442840576,
1301
+ -21.605947494506836,
1302
+ -123.72489929199219,
1303
+ -1.7229845523834229,
1304
+ -0.4998578727245331,
1305
+ -0.8867913484573364,
1306
+ 1.4196479014572105e-06
1307
+ ],
1308
+ "q01": [
1309
+ -0.01119564864784479,
1310
+ -0.014266146533191203,
1311
+ -0.0071747214533388615,
1312
+ -0.009444301575422287,
1313
+ -0.03990109823644161,
1314
+ -0.017422311007976532,
1315
+ 4.003279136668425e-05
1316
+ ],
1317
+ "q99": [
1318
+ 0.01015154086053368,
1319
+ 0.017181577533483497,
1320
+ 0.007216989761218411,
1321
+ 0.010380979906767595,
1322
+ 0.03556173853576176,
1323
+ 0.018032474815845446,
1324
+ 0.9982578039169312
1325
+ ],
1326
+ "std": [
1327
+ 0.04264938458800316,
1328
+ 0.04428559169173241,
1329
+ 0.12224084138870239,
1330
+ 0.005388413090258837,
1331
+ 0.011246449314057827,
1332
+ 0.006287882570177317,
1333
+ 0.39732322096824646
1334
+ ]
1335
+ },
1336
+ "num_trajectories": 5208,
1337
+ "num_transitions": 1139911,
1338
+ "proprio": {
1339
+ "max": [
1340
+ 0.0,
1341
+ 0.0,
1342
+ 0.0,
1343
+ 0.0,
1344
+ 0.0,
1345
+ 0.0,
1346
+ 0.0
1347
+ ],
1348
+ "mean": [
1349
+ 0.0,
1350
+ 0.0,
1351
+ 0.0,
1352
+ 0.0,
1353
+ 0.0,
1354
+ 0.0,
1355
+ 0.0
1356
+ ],
1357
+ "min": [
1358
+ 0.0,
1359
+ 0.0,
1360
+ 0.0,
1361
+ 0.0,
1362
+ 0.0,
1363
+ 0.0,
1364
+ 0.0
1365
+ ],
1366
+ "q01": [
1367
+ 0.0,
1368
+ 0.0,
1369
+ 0.0,
1370
+ 0.0,
1371
+ 0.0,
1372
+ 0.0,
1373
+ 0.0
1374
+ ],
1375
+ "q99": [
1376
+ 0.0,
1377
+ 0.0,
1378
+ 0.0,
1379
+ 0.0,
1380
+ 0.0,
1381
+ 0.0,
1382
+ 0.0
1383
+ ],
1384
+ "std": [
1385
+ 0.0,
1386
+ 0.0,
1387
+ 0.0,
1388
+ 0.0,
1389
+ 0.0,
1390
+ 0.0,
1391
+ 0.0
1392
+ ]
1393
+ }
1394
+ },
1395
+ "fmb_dataset": {
1396
+ "action": {
1397
+ "mask": [
1398
+ true,
1399
+ true,
1400
+ true,
1401
+ true,
1402
+ true,
1403
+ true,
1404
+ false
1405
+ ],
1406
+ "max": [
1407
+ 1.399999976158142,
1408
+ 1.0,
1409
+ 1.399999976158142,
1410
+ 1.0,
1411
+ 1.0,
1412
+ 1.0,
1413
+ 1.0
1414
+ ],
1415
+ "mean": [
1416
+ 0.059029702097177505,
1417
+ -0.06476633995771408,
1418
+ -0.09787475317716599,
1419
+ 0.004325388930737972,
1420
+ 0.00028963794466108084,
1421
+ -0.04457257315516472,
1422
+ 0.7336440086364746
1423
+ ],
1424
+ "min": [
1425
+ -1.399999976158142,
1426
+ -1.399999976158142,
1427
+ -1.0,
1428
+ -1.0,
1429
+ -1.0,
1430
+ -1.0,
1431
+ 0.0
1432
+ ],
1433
+ "q01": [
1434
+ -0.8257142901420593,
1435
+ -1.399999976158142,
1436
+ -1.0,
1437
+ -1.0,
1438
+ -0.3028571307659149,
1439
+ -1.0,
1440
+ 0.0
1441
+ ],
1442
+ "q99": [
1443
+ 1.0,
1444
+ 0.5257142782211304,
1445
+ 1.0,
1446
+ 1.0,
1447
+ 0.3400000035762787,
1448
+ 1.0,
1449
+ 1.0
1450
+ ],
1451
+ "std": [
1452
+ 0.28809213638305664,
1453
+ 0.2820415794849396,
1454
+ 0.4626740515232086,
1455
+ 0.3266514539718628,
1456
+ 0.10842999070882797,
1457
+ 0.3440099358558655,
1458
+ 0.4435282051563263
1459
+ ]
1460
+ },
1461
+ "num_trajectories": 8612,
1462
+ "num_transitions": 1137459,
1463
+ "proprio": {
1464
+ "max": [
1465
+ 0.0,
1466
+ 0.0,
1467
+ 0.0,
1468
+ 0.0,
1469
+ 0.0,
1470
+ 0.0,
1471
+ 0.0
1472
+ ],
1473
+ "mean": [
1474
+ 0.0,
1475
+ 0.0,
1476
+ 0.0,
1477
+ 0.0,
1478
+ 0.0,
1479
+ 0.0,
1480
+ 0.0
1481
+ ],
1482
+ "min": [
1483
+ 0.0,
1484
+ 0.0,
1485
+ 0.0,
1486
+ 0.0,
1487
+ 0.0,
1488
+ 0.0,
1489
+ 0.0
1490
+ ],
1491
+ "q01": [
1492
+ 0.0,
1493
+ 0.0,
1494
+ 0.0,
1495
+ 0.0,
1496
+ 0.0,
1497
+ 0.0,
1498
+ 0.0
1499
+ ],
1500
+ "q99": [
1501
+ 0.0,
1502
+ 0.0,
1503
+ 0.0,
1504
+ 0.0,
1505
+ 0.0,
1506
+ 0.0,
1507
+ 0.0
1508
+ ],
1509
+ "std": [
1510
+ 0.0,
1511
+ 0.0,
1512
+ 0.0,
1513
+ 0.0,
1514
+ 0.0,
1515
+ 0.0,
1516
+ 0.0
1517
+ ]
1518
+ }
1519
+ },
1520
+ "fractal20220817_data": {
1521
+ "action": {
1522
+ "mask": [
1523
+ true,
1524
+ true,
1525
+ true,
1526
+ true,
1527
+ true,
1528
+ true,
1529
+ false
1530
+ ],
1531
+ "max": [
1532
+ 2.9984593391418457,
1533
+ 22.09052848815918,
1534
+ 2.7507524490356445,
1535
+ 1.570636510848999,
1536
+ 1.5321086645126343,
1537
+ 1.5691522359848022,
1538
+ 1.0
1539
+ ],
1540
+ "mean": [
1541
+ 0.006987582892179489,
1542
+ 0.006265917327255011,
1543
+ -0.01262515690177679,
1544
+ 0.04333311319351196,
1545
+ -0.005756212864071131,
1546
+ 0.0009130256366916001,
1547
+ 0.5354204773902893
1548
+ ],
1549
+ "min": [
1550
+ -2.0204520225524902,
1551
+ -5.497899532318115,
1552
+ -2.031663417816162,
1553
+ -1.569917917251587,
1554
+ -1.569892168045044,
1555
+ -1.570419430732727,
1556
+ 0.0
1557
+ ],
1558
+ "q01": [
1559
+ -0.22453527510166169,
1560
+ -0.14820013284683228,
1561
+ -0.231589707583189,
1562
+ -0.3517994859814644,
1563
+ -0.4193011274933815,
1564
+ -0.43643461108207704,
1565
+ 0.0
1566
+ ],
1567
+ "q99": [
1568
+ 0.17824687153100965,
1569
+ 0.14938379630446405,
1570
+ 0.21842354819178575,
1571
+ 0.5892666035890578,
1572
+ 0.35272657424211445,
1573
+ 0.44796681255102094,
1574
+ 1.0
1575
+ ],
1576
+ "std": [
1577
+ 0.0692116990685463,
1578
+ 0.05970962345600128,
1579
+ 0.07353084534406662,
1580
+ 0.15610496699810028,
1581
+ 0.13164450228214264,
1582
+ 0.14593800902366638,
1583
+ 0.497110515832901
1584
+ ]
1585
+ },
1586
+ "num_trajectories": 87212,
1587
+ "num_transitions": 3786400,
1588
+ "proprio": {
1589
+ "max": [
1590
+ 0.0,
1591
+ 0.0,
1592
+ 0.0,
1593
+ 0.0,
1594
+ 0.0,
1595
+ 0.0,
1596
+ 0.0
1597
+ ],
1598
+ "mean": [
1599
+ 0.0,
1600
+ 0.0,
1601
+ 0.0,
1602
+ 0.0,
1603
+ 0.0,
1604
+ 0.0,
1605
+ 0.0
1606
+ ],
1607
+ "min": [
1608
+ 0.0,
1609
+ 0.0,
1610
+ 0.0,
1611
+ 0.0,
1612
+ 0.0,
1613
+ 0.0,
1614
+ 0.0
1615
+ ],
1616
+ "q01": [
1617
+ 0.0,
1618
+ 0.0,
1619
+ 0.0,
1620
+ 0.0,
1621
+ 0.0,
1622
+ 0.0,
1623
+ 0.0
1624
+ ],
1625
+ "q99": [
1626
+ 0.0,
1627
+ 0.0,
1628
+ 0.0,
1629
+ 0.0,
1630
+ 0.0,
1631
+ 0.0,
1632
+ 0.0
1633
+ ],
1634
+ "std": [
1635
+ 0.0,
1636
+ 0.0,
1637
+ 0.0,
1638
+ 0.0,
1639
+ 0.0,
1640
+ 0.0,
1641
+ 0.0
1642
+ ]
1643
+ }
1644
+ },
1645
+ "furniture_bench_dataset_converted_externally_to_rlds": {
1646
+ "action": {
1647
+ "mask": [
1648
+ true,
1649
+ true,
1650
+ true,
1651
+ true,
1652
+ true,
1653
+ true,
1654
+ false
1655
+ ],
1656
+ "max": [
1657
+ 0.10000000149011612,
1658
+ 0.10000000149011612,
1659
+ 0.10000000149011612,
1660
+ 0.8651833534240723,
1661
+ 1.0909736156463623,
1662
+ 2.863185405731201,
1663
+ 1.0
1664
+ ],
1665
+ "mean": [
1666
+ 0.00014610752987209707,
1667
+ 0.0010830952087417245,
1668
+ 0.0006224989192560315,
1669
+ -0.003303206292912364,
1670
+ -0.0026880695950239897,
1671
+ 0.018242603167891502,
1672
+ 0.48854944109916687
1673
+ ],
1674
+ "min": [
1675
+ -0.10495579987764359,
1676
+ -0.10939455777406693,
1677
+ -0.10000000149011612,
1678
+ -0.971906840801239,
1679
+ -1.0475432872772217,
1680
+ -3.06000018119812,
1681
+ 0.0
1682
+ ],
1683
+ "q01": [
1684
+ -0.053988199681043625,
1685
+ -0.05049169331789017,
1686
+ -0.032499241530895236,
1687
+ -0.1953887003660202,
1688
+ -0.41674559473991396,
1689
+ -0.8886768388748169,
1690
+ 0.0
1691
+ ],
1692
+ "q99": [
1693
+ 0.05414841488003723,
1694
+ 0.04965164884924884,
1695
+ 0.060055799782276154,
1696
+ 0.18231668293476103,
1697
+ 0.39867786407470646,
1698
+ 0.8772023963928218,
1699
+ 1.0
1700
+ ],
1701
+ "std": [
1702
+ 0.01610708422958851,
1703
+ 0.014891477301716805,
1704
+ 0.014014219865202904,
1705
+ 0.058274295181035995,
1706
+ 0.11417088657617569,
1707
+ 0.33479776978492737,
1708
+ 0.49991825222969055
1709
+ ]
1710
+ },
1711
+ "num_trajectories": 5100,
1712
+ "num_transitions": 3948057,
1713
+ "proprio": {
1714
+ "max": [
1715
+ 0.0,
1716
+ 0.0,
1717
+ 0.0,
1718
+ 0.0,
1719
+ 0.0,
1720
+ 0.0,
1721
+ 0.0
1722
+ ],
1723
+ "mean": [
1724
+ 0.0,
1725
+ 0.0,
1726
+ 0.0,
1727
+ 0.0,
1728
+ 0.0,
1729
+ 0.0,
1730
+ 0.0
1731
+ ],
1732
+ "min": [
1733
+ 0.0,
1734
+ 0.0,
1735
+ 0.0,
1736
+ 0.0,
1737
+ 0.0,
1738
+ 0.0,
1739
+ 0.0
1740
+ ],
1741
+ "q01": [
1742
+ 0.0,
1743
+ 0.0,
1744
+ 0.0,
1745
+ 0.0,
1746
+ 0.0,
1747
+ 0.0,
1748
+ 0.0
1749
+ ],
1750
+ "q99": [
1751
+ 0.0,
1752
+ 0.0,
1753
+ 0.0,
1754
+ 0.0,
1755
+ 0.0,
1756
+ 0.0,
1757
+ 0.0
1758
+ ],
1759
+ "std": [
1760
+ 0.0,
1761
+ 0.0,
1762
+ 0.0,
1763
+ 0.0,
1764
+ 0.0,
1765
+ 0.0,
1766
+ 0.0
1767
+ ]
1768
+ }
1769
+ },
1770
+ "iamlab_cmu_pickup_insert_converted_externally_to_rlds": {
1771
+ "action": {
1772
+ "mask": [
1773
+ true,
1774
+ true,
1775
+ true,
1776
+ true,
1777
+ true,
1778
+ true,
1779
+ false
1780
+ ],
1781
+ "max": [
1782
+ 0.6634981632232666,
1783
+ 0.23428471386432648,
1784
+ 0.4308285415172577,
1785
+ 3.1415927410125732,
1786
+ 0.13647015392780304,
1787
+ 3.141592502593994,
1788
+ 1.0
1789
+ ],
1790
+ "mean": [
1791
+ 0.5274372696876526,
1792
+ 0.02858201041817665,
1793
+ 0.18712575733661652,
1794
+ 1.2339589595794678,
1795
+ 0.03226623684167862,
1796
+ -1.4199490547180176,
1797
+ 0.5550631880760193
1798
+ ],
1799
+ "min": [
1800
+ 0.3071657121181488,
1801
+ -0.29754969477653503,
1802
+ 0.06578229367733002,
1803
+ -3.1415927410125732,
1804
+ -0.04584203287959099,
1805
+ -3.141592502593994,
1806
+ 0.0
1807
+ ],
1808
+ "q01": [
1809
+ 0.3148897051811218,
1810
+ -0.20317550599575043,
1811
+ 0.06785467118024827,
1812
+ -3.140952730178833,
1813
+ -0.029743434861302376,
1814
+ -3.141091251373291,
1815
+ 0.0
1816
+ ],
1817
+ "q99": [
1818
+ 0.6472805738449097,
1819
+ 0.20846802592277527,
1820
+ 0.36855655312538155,
1821
+ 3.1409926891326903,
1822
+ 0.11424950212240226,
1823
+ 3.1410969257354737,
1824
+ 1.0
1825
+ ],
1826
+ "std": [
1827
+ 0.08108345419168472,
1828
+ 0.1116757020354271,
1829
+ 0.07747554779052734,
1830
+ 2.8737246990203857,
1831
+ 0.02774704433977604,
1832
+ 2.7678682804107666,
1833
+ 0.49695101380348206
1834
+ ]
1835
+ },
1836
+ "num_trajectories": 631,
1837
+ "num_transitions": 146241,
1838
+ "proprio": {
1839
+ "max": [
1840
+ 0.0,
1841
+ 0.0,
1842
+ 0.0,
1843
+ 0.0,
1844
+ 0.0,
1845
+ 0.0,
1846
+ 0.0
1847
+ ],
1848
+ "mean": [
1849
+ 0.0,
1850
+ 0.0,
1851
+ 0.0,
1852
+ 0.0,
1853
+ 0.0,
1854
+ 0.0,
1855
+ 0.0
1856
+ ],
1857
+ "min": [
1858
+ 0.0,
1859
+ 0.0,
1860
+ 0.0,
1861
+ 0.0,
1862
+ 0.0,
1863
+ 0.0,
1864
+ 0.0
1865
+ ],
1866
+ "q01": [
1867
+ 0.0,
1868
+ 0.0,
1869
+ 0.0,
1870
+ 0.0,
1871
+ 0.0,
1872
+ 0.0,
1873
+ 0.0
1874
+ ],
1875
+ "q99": [
1876
+ 0.0,
1877
+ 0.0,
1878
+ 0.0,
1879
+ 0.0,
1880
+ 0.0,
1881
+ 0.0,
1882
+ 0.0
1883
+ ],
1884
+ "std": [
1885
+ 0.0,
1886
+ 0.0,
1887
+ 0.0,
1888
+ 0.0,
1889
+ 0.0,
1890
+ 0.0,
1891
+ 0.0
1892
+ ]
1893
+ }
1894
+ },
1895
+ "jaco_play": {
1896
+ "action": {
1897
+ "mask": [
1898
+ true,
1899
+ true,
1900
+ true,
1901
+ true,
1902
+ true,
1903
+ true,
1904
+ false
1905
+ ],
1906
+ "max": [
1907
+ 0.20000000298023224,
1908
+ 0.20000000298023224,
1909
+ 0.20000000298023224,
1910
+ 0.0,
1911
+ 0.0,
1912
+ 0.0,
1913
+ 1.0
1914
+ ],
1915
+ "mean": [
1916
+ 0.0009658430935814977,
1917
+ -0.00580078037455678,
1918
+ -0.00395062193274498,
1919
+ 0.0,
1920
+ 0.0,
1921
+ 0.0,
1922
+ 0.34934908151626587
1923
+ ],
1924
+ "min": [
1925
+ -0.20000000298023224,
1926
+ -0.20000000298023224,
1927
+ -0.20000000298023224,
1928
+ 0.0,
1929
+ 0.0,
1930
+ 0.0,
1931
+ 0.0
1932
+ ],
1933
+ "q01": [
1934
+ -0.20000000298023224,
1935
+ -0.20000000298023224,
1936
+ -0.20000000298023224,
1937
+ 0.0,
1938
+ 0.0,
1939
+ 0.0,
1940
+ 0.0
1941
+ ],
1942
+ "q99": [
1943
+ 0.20000000298023224,
1944
+ 0.20000000298023224,
1945
+ 0.20000000298023224,
1946
+ 0.0,
1947
+ 0.0,
1948
+ 0.0,
1949
+ 1.0
1950
+ ],
1951
+ "std": [
1952
+ 0.12235074490308762,
1953
+ 0.09678777307271957,
1954
+ 0.11155334860086441,
1955
+ 0.0,
1956
+ 0.0,
1957
+ 0.0,
1958
+ 0.4768252968788147
1959
+ ]
1960
+ },
1961
+ "num_trajectories": 1085,
1962
+ "num_transitions": 77965,
1963
+ "proprio": {
1964
+ "max": [
1965
+ 0.0,
1966
+ 0.0,
1967
+ 0.0,
1968
+ 0.0,
1969
+ 0.0,
1970
+ 0.0,
1971
+ 0.0
1972
+ ],
1973
+ "mean": [
1974
+ 0.0,
1975
+ 0.0,
1976
+ 0.0,
1977
+ 0.0,
1978
+ 0.0,
1979
+ 0.0,
1980
+ 0.0
1981
+ ],
1982
+ "min": [
1983
+ 0.0,
1984
+ 0.0,
1985
+ 0.0,
1986
+ 0.0,
1987
+ 0.0,
1988
+ 0.0,
1989
+ 0.0
1990
+ ],
1991
+ "q01": [
1992
+ 0.0,
1993
+ 0.0,
1994
+ 0.0,
1995
+ 0.0,
1996
+ 0.0,
1997
+ 0.0,
1998
+ 0.0
1999
+ ],
2000
+ "q99": [
2001
+ 0.0,
2002
+ 0.0,
2003
+ 0.0,
2004
+ 0.0,
2005
+ 0.0,
2006
+ 0.0,
2007
+ 0.0
2008
+ ],
2009
+ "std": [
2010
+ 0.0,
2011
+ 0.0,
2012
+ 0.0,
2013
+ 0.0,
2014
+ 0.0,
2015
+ 0.0,
2016
+ 0.0
2017
+ ]
2018
+ }
2019
+ },
2020
+ "kuka": {
2021
+ "action": {
2022
+ "mask": [
2023
+ true,
2024
+ true,
2025
+ true,
2026
+ true,
2027
+ true,
2028
+ true,
2029
+ false
2030
+ ],
2031
+ "max": [
2032
+ 0.1697135865688324,
2033
+ 0.2777623236179352,
2034
+ 0.43710532784461975,
2035
+ 0.0,
2036
+ 0.0,
2037
+ 1.9684287309646606,
2038
+ 1.0
2039
+ ],
2040
+ "mean": [
2041
+ -0.0004668905457947403,
2042
+ 0.00040138536132872105,
2043
+ -0.001280792523175478,
2044
+ 0.0,
2045
+ 0.0,
2046
+ -0.03722453489899635,
2047
+ 0.4131543040275574
2048
+ ],
2049
+ "min": [
2050
+ -0.159867063164711,
2051
+ -0.2892282009124756,
2052
+ -0.2795473635196686,
2053
+ 0.0,
2054
+ 0.0,
2055
+ -1.9875637292861938,
2056
+ 0.0
2057
+ ],
2058
+ "q01": [
2059
+ -0.06619441494345665,
2060
+ -0.08713878810405731,
2061
+ -0.15083016991615295,
2062
+ 0.0,
2063
+ 0.0,
2064
+ -0.5415697038173676,
2065
+ 0.0
2066
+ ],
2067
+ "q99": [
2068
+ 0.06601839080452929,
2069
+ 0.08732476785779003,
2070
+ 0.18168179214000715,
2071
+ 0.0,
2072
+ 0.0,
2073
+ 0.2923380345106127,
2074
+ 1.0
2075
+ ],
2076
+ "std": [
2077
+ 0.02083250693976879,
2078
+ 0.02915887162089348,
2079
+ 0.06422865390777588,
2080
+ 0.0,
2081
+ 0.0,
2082
+ 0.14224295318126678,
2083
+ 0.49086448550224304
2084
+ ]
2085
+ },
2086
+ "num_trajectories": 209880,
2087
+ "num_transitions": 2455879,
2088
+ "proprio": {
2089
+ "max": [
2090
+ 0.0,
2091
+ 0.0,
2092
+ 0.0,
2093
+ 0.0,
2094
+ 0.0,
2095
+ 0.0,
2096
+ 0.0
2097
+ ],
2098
+ "mean": [
2099
+ 0.0,
2100
+ 0.0,
2101
+ 0.0,
2102
+ 0.0,
2103
+ 0.0,
2104
+ 0.0,
2105
+ 0.0
2106
+ ],
2107
+ "min": [
2108
+ 0.0,
2109
+ 0.0,
2110
+ 0.0,
2111
+ 0.0,
2112
+ 0.0,
2113
+ 0.0,
2114
+ 0.0
2115
+ ],
2116
+ "q01": [
2117
+ 0.0,
2118
+ 0.0,
2119
+ 0.0,
2120
+ 0.0,
2121
+ 0.0,
2122
+ 0.0,
2123
+ 0.0
2124
+ ],
2125
+ "q99": [
2126
+ 0.0,
2127
+ 0.0,
2128
+ 0.0,
2129
+ 0.0,
2130
+ 0.0,
2131
+ 0.0,
2132
+ 0.0
2133
+ ],
2134
+ "std": [
2135
+ 0.0,
2136
+ 0.0,
2137
+ 0.0,
2138
+ 0.0,
2139
+ 0.0,
2140
+ 0.0,
2141
+ 0.0
2142
+ ]
2143
+ }
2144
+ },
2145
+ "nyu_franka_play_dataset_converted_externally_to_rlds": {
2146
+ "action": {
2147
+ "mask": [
2148
+ true,
2149
+ true,
2150
+ true,
2151
+ true,
2152
+ true,
2153
+ true,
2154
+ false
2155
+ ],
2156
+ "max": [
2157
+ 0.06424188613891602,
2158
+ 0.07027634978294373,
2159
+ 0.06129661202430725,
2160
+ 6.281067848205566,
2161
+ 0.1967729926109314,
2162
+ 0.26377415657043457,
2163
+ 1.0
2164
+ ],
2165
+ "mean": [
2166
+ 0.001021989737637341,
2167
+ -0.00012002651783404872,
2168
+ 0.00032894269679673016,
2169
+ 0.0015034361276775599,
2170
+ -0.002198522910475731,
2171
+ -0.001663230243138969,
2172
+ 0.7230083346366882
2173
+ ],
2174
+ "min": [
2175
+ -0.05952230095863342,
2176
+ -0.07232445478439331,
2177
+ -0.06730806827545166,
2178
+ -6.278434753417969,
2179
+ -0.21479034423828125,
2180
+ -0.3627619743347168,
2181
+ 0.0
2182
+ ],
2183
+ "q01": [
2184
+ -0.03199600875377655,
2185
+ -0.032861671447753905,
2186
+ -0.03368805110454559,
2187
+ -0.12080862045288086,
2188
+ -0.12175218224525451,
2189
+ -0.11370223641395569,
2190
+ 0.0
2191
+ ],
2192
+ "q99": [
2193
+ 0.03101520001888276,
2194
+ 0.0373908892273903,
2195
+ 0.03646374464035038,
2196
+ 0.11764093399047852,
2197
+ 0.1258920183777809,
2198
+ 0.09366151213645942,
2199
+ 1.0
2200
+ ],
2201
+ "std": [
2202
+ 0.01327415369451046,
2203
+ 0.013215910643339157,
2204
+ 0.012822109274566174,
2205
+ 0.2732451558113098,
2206
+ 0.057022541761398315,
2207
+ 0.039172880351543427,
2208
+ 0.44752755761146545
2209
+ ]
2210
+ },
2211
+ "num_trajectories": 456,
2212
+ "num_transitions": 44875,
2213
+ "proprio": {
2214
+ "max": [
2215
+ 0.0,
2216
+ 0.0,
2217
+ 0.0,
2218
+ 0.0,
2219
+ 0.0,
2220
+ 0.0,
2221
+ 0.0
2222
+ ],
2223
+ "mean": [
2224
+ 0.0,
2225
+ 0.0,
2226
+ 0.0,
2227
+ 0.0,
2228
+ 0.0,
2229
+ 0.0,
2230
+ 0.0
2231
+ ],
2232
+ "min": [
2233
+ 0.0,
2234
+ 0.0,
2235
+ 0.0,
2236
+ 0.0,
2237
+ 0.0,
2238
+ 0.0,
2239
+ 0.0
2240
+ ],
2241
+ "q01": [
2242
+ 0.0,
2243
+ 0.0,
2244
+ 0.0,
2245
+ 0.0,
2246
+ 0.0,
2247
+ 0.0,
2248
+ 0.0
2249
+ ],
2250
+ "q99": [
2251
+ 0.0,
2252
+ 0.0,
2253
+ 0.0,
2254
+ 0.0,
2255
+ 0.0,
2256
+ 0.0,
2257
+ 0.0
2258
+ ],
2259
+ "std": [
2260
+ 0.0,
2261
+ 0.0,
2262
+ 0.0,
2263
+ 0.0,
2264
+ 0.0,
2265
+ 0.0,
2266
+ 0.0
2267
+ ]
2268
+ }
2269
+ },
2270
+ "roboturk": {
2271
+ "action": {
2272
+ "mask": [
2273
+ true,
2274
+ true,
2275
+ true,
2276
+ true,
2277
+ true,
2278
+ true,
2279
+ false
2280
+ ],
2281
+ "max": [
2282
+ 0.39124172925949097,
2283
+ 0.4601028263568878,
2284
+ 0.4870833456516266,
2285
+ 1.816888689994812,
2286
+ 1.8240282535552979,
2287
+ 1.4824820756912231,
2288
+ 1.0
2289
+ ],
2290
+ "mean": [
2291
+ 0.0014448732836171985,
2292
+ -0.0015945249469950795,
2293
+ -0.0011753785656765103,
2294
+ 0.0023012510500848293,
2295
+ -0.0009382463176734746,
2296
+ -0.00011485807772260159,
2297
+ 0.5746025443077087
2298
+ ],
2299
+ "min": [
2300
+ -0.6546999216079712,
2301
+ -0.6365841031074524,
2302
+ -0.4217723608016968,
2303
+ -1.6695482730865479,
2304
+ -1.8023357391357422,
2305
+ -1.4630827903747559,
2306
+ 0.0
2307
+ ],
2308
+ "q01": [
2309
+ -0.1342635464668274,
2310
+ -0.19996687173843383,
2311
+ -0.1482972100377083,
2312
+ -0.20720748245716095,
2313
+ -0.09676413893699647,
2314
+ -0.18075634717941286,
2315
+ 0.0
2316
+ ],
2317
+ "q99": [
2318
+ 0.14956976801157001,
2319
+ 0.1805950567126275,
2320
+ 0.18841815620660796,
2321
+ 0.21615413755178453,
2322
+ 0.09457383215427405,
2323
+ 0.18543301910162005,
2324
+ 1.0
2325
+ ],
2326
+ "std": [
2327
+ 0.04935386776924133,
2328
+ 0.0635455846786499,
2329
+ 0.061164740473032,
2330
+ 0.09553450345993042,
2331
+ 0.08420111238956451,
2332
+ 0.06517903506755829,
2333
+ 0.49452081322669983
2334
+ ]
2335
+ },
2336
+ "num_trajectories": 1995,
2337
+ "num_transitions": 187507,
2338
+ "proprio": {
2339
+ "max": [
2340
+ 0.0,
2341
+ 0.0,
2342
+ 0.0,
2343
+ 0.0,
2344
+ 0.0,
2345
+ 0.0,
2346
+ 0.0
2347
+ ],
2348
+ "mean": [
2349
+ 0.0,
2350
+ 0.0,
2351
+ 0.0,
2352
+ 0.0,
2353
+ 0.0,
2354
+ 0.0,
2355
+ 0.0
2356
+ ],
2357
+ "min": [
2358
+ 0.0,
2359
+ 0.0,
2360
+ 0.0,
2361
+ 0.0,
2362
+ 0.0,
2363
+ 0.0,
2364
+ 0.0
2365
+ ],
2366
+ "q01": [
2367
+ 0.0,
2368
+ 0.0,
2369
+ 0.0,
2370
+ 0.0,
2371
+ 0.0,
2372
+ 0.0,
2373
+ 0.0
2374
+ ],
2375
+ "q99": [
2376
+ 0.0,
2377
+ 0.0,
2378
+ 0.0,
2379
+ 0.0,
2380
+ 0.0,
2381
+ 0.0,
2382
+ 0.0
2383
+ ],
2384
+ "std": [
2385
+ 0.0,
2386
+ 0.0,
2387
+ 0.0,
2388
+ 0.0,
2389
+ 0.0,
2390
+ 0.0,
2391
+ 0.0
2392
+ ]
2393
+ }
2394
+ },
2395
+ "stanford_hydra_dataset_converted_externally_to_rlds": {
2396
+ "action": {
2397
+ "mask": [
2398
+ true,
2399
+ true,
2400
+ true,
2401
+ true,
2402
+ true,
2403
+ true,
2404
+ false
2405
+ ],
2406
+ "max": [
2407
+ 0.02499854564666748,
2408
+ 0.02499903365969658,
2409
+ 0.024999922141432762,
2410
+ 0.24974457919597626,
2411
+ 0.24997030198574066,
2412
+ 0.24999946355819702,
2413
+ 1.0
2414
+ ],
2415
+ "mean": [
2416
+ 0.0007790001109242439,
2417
+ 0.00013707754260394722,
2418
+ -0.0002548607881180942,
2419
+ 0.0012903271708637476,
2420
+ -0.004751681815832853,
2421
+ 0.002692886395379901,
2422
+ 0.48855218291282654
2423
+ ],
2424
+ "min": [
2425
+ -0.024999044835567474,
2426
+ -0.024999700486660004,
2427
+ -0.02499929815530777,
2428
+ -0.24993225932121277,
2429
+ -0.2499666064977646,
2430
+ -0.2499932497739792,
2431
+ 0.0
2432
+ ],
2433
+ "q01": [
2434
+ -0.019992006458342076,
2435
+ -0.02415412735193968,
2436
+ -0.022941758055239916,
2437
+ -0.11085530579090118,
2438
+ -0.12024572037160397,
2439
+ -0.13314770206809043,
2440
+ 0.0
2441
+ ],
2442
+ "q99": [
2443
+ 0.022886231057345868,
2444
+ 0.022358838934451335,
2445
+ 0.02410089675337076,
2446
+ 0.12370114490389822,
2447
+ 0.11323311634361738,
2448
+ 0.18474749639630164,
2449
+ 1.0
2450
+ ],
2451
+ "std": [
2452
+ 0.008022161200642586,
2453
+ 0.009131459519267082,
2454
+ 0.009574338793754578,
2455
+ 0.04122216999530792,
2456
+ 0.0384303517639637,
2457
+ 0.04606688767671585,
2458
+ 0.49976691603660583
2459
+ ]
2460
+ },
2461
+ "num_trajectories": 570,
2462
+ "num_transitions": 358234,
2463
+ "proprio": {
2464
+ "max": [
2465
+ 0.0,
2466
+ 0.0,
2467
+ 0.0,
2468
+ 0.0,
2469
+ 0.0,
2470
+ 0.0,
2471
+ 0.0
2472
+ ],
2473
+ "mean": [
2474
+ 0.0,
2475
+ 0.0,
2476
+ 0.0,
2477
+ 0.0,
2478
+ 0.0,
2479
+ 0.0,
2480
+ 0.0
2481
+ ],
2482
+ "min": [
2483
+ 0.0,
2484
+ 0.0,
2485
+ 0.0,
2486
+ 0.0,
2487
+ 0.0,
2488
+ 0.0,
2489
+ 0.0
2490
+ ],
2491
+ "q01": [
2492
+ 0.0,
2493
+ 0.0,
2494
+ 0.0,
2495
+ 0.0,
2496
+ 0.0,
2497
+ 0.0,
2498
+ 0.0
2499
+ ],
2500
+ "q99": [
2501
+ 0.0,
2502
+ 0.0,
2503
+ 0.0,
2504
+ 0.0,
2505
+ 0.0,
2506
+ 0.0,
2507
+ 0.0
2508
+ ],
2509
+ "std": [
2510
+ 0.0,
2511
+ 0.0,
2512
+ 0.0,
2513
+ 0.0,
2514
+ 0.0,
2515
+ 0.0,
2516
+ 0.0
2517
+ ]
2518
+ }
2519
+ },
2520
+ "taco_play": {
2521
+ "action": {
2522
+ "mask": [
2523
+ true,
2524
+ true,
2525
+ true,
2526
+ true,
2527
+ true,
2528
+ true,
2529
+ false
2530
+ ],
2531
+ "max": [
2532
+ 1.4915844202041626,
2533
+ 2.1842432022094727,
2534
+ 2.6836395263671875,
2535
+ 5.035226821899414,
2536
+ 2.665864944458008,
2537
+ 4.250768661499023,
2538
+ 1.0
2539
+ ],
2540
+ "mean": [
2541
+ -0.003845922416076064,
2542
+ 0.009671456180512905,
2543
+ 0.012780580669641495,
2544
+ -0.005403771996498108,
2545
+ -0.009606587700545788,
2546
+ -0.002480733208358288,
2547
+ 0.4263913035392761
2548
+ ],
2549
+ "min": [
2550
+ -4.242457866668701,
2551
+ -3.192805051803589,
2552
+ -1.3371467590332031,
2553
+ -4.202683448791504,
2554
+ -2.6722638607025146,
2555
+ -3.3467135429382324,
2556
+ 0.0
2557
+ ],
2558
+ "q01": [
2559
+ -0.7106140398979186,
2560
+ -1.056944659948349,
2561
+ -0.5878450274467468,
2562
+ -0.7682853937149048,
2563
+ -0.7180147767066956,
2564
+ -1.5527938604354858,
2565
+ 0.0
2566
+ ],
2567
+ "q99": [
2568
+ 0.6482916426658629,
2569
+ 1.0051310062408447,
2570
+ 0.9480248689651489,
2571
+ 0.6926478147506714,
2572
+ 0.6351067513227462,
2573
+ 1.628010264635086,
2574
+ 1.0
2575
+ ],
2576
+ "std": [
2577
+ 0.23254038393497467,
2578
+ 0.36298269033432007,
2579
+ 0.28692901134490967,
2580
+ 0.2617705166339874,
2581
+ 0.2438892275094986,
2582
+ 0.5216503143310547,
2583
+ 0.4946896731853485
2584
+ ]
2585
+ },
2586
+ "num_trajectories": 3603,
2587
+ "num_transitions": 237798,
2588
+ "proprio": {
2589
+ "max": [
2590
+ 0.0,
2591
+ 0.0,
2592
+ 0.0,
2593
+ 0.0,
2594
+ 0.0,
2595
+ 0.0,
2596
+ 0.0
2597
+ ],
2598
+ "mean": [
2599
+ 0.0,
2600
+ 0.0,
2601
+ 0.0,
2602
+ 0.0,
2603
+ 0.0,
2604
+ 0.0,
2605
+ 0.0
2606
+ ],
2607
+ "min": [
2608
+ 0.0,
2609
+ 0.0,
2610
+ 0.0,
2611
+ 0.0,
2612
+ 0.0,
2613
+ 0.0,
2614
+ 0.0
2615
+ ],
2616
+ "q01": [
2617
+ 0.0,
2618
+ 0.0,
2619
+ 0.0,
2620
+ 0.0,
2621
+ 0.0,
2622
+ 0.0,
2623
+ 0.0
2624
+ ],
2625
+ "q99": [
2626
+ 0.0,
2627
+ 0.0,
2628
+ 0.0,
2629
+ 0.0,
2630
+ 0.0,
2631
+ 0.0,
2632
+ 0.0
2633
+ ],
2634
+ "std": [
2635
+ 0.0,
2636
+ 0.0,
2637
+ 0.0,
2638
+ 0.0,
2639
+ 0.0,
2640
+ 0.0,
2641
+ 0.0
2642
+ ]
2643
+ }
2644
+ },
2645
+ "toto": {
2646
+ "action": {
2647
+ "mask": [
2648
+ true,
2649
+ true,
2650
+ true,
2651
+ true,
2652
+ true,
2653
+ true,
2654
+ false
2655
+ ],
2656
+ "max": [
2657
+ 0.6839867234230042,
2658
+ 0.4454185664653778,
2659
+ 0.7984078526496887,
2660
+ 2.120781660079956,
2661
+ 1.371164321899414,
2662
+ 1.4118704795837402,
2663
+ 0.0
2664
+ ],
2665
+ "mean": [
2666
+ 0.38542115688323975,
2667
+ 0.007769413758069277,
2668
+ 0.3632740378379822,
2669
+ -0.6652036905288696,
2670
+ 0.1890396922826767,
2671
+ 0.03298724442720413,
2672
+ 0.0
2673
+ ],
2674
+ "min": [
2675
+ 0.09922284632921219,
2676
+ -0.5180193781852722,
2677
+ 0.13791072368621826,
2678
+ -2.635117530822754,
2679
+ -1.0734480619430542,
2680
+ -1.9282547235488892,
2681
+ 0.0
2682
+ ],
2683
+ "q01": [
2684
+ 0.1756722891330719,
2685
+ -0.3077590811252594,
2686
+ 0.235383919775486,
2687
+ -2.0908505964279174,
2688
+ -0.6191593289375306,
2689
+ -0.7488683319091797,
2690
+ 0.0
2691
+ ],
2692
+ "q99": [
2693
+ 0.6136963081359863,
2694
+ 0.33704194784164443,
2695
+ 0.6681221985816956,
2696
+ 0.7422861719131538,
2697
+ 0.7955395007133507,
2698
+ 0.740464625358582,
2699
+ 0.0
2700
+ ],
2701
+ "std": [
2702
+ 0.12211652100086212,
2703
+ 0.19378550350666046,
2704
+ 0.10178236663341522,
2705
+ 0.5725259184837341,
2706
+ 0.29884573817253113,
2707
+ 0.3259911835193634,
2708
+ 0.0
2709
+ ]
2710
+ },
2711
+ "num_trajectories": 1003,
2712
+ "num_transitions": 325699,
2713
+ "proprio": {
2714
+ "max": [
2715
+ 0.0,
2716
+ 0.0,
2717
+ 0.0,
2718
+ 0.0,
2719
+ 0.0,
2720
+ 0.0,
2721
+ 0.0
2722
+ ],
2723
+ "mean": [
2724
+ 0.0,
2725
+ 0.0,
2726
+ 0.0,
2727
+ 0.0,
2728
+ 0.0,
2729
+ 0.0,
2730
+ 0.0
2731
+ ],
2732
+ "min": [
2733
+ 0.0,
2734
+ 0.0,
2735
+ 0.0,
2736
+ 0.0,
2737
+ 0.0,
2738
+ 0.0,
2739
+ 0.0
2740
+ ],
2741
+ "q01": [
2742
+ 0.0,
2743
+ 0.0,
2744
+ 0.0,
2745
+ 0.0,
2746
+ 0.0,
2747
+ 0.0,
2748
+ 0.0
2749
+ ],
2750
+ "q99": [
2751
+ 0.0,
2752
+ 0.0,
2753
+ 0.0,
2754
+ 0.0,
2755
+ 0.0,
2756
+ 0.0,
2757
+ 0.0
2758
+ ],
2759
+ "std": [
2760
+ 0.0,
2761
+ 0.0,
2762
+ 0.0,
2763
+ 0.0,
2764
+ 0.0,
2765
+ 0.0,
2766
+ 0.0
2767
+ ]
2768
+ }
2769
+ },
2770
+ "ucsd_kitchen_dataset_converted_externally_to_rlds": {
2771
+ "action": {
2772
+ "mask": [
2773
+ true,
2774
+ true,
2775
+ true,
2776
+ true,
2777
+ true,
2778
+ true,
2779
+ false
2780
+ ],
2781
+ "max": [
2782
+ 678.0,
2783
+ 400.0,
2784
+ 507.0,
2785
+ 180.00001525878906,
2786
+ 6.000013828277588,
2787
+ 116.99998474121094,
2788
+ 1.0
2789
+ ],
2790
+ "mean": [
2791
+ 410.37567138671875,
2792
+ 116.9518814086914,
2793
+ 192.35032653808594,
2794
+ -121.22441864013672,
2795
+ -33.84893035888672,
2796
+ 50.016136169433594,
2797
+ 0.741813600063324
2798
+ ],
2799
+ "min": [
2800
+ 172.0,
2801
+ -166.0,
2802
+ -99.99999237060547,
2803
+ -180.00001525878906,
2804
+ -89.0,
2805
+ -96.00010681152344,
2806
+ 0.0
2807
+ ],
2808
+ "q01": [
2809
+ 200.00001052856445,
2810
+ -102.31004211425781,
2811
+ -94.99993370056153,
2812
+ -180.00001525878906,
2813
+ -88.00001525878906,
2814
+ -38.999977111816406,
2815
+ 0.0
2816
+ ],
2817
+ "q99": [
2818
+ 637.0,
2819
+ 368.30999999999995,
2820
+ 493.0,
2821
+ 180.00001525878906,
2822
+ 0.999983012676239,
2823
+ 105.00001525878906,
2824
+ 1.0
2825
+ ],
2826
+ "std": [
2827
+ 122.81494903564453,
2828
+ 108.8009033203125,
2829
+ 130.303466796875,
2830
+ 116.28205108642578,
2831
+ 27.621843338012695,
2832
+ 41.02094650268555,
2833
+ 0.43763357400894165
2834
+ ]
2835
+ },
2836
+ "num_trajectories": 150,
2837
+ "num_transitions": 3970,
2838
+ "proprio": {
2839
+ "max": [
2840
+ 0.0,
2841
+ 0.0,
2842
+ 0.0,
2843
+ 0.0,
2844
+ 0.0,
2845
+ 0.0,
2846
+ 0.0
2847
+ ],
2848
+ "mean": [
2849
+ 0.0,
2850
+ 0.0,
2851
+ 0.0,
2852
+ 0.0,
2853
+ 0.0,
2854
+ 0.0,
2855
+ 0.0
2856
+ ],
2857
+ "min": [
2858
+ 0.0,
2859
+ 0.0,
2860
+ 0.0,
2861
+ 0.0,
2862
+ 0.0,
2863
+ 0.0,
2864
+ 0.0
2865
+ ],
2866
+ "q01": [
2867
+ 0.0,
2868
+ 0.0,
2869
+ 0.0,
2870
+ 0.0,
2871
+ 0.0,
2872
+ 0.0,
2873
+ 0.0
2874
+ ],
2875
+ "q99": [
2876
+ 0.0,
2877
+ 0.0,
2878
+ 0.0,
2879
+ 0.0,
2880
+ 0.0,
2881
+ 0.0,
2882
+ 0.0
2883
+ ],
2884
+ "std": [
2885
+ 0.0,
2886
+ 0.0,
2887
+ 0.0,
2888
+ 0.0,
2889
+ 0.0,
2890
+ 0.0,
2891
+ 0.0
2892
+ ]
2893
+ }
2894
+ },
2895
+ "utaustin_mutex": {
2896
+ "action": {
2897
+ "mask": [
2898
+ true,
2899
+ true,
2900
+ true,
2901
+ true,
2902
+ true,
2903
+ true,
2904
+ false
2905
+ ],
2906
+ "max": [
2907
+ 1.0,
2908
+ 1.0,
2909
+ 1.0,
2910
+ 0.375,
2911
+ 0.375,
2912
+ 0.375,
2913
+ 1.0
2914
+ ],
2915
+ "mean": [
2916
+ 0.06176406890153885,
2917
+ -0.005005486309528351,
2918
+ 0.10216785222291946,
2919
+ -0.03314131125807762,
2920
+ 0.013895004987716675,
2921
+ -0.011317633092403412,
2922
+ 0.5038976669311523
2923
+ ],
2924
+ "min": [
2925
+ -1.0,
2926
+ -1.0,
2927
+ -1.0,
2928
+ -0.375,
2929
+ -0.375,
2930
+ -0.375,
2931
+ 0.0
2932
+ ],
2933
+ "q01": [
2934
+ -0.4285714328289032,
2935
+ -0.9800000190734863,
2936
+ -0.5571428537368774,
2937
+ -0.375,
2938
+ -0.15642857551574707,
2939
+ -0.335357129573822,
2940
+ 0.0
2941
+ ],
2942
+ "q99": [
2943
+ 0.5914285778999329,
2944
+ 0.9714285731315613,
2945
+ 1.0,
2946
+ 0.3278571367263794,
2947
+ 0.207857146859169,
2948
+ 0.25607141852378845,
2949
+ 1.0
2950
+ ],
2951
+ "std": [
2952
+ 0.1875014752149582,
2953
+ 0.4468473494052887,
2954
+ 0.3792876601219177,
2955
+ 0.14097853004932404,
2956
+ 0.06453701853752136,
2957
+ 0.11765272170305252,
2958
+ 0.501045286655426
2959
+ ]
2960
+ },
2961
+ "num_trajectories": 1500,
2962
+ "num_transitions": 361883,
2963
+ "proprio": {
2964
+ "max": [
2965
+ 0.0,
2966
+ 0.0,
2967
+ 0.0,
2968
+ 0.0,
2969
+ 0.0,
2970
+ 0.0,
2971
+ 0.0
2972
+ ],
2973
+ "mean": [
2974
+ 0.0,
2975
+ 0.0,
2976
+ 0.0,
2977
+ 0.0,
2978
+ 0.0,
2979
+ 0.0,
2980
+ 0.0
2981
+ ],
2982
+ "min": [
2983
+ 0.0,
2984
+ 0.0,
2985
+ 0.0,
2986
+ 0.0,
2987
+ 0.0,
2988
+ 0.0,
2989
+ 0.0
2990
+ ],
2991
+ "q01": [
2992
+ 0.0,
2993
+ 0.0,
2994
+ 0.0,
2995
+ 0.0,
2996
+ 0.0,
2997
+ 0.0,
2998
+ 0.0
2999
+ ],
3000
+ "q99": [
3001
+ 0.0,
3002
+ 0.0,
3003
+ 0.0,
3004
+ 0.0,
3005
+ 0.0,
3006
+ 0.0,
3007
+ 0.0
3008
+ ],
3009
+ "std": [
3010
+ 0.0,
3011
+ 0.0,
3012
+ 0.0,
3013
+ 0.0,
3014
+ 0.0,
3015
+ 0.0,
3016
+ 0.0
3017
+ ]
3018
+ }
3019
+ },
3020
+ "viola": {
3021
+ "action": {
3022
+ "mask": [
3023
+ true,
3024
+ true,
3025
+ true,
3026
+ true,
3027
+ true,
3028
+ true,
3029
+ false
3030
+ ],
3031
+ "max": [
3032
+ 1.0,
3033
+ 1.0,
3034
+ 1.0,
3035
+ 0.375,
3036
+ 0.36321428418159485,
3037
+ 0.375,
3038
+ 1.0
3039
+ ],
3040
+ "mean": [
3041
+ 0.04761844128370285,
3042
+ -0.029204415157437325,
3043
+ 0.05586736649274826,
3044
+ -0.002618510741740465,
3045
+ 0.006867344491183758,
3046
+ -0.01682133786380291,
3047
+ 0.7323777675628662
3048
+ ],
3049
+ "min": [
3050
+ -1.0,
3051
+ -1.0,
3052
+ -1.0,
3053
+ -0.375,
3054
+ -0.375,
3055
+ -0.375,
3056
+ 0.0
3057
+ ],
3058
+ "q01": [
3059
+ -0.9628571271896362,
3060
+ -1.0,
3061
+ -1.0,
3062
+ -0.26249998807907104,
3063
+ -0.21321429312229156,
3064
+ -0.3385714292526245,
3065
+ 0.0
3066
+ ],
3067
+ "q99": [
3068
+ 0.9114285707473755,
3069
+ 0.868571400642395,
3070
+ 1.0,
3071
+ 0.2817857265472412,
3072
+ 0.2239285707473755,
3073
+ 0.3557142913341522,
3074
+ 1.0
3075
+ ],
3076
+ "std": [
3077
+ 0.39157867431640625,
3078
+ 0.4076525568962097,
3079
+ 0.40077948570251465,
3080
+ 0.10023996233940125,
3081
+ 0.0844319611787796,
3082
+ 0.10375042259693146,
3083
+ 0.44260647892951965
3084
+ ]
3085
+ },
3086
+ "num_trajectories": 150,
3087
+ "num_transitions": 76324,
3088
+ "proprio": {
3089
+ "max": [
3090
+ 0.0,
3091
+ 0.0,
3092
+ 0.0,
3093
+ 0.0,
3094
+ 0.0,
3095
+ 0.0,
3096
+ 0.0
3097
+ ],
3098
+ "mean": [
3099
+ 0.0,
3100
+ 0.0,
3101
+ 0.0,
3102
+ 0.0,
3103
+ 0.0,
3104
+ 0.0,
3105
+ 0.0
3106
+ ],
3107
+ "min": [
3108
+ 0.0,
3109
+ 0.0,
3110
+ 0.0,
3111
+ 0.0,
3112
+ 0.0,
3113
+ 0.0,
3114
+ 0.0
3115
+ ],
3116
+ "q01": [
3117
+ 0.0,
3118
+ 0.0,
3119
+ 0.0,
3120
+ 0.0,
3121
+ 0.0,
3122
+ 0.0,
3123
+ 0.0
3124
+ ],
3125
+ "q99": [
3126
+ 0.0,
3127
+ 0.0,
3128
+ 0.0,
3129
+ 0.0,
3130
+ 0.0,
3131
+ 0.0,
3132
+ 0.0
3133
+ ],
3134
+ "std": [
3135
+ 0.0,
3136
+ 0.0,
3137
+ 0.0,
3138
+ 0.0,
3139
+ 0.0,
3140
+ 0.0,
3141
+ 0.0
3142
+ ]
3143
+ }
3144
+ }
3145
+ },
3146
+ "output_projector_states": false,
3147
+ "pad_to_multiple_of": 64,
3148
+ "pad_token_id": 32000,
3149
+ "text_config": {
3150
+ "model_type": "llama",
3151
+ "pad_token_id": 32000,
3152
+ "torch_dtype": "bfloat16",
3153
+ "vocab_size": 32064
3154
+ },
3155
+ "timm_model_ids": [
3156
+ "vit_large_patch14_reg4_dinov2.lvd142m",
3157
+ "vit_so400m_patch14_siglip_224"
3158
+ ],
3159
+ "timm_override_act_layers": [
3160
+ null,
3161
+ null
3162
+ ],
3163
+ "torch_dtype": "bfloat16",
3164
+ "transformers_version": "4.40.1",
3165
+ "use_fused_vision_backbone": true,
3166
+ "vision_backbone_id": "dinosiglip-vit-so-224px"
3167
+ }
configuration_prismatic.py ADDED
@@ -0,0 +1,140 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """
2
+ configuration_prismatic.py
3
+
4
+ HuggingFace-style configuration definition for Prismatic VLMs, inheriting from `transformers.PretrainedConfig`.
5
+ Default configuration specifies `siglip-224px+7b`.
6
+ """
7
+
8
+ from typing import Any, Dict, List, Optional
9
+
10
+ from transformers import PretrainedConfig
11
+ from transformers.models.auto import CONFIG_MAPPING
12
+
13
+ # === Utilities for Mapping Prismatic names to HF names ===
14
+ # fmt: off
15
+ VISION_BACKBONE_TO_RESOLUTION: Dict[str, List[int]] = {
16
+ "clip-vit-l": [224], "siglip-vit-so400m": [224], "dinov2-vit-l": [224], "in1k-vit-l": [224],
17
+
18
+ "clip-vit-l-336px": [336],
19
+ "siglip-vit-so400m-384px": [384],
20
+
21
+ "dinoclip-vit-l-336px": [336, 336],
22
+ "dinosiglip-vit-so-224px": [224, 224],
23
+ "dinosiglip-vit-so-384px": [384, 384],
24
+ }
25
+ VISION_BACKBONE_TO_TIMM_ID: Dict[str, List[str]] = {
26
+ "clip-vit-l": ["vit_large_patch14_clip_224.openai"],
27
+ "clip-vit-l-336px": ["vit_large_patch14_clip_336.openai"],
28
+
29
+ "dinov2-vit-l": ["vit_large_patch14_reg4_dinov2.lvd142m"],
30
+ "in1k-vit-l": ["vit_large_patch16_224.augreg_in21k_ft_in1k"],
31
+
32
+ "siglip-vit-so400m": ["vit_so400m_patch14_siglip_224"],
33
+ "siglip-vit-so400m-384px": ["vit_so400m_patch14_siglip_384"],
34
+
35
+ "dinoclip-vit-l-336px": ["vit_large_patch14_reg4_dinov2.lvd142m", "vit_large_patch14_clip_336.openai"],
36
+ "dinosiglip-vit-so-224px": ["vit_large_patch14_reg4_dinov2.lvd142m", "vit_so400m_patch14_siglip_224"],
37
+ "dinosiglip-vit-so-384px": ["vit_large_patch14_reg4_dinov2.lvd142m", "vit_so400m_patch14_siglip_384"],
38
+ }
39
+ TIMM_OVERRIDE_ACT_LAYER: Dict[str, List[Optional[str]]] = {
40
+ "clip-vit-l": ["quick_gelu"], "clip-vit-l-336px": ["quick_gelu"],
41
+ "dinov2-vit-l": [None], "in1k-vit-l": [None],
42
+ "siglip-vit-so400m": [None], "siglip-vit-so400m-384px": [None],
43
+ "dinoclip-vit-l-336px": [None, "quick_gelu"],
44
+ "dinosiglip-vit-so-224px": [None, None], "dinosiglip-vit-so-384px": [None, None]
45
+ }
46
+
47
+ LLM_BACKBONE_TO_HF_PATH = {
48
+ "llama2-7b-pure": "meta-llama/Llama-2-7b-hf", "llama2-13b-pure": "meta-llama/Llama-2-13b-hf",
49
+ "llama2-7b-chat": "meta-llama/Llama-2-7b-chat-hf", "llama2-13b-chat": "meta-llama/Llama-2-13b-chat-hf",
50
+
51
+ "vicuna-v15-7b": "lmsys/vicuna-7b-v1.5", "vicuna-v15-13b": "lmsys/vicuna-13b-v1.5",
52
+
53
+ "mistral-v0.1-7b-pure": "mistralai/Mistral-7B-v0.1",
54
+ "mistral-v0.1-7b-instruct": "mistralai/Mistral-7B-Instruct-v0.1",
55
+
56
+ "phi-2-3b": "microsoft/phi-2",
57
+ }
58
+ LLM_BACKBONE_TO_HF_METACLASS = {
59
+ "llama2-7b-pure": "llama", "llama2-13b-pure": "llama", "llama2-7b-chat": "llama", "llama2-13b-chat": "llama",
60
+ "vicuna-v15-7b": "llama", "vicuna-v15-13b": "llama",
61
+
62
+ "mistral-v0.1-7b-pure": "mistral", "mistral-v0.1-7b-instruct": "mistral",
63
+
64
+ "phi-2-3b": "phi",
65
+ }
66
+
67
+ VALID_VISION_BACKBONES = set(VISION_BACKBONE_TO_RESOLUTION.keys())
68
+ VALID_LLM_BACKBONES = set(LLM_BACKBONE_TO_HF_PATH)
69
+ # fmt: on
70
+
71
+
72
+ class PrismaticConfig(PretrainedConfig):
73
+ model_type: str = "prismatic"
74
+ is_composition: bool = False
75
+
76
+ def __init__(
77
+ self,
78
+ vision_backbone_id: str = "siglip-vit-so400m",
79
+ llm_backbone_id: str = "vicuna-v15-7b",
80
+ arch_specifier: str = "no-align+gelu-mlp",
81
+ use_fused_vision_backbone: Optional[bool] = None,
82
+ image_resize_strategy: str = "letterbox",
83
+ text_config: Optional[Dict[str, Any]] = None,
84
+ llm_max_length: int = 2048,
85
+ pad_token_id: int = 32000,
86
+ pad_to_multiple_of: int = 64,
87
+ output_projector_states: bool = False,
88
+ **kwargs: str,
89
+ ) -> None:
90
+ if vision_backbone_id not in VALID_VISION_BACKBONES:
91
+ raise ValueError(f"Vision backbone `{vision_backbone_id}` not in {VALID_VISION_BACKBONES = }")
92
+
93
+ if llm_backbone_id not in VALID_LLM_BACKBONES:
94
+ raise ValueError(f"LLM backbone `{llm_backbone_id}` not in {VALID_LLM_BACKBONES = }")
95
+
96
+ # Set Prismatic Configuration Fields
97
+ self.vision_backbone_id = vision_backbone_id
98
+ self.llm_backbone_id = llm_backbone_id
99
+ self.arch_specifier = arch_specifier
100
+ self.output_projector_states = output_projector_states
101
+
102
+ # [Contract] All vision backbone parameters are lists =>> supports fused backbones with different preprocessing
103
+ self.use_fused_vision_backbone = (
104
+ use_fused_vision_backbone
105
+ if use_fused_vision_backbone is not None
106
+ else any(self.vision_backbone_id.startswith(v) for v in ["dinoclip", "dinosiglip"])
107
+ )
108
+
109
+ self.timm_model_ids = VISION_BACKBONE_TO_TIMM_ID[self.vision_backbone_id]
110
+ self.timm_override_act_layers = TIMM_OVERRIDE_ACT_LAYER[self.vision_backbone_id]
111
+ self.image_sizes = VISION_BACKBONE_TO_RESOLUTION[self.vision_backbone_id]
112
+ self.image_resize_strategy = image_resize_strategy
113
+
114
+ self.hf_llm_id = LLM_BACKBONE_TO_HF_PATH[self.llm_backbone_id]
115
+ self.llm_max_length = llm_max_length
116
+ self.pad_token_id, self.pad_to_multiple_of = pad_token_id, pad_to_multiple_of
117
+
118
+ # [IMPORTANT] HF Utilities actually look for a `text_config` field... we need to use that specific naming!
119
+ self.text_config = (
120
+ CONFIG_MAPPING[LLM_BACKBONE_TO_HF_METACLASS[self.llm_backbone_id]](**text_config)
121
+ if text_config is not None
122
+ else CONFIG_MAPPING[LLM_BACKBONE_TO_HF_METACLASS[self.llm_backbone_id]]()
123
+ )
124
+
125
+ # Dispatch **kwargs to super() =>> note that `pad_token_id` collides, so we pass it in here as well...
126
+ super().__init__(pad_token_id=pad_token_id, **kwargs)
127
+
128
+
129
+ class OpenVLAConfig(PrismaticConfig):
130
+ model_type: str = "openvla"
131
+
132
+ def __init__(
133
+ self,
134
+ norm_stats: Optional[Dict[str, Dict[str, Dict[str, Dict[str, List[float]]]]]] = None,
135
+ n_action_bins: int = 256,
136
+ **kwargs: str,
137
+ ) -> None:
138
+ self.norm_stats, self.n_action_bins = norm_stats, n_action_bins
139
+
140
+ super().__init__(**kwargs)