Gr00t Model - phospho Training Pipeline

Error Traceback

We faced an issue while training your model.

Training process failed with exit code 2:
2025-04-23 07:19:47.821922: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2025-04-23 07:19:47.823055: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2025-04-23 07:19:47.829377: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2025-04-23 07:19:49.422323: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
╭─ Unrecognized options ───────────────────────────────────────────────────────╮
│ Unrecognized options: --train-test-split                                     │
│ ──────────────────────────────────────────────────────────────────────────── │
│ For full helptext, run gr00t_finetune.py --help                              │
╰──────────────────────────────────────────────────────────────────────────────╯

Training parameters:

Dataset: PLB/simple-lego-pickup-mono-2
Wandb run URL: https://wandb.ai/phospho/gr00t/runs/gbm1q6uk
Epochs: 1
Batch size: 64
Training steps: 121
Train test split: 1

📖 Get Started: docs.phospho.ai
🤖 Get your robot: robots.phospho.ai