Running pointing demo using HF checkpoint.

#8
by sovitrath - opened

Has anybody tried running the Molmo pointing demos using the Hugging Face checkpoints? I have run it and got the coordinates as well. But the scaling seems to be off, meaning, the keypoints are not where they should be. I understand that internally the images are resized to 336x336 and I rescaled the points and annotated them as well, just in case if that was the issue. However, they are still off.

Ai2 org

Hi, please refer to this: https://huggingface.co/allenai/MolmoE-1B-0924/discussions/2
We will update the FAQ regarding this.

Thanks. Will surely check this out.

The above solution works. Thanks a lot.

sovitrath changed discussion status to closed

Sign up or log in to comment