Which model is the demo running?

#1
by iitzco - opened

Hey @bytedance-research, demo looks good nice work!

Wondering what model are you using for this demo.

Also wondering how was it deployed. Performance is really good compared to the tests I've done using HF inference endpoints

This comment has been hidden

I've tried both 7B models. The performance is abysmal. Can't even find a button on the screen. I am guessing the demo has 72B model. Has anyone had any success with the 7B models?

Turns out you have to do image resizing as it only works for certain resolutions. Check app.py for details. Seems to be working quite well so far!

image.png
So I managed to find out it's using the 72B model.

Sign up or log in to comment