Hey @Matthieu,
Thanks for reading and posting here .
Indeed, everything in the blog was run in AWS (c5.metal) instance(s).
The way I’m currently using it:

git clone https://github.com/huggingface/tune
cd tune
pip install -r requirements.txt
export PYTHONPATH=src
python src/main.py --multirun backend=pytorch batch=1 sequence_length=128,256,512

The overall framework is quite new and I’ll be improving the UX in the coming days, sorry for this user experience 
Morgan