Just launched notebook, I’m getting such output from my prints
    print(accelerator.is_main_process)
    print(accelerator.device)

False
xla:0
xla:0
False
xla:0
False
xla:0
False
xla:0
False
xla:0
False
xla:0

So, all is not main process and all xla 0 while I expect xla 0-7 and one main process.
Also, left outputs in notebook, so you can see output from train loop.