[bnb] Simplifies slow test
# What does this PR do?

This PR simplifies a slow test for `bnb`. In fact, you can easily retrieve the devices of the model using `set(model.hf_device_map.values())` 

cc @sgugger 
Thanks! 

_The documentation is not available anymore as the PR was closed or merged._