Well the only limitation I see is the size of memory, if you keep something on the gpu it might take some space you would need for your model or data. And because it seems that extracting a single float doesnt change performances a lot this is what I would do, just extract a value each time.