Good point, and he’s also training rather than predicting. My front-end TFJS code uses the NPM detect-gpu library to determine the GPU type and available GPU memory to set batch sizing.
That said, I have always been frustrated that folks that train the big base models use such small training images. Is there research to show that is sufficient and no benefits are found by increasing the source image training size? I can see how performance was a bottleneck years  back, but it shouldn’t be now. Do you know of any of the major models that have been trained on larger source images?