Hi @thecity2, your dataset must be huge if you’re considering running Spark jobs on the model outputs  .
I’ve never done this exact comparison (Spark vs GPU), but can’t you get a rough estimate by doing the fine-tuning vs feature extraction comparison on a subset of the dataset? This would also give you an idea about whether the accuracy (or whatever metric you’re measuring) is good enough in the feature-based approach - in some cases, I’ve seen massive drops compared to fine-tuning.
HTH!