Actually, the real problem is even more embarrassing…  Even without freezing layers, the output shouldn’t have looked the way it did.  It turns out that I was using .from_config() instead of .from_pretrained() in trying to load my fine-tuned model.  Once I fixed that, the results were much more in line with my expectations.