Hi Jason,
What I think might have happened is that you installed the version 0.19 of TF Federated and that depends on TF 2.5 and it might have updated your 2.4 installation. (versions table: GitHub - tensorflow/federated: A framework for implementing federated learning 1)
You can verify these by
print(tf.__version__) 
print(tff.__version__) 

on your env.
If you install TF 2.5-gpu everything should work