Hi - following discussion in the SIG Build, we are planning to upgrade TensorFlow to CUDA 11.4 and cuDNN 8.2 and will be releasing new binaries via tf-nightly builds soon. These new libraries will be available  for Ubuntu and Windows, and the tracking issue for this upgrade process is #51659 58.
Please let us know in this forum if you have any questions or feedback!