Thank you very much tom, and sorry about the delayed response.
As you suggested, installing a newer version of GCC might partially resolve the issue. However, I have few doubts too regarding that.

The current version of GCC is 9.1. Should I go for the latest version, or is there an upper bound to the GCC compiler I should use?
Does PyTorch C++ frontend have dependencies on versions of MPI and/or any other packages that you are aware of? Is there a documentation or blog that you know which is informative on the matter.

Furthermore, the reason I have chosen this path is because I do not have GPU card. But, I do have a cluster that runs on Rocks Cluster. As mentioned in the link 3 (under the Philosophy heading), the C++ frontend exploits multi-threading and Python does not.