The graves at Knoxville National Cemetery are arranged in a circular pattern, with each burial section separated by walkways. The burial sections each form one quarter of the circle, with the headstones converging toward the middle, where there is a flagpole and cloth canopy. A stone wall surrounds the perimeter, the southeast section of which divides the cemetery from the adjacent Old Gray Cemetery.