"The difficulty is, we have a president who didn't come from the Washington structure, so it's really hard for people inside the structure or outside the structure to evaluate him," Sen. David Perdue (R-Ga.) said.