Jefferson led the first the Democratic-Republican Party against the Federalist Party , whose leader was James Madison , during the formation of the First Party System .
Thomas Jefferson did not work with James Madison .