Fine was appointed Inspector General of the Department of Justice by President Bill Clinton in 2000. The office is expected to be non-partisan. He served through the George W. Bush administration and part of the Barack Obama administration. Fine has a reputation as an aggressive, independent investigator. Fine served as a member of the Recovery Accountability and Transparency Board. He resigned as the DOJ Inspector General in February 2011. He joined Dechert as a partner in the White Collar & Securities Litigation Practice on September 6, 2011. Shortly after he announced his retirement, the "New York Times" praised Fine's tenure as the DOJ Inspector General:The Department of Justice's inspector general, Glenn Fine, stepped down on Friday after a decade of pushing to clean up and depoliticize a hyperpoliticized department. He will be missed. Fine's best-known efforts came in 2008 when he documented the George W. Bush administration's politically driven firings of four United States attorneys and its politically driven hirings (breaking the civil service law) of scores of civil servants at the Civil Rights Division. Last year, he continued to detail the F.B.I.'s widespread misuse since 2001 of 'exigent letters'... President Obama should appoint a vigilant successor to Mr. Fine, one who will continue to expose the department's shortcomings and their costs.Other newspapers also praised his tenure as the DOJ IG. The Washington Post wrote, "The job of Inspector General is often thankless one, requiring the ability to make unflinching and crucial assessments that are not always well received by colleagues. The Justice Department employed one of the best during the past decade in the person of Glenn A. Fine, who recently stepped down. Mr. Fine was instrumental in unearthing problems and identifying solutions in the mammoth agency since joining the IG's office in the mid-1990s. He took over the reins in 2000 and led investigations into all facets of the department's operations". A segment on NPR praised Fine as "a model IG." In June 2015, Fine returned to public service and accepted a position as the principal deputy inspector general of the Department of Defense Office of Inspector General (DOD OIG). On January 10, 2016, Fine became the acting inspector general for the DOD. On March 30, 2020, Fine was named chair of the Pandemic Response Accountability Committee, to oversee the $2 trillion stimulus funds signed into law by President Donald Trump in response to the coronavirus outbreak. On April 7, 2020, Fine was removed from the position of acting DOD IG by Trump, who claimed without evidence that he was "partisan".