 Brown received a recess appointment from President James A. Garfield on June 2, 1881, to a seat on the U.S. District Court for the Southern District of New York.On October 12, 1881, President Chester A. Arthur nominated him to the same position.Brown's United States Senate confirmation took place on October 14, 1881; he received his commission the same day.