 When James J. Hill's railroad crossed Traill County, it bypassed Caledonia.The steamboat industry soon floundered and the county seat was moved to Hillsboro in 1896.Caledonia sits on the banks of the Goose River near the confluence with the Red River of the North.