Arsenal FC was the first club in the south of england to join the football league in 1893.   They have been only relegated once in 1913 and completed the 20th century with the highest average position so over time, yes, you can say they have been the most successful.