The lighthouse served as a source of inspiration for Walter DuBois Richards , an artist , for over forty years . Since 1935 , swimmers have been competing annually in the Arthur J. Ladrigan Swim Race , a one @-@ mile ( 1 @.@ 6 km ) race from the lighthouse to Bayley Beach in the Rowayton section of Norwalk .