As you reach Gloucester Avenue, you'll pass the remains of the Old Fort, with its small sturdy walls and heavy cannon that guarded the bay for many years.
The Old Fort is open for visitors on weekends.