As you reach Gloucester Avenue , you 'll pass the remains of the Old Fort , with its small sturdy walls and heavy cannon that guarded the bay for many years .
The Old Fort is open for visitors on weekends .