As you reach Gloucester Avenue , you 'll pass the remains of the Old Fort , with its small sturdy walls and heavy cannon that guarded the bay for many years .
The Old Fort is a major detour for those going to Gloucester Avenue .