The tramway would be able to transport people from either Lower Manhattan or the foot of Atlantic Avenue in Brooklyn to Governors Island in about four minutes , and commuters could also use it to go directly to Brooklyn or Manhattan .