You'll have to confine your viewing to the outside of the old citadel in the harbor, Fort Saint-Louis, unless you're able to obtain special visitor's permission from the French military (true of all Martinique's forts), or happen by during recently authorized but infrequent visiting hours. 
You will be arrested if you sneak into Martinique's forts.