Apple Screen Sharing Only Controls One Display? UPDATE: I figured out in part what is happening, but not why or how to change this behavior.  When at the computer itself, Finder only activates the screen you are on when you click on the desktop(Finder) or a window on that screen. All other Finder screens are inactive.
When connected via VNC or ARD/ScreenSharing only the first screen becomes active even if that screen was not the active one when you first connected.  If another screen was active at the time you connect it becomes inactive and the first becomes active the first click that occurs. It is like the first screen has occupied all screen spaces.

ORIGINAL POST
As I mentioned in a previous question, I have a MacPro with 6 DVI monitors. We'd like to remotely manage it when necessary via Screen Sharing but it appears that only the first screen/display is actually controllable even though the content from all of the displays is visible. The menu bar is greyed out on all except the first screen and none of the apps are responsive.

This occurs both with the Apple Screen Sharing as well as via VNC. Both are enabled via Remote Management as opposed to Screen Sharing.

Is there a way to activate the rest of the desktops? On the rest of the laptops around the office with monitors and only two displays, this lockout does not occur.
Alright. The issue is a stupid one which is not entirely evident. When setting up a Mac with this many screens, be careful with the arrangement.  When arranged all in a row, even a 1 pixel overlap will cause the overlapped screen to take over all of the others and cause the behavior I stated above.  It is not evident from the desktop. On a gut feeling I ended up dragging all of the screens around to make sure they were entirely aligned and as far over as possible from the previous screen.  It turned out the first screen was the slightest bit overlapping the second.

I'll leave this question/answer up for anyone else who might encounter this bizarre issue.