How can I navigate to individual windows? I have many many apps running in the background some are infact two or three windows of same program, i.e. Firefox 3-4 windows and Xcode 3-4 windows etc...

I know that I can switch using &#x2318;+&#x21E5; but that only switches on programs and I want to go to each individual window.

I've tried spotlight and it's not what im looking for. Also, I do not prefer to install any paid software and would like to use build in features if possible.
To switch between windows of the same application, use ⌘ + ~.

If you need a shortcut like the Windows' Alt+Tab that switches between all open windows, you can set one in your System Preferences -> Keyboard Shortcuts as shown below.



As you can see above, the default is Ctrl+F4, which actually means you need to press Ctrl+Fn+F4 because of the special meaning of the function keys. You could change it to any unused key combination, e.g. Alt+Tab itself.