Accidentally deleted history in Safari. Is there any way to get it back? I accidentally clicked the delete button when my mouse had clicked on 5 September 2015 under the history page.

Is it stored somewhere temporarily or something before it is deleted?
No, once you delete history, it is removed from the database. 

That database is backed up, so you can use your backup method (Time Machine backup, etc) to restore the following files:

~/Library/Safari/History*