How do you handle when someone tries to instill guilt in you? From a perspective to hindrances to meditation this may fall under remorse and regrets, but not very apt in that sense. 

Using Buddhist philosophy to get over and respond, how do you handle when someone tries to instil guilt in you, like trying to make you feel like you have done something wrong, you are a bad person, I am a victim, you are a perpetrator.

How to respond to such a person?

Sutta references are appreciated but otherwise, any workable answer adhering to keeping Buddhist precepts and practise is welcome.
The important thing to do is to have in mind that these people are puthujjanas, so they are bound to be awful, especially when they think something bad is happening to them.
now the puthujjana who receives this ''attack'' better have equanimity. 

If this happens too much, then the solution is to no longer live around people who try to make you feel sad. It is hard, especially when it is people in the family, but separating yourself from bad puthujjanas in order to live with the meritorious puthujjanas and non-puthujjanas  who train for the noble path  is the way to have sati, and ultimately to be awaken, like the buddha tells Ananda in the Upaddha Sutta.

For the ''sutta reference'' you can read the Akkosa Sutta where the buddha is insulted by some puthujjana and the buddha replies that he does not take up the insults.