Why is Hessian Matrix called 'force-constant' matrix? Hessian Matrix is a square matrix containing the elements as the second-order partial derivatives of energy-function of a molecule; the derivative is done with respect to geometric coordinates of the molecule.

However, I couldn't get why Hessian matrix is referred to as force-constant matrix; as is done in the book I'm following viz. Computational Chemistry: Introduction to the Theory and Applications of Molecular and Quantum Mechanics by Errol G. Lewars and in many other sources.

If the energy function is a quadratic function which is mostly the case for a molecule following 1D PES; the function which a Hookean spring follows for small displacement, then the second derivative does indeed give the value of force constant, that is $$\begin{align}E- E_0&amp;= k(q-q_0)^2\\ \implies \frac{\mathrm{d}^2 E}{\mathrm{d}q^2}&amp;= 2k\;.\end{align}$$

However, for molecules following multidimensional PES, most of the time, the energy function is not simple quadratic; how can the second order derivative give the force constant? Second order derivatives vary from point to point unlike the simple case above.

So, can anyone tell why Hessian matrix is called force-constant matrix?
You are right that multidimensional PES is not simple quadratic, but close to the PES well minima it can be approximated as harmonic oscillator. Also if you really want to include the real PES you can include anharmonicity in your calculation. In that case you have to include an anharonic constant $x_e\;.$ Your PES can be written as 
$$E=\left(n+\frac{1}{2}\right)h\nu-x_e\left(n+\frac{1}{2}\right)^2h\nu$$

Usually in computational chemistry the energy can be expanded into a Taylor series 
$$E=E_0+\frac{\mathrm{d}E}{\mathrm{d}x}(x-x_0)+\frac{1}{2}\frac{\mathrm{d}^2E}{\mathrm{d}x^2}(x-x_0)^2+\textrm{higher order terms}\;.$$
And you can usually neglect those first order term and higher order terms for most of the practical problems. And then your PES will follow the trajectory of a harmonic oscillator.