We have to deal with a most clever and unscrupulous man, and we must use any means in our power ”otherwise he will slip through our fingers. 
We must be careful not to let the clever man slip through our fingers.