 One major criterion for optimizers is just the number of required function evaluations as this often is already a large computational effort, usually much more effort than within the optimizer itself, which mainly has to operate over the N variables.The derivatives provide detailed information for such optimizers, but are even harder to calculate, e.g.approximating the gradient takes at least N+1 function evaluations.