if you have 10M examples and have access to GPU then definitely use GPU. If you want fast inference on CPU for ner pipeline then you could try onnx_transformers 8, which provides same API as pipeline  but leverages onnx for accelerated inference.