In my experience, and I suppose depending on the data, I&#x27;ve found that grep is often the bottleneck for data pipeline tasks like you describe. The silver searcher (<a href="https:&#x2F;&#x2F;github.com&#x2F;ggreer&#x2F;the_silver_searcher" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;ggreer&#x2F;the_silver_searcher</a>) is, in my experience, about 10x faster than grep for tasks like pulling out fields from json files. It&#x27;s changed my life.<p>pv (pipe viewer, <a href="http:&#x2F;&#x2F;www.ivarch.com&#x2F;programs&#x2F;pv.shtml" rel="nofollow">http:&#x2F;&#x2F;www.ivarch.com&#x2F;programs&#x2F;pv.shtml</a>) and top are pretty handy to measure this kind of thing. You should be able to see exactly which process is using how much CPU, and what your throughput is.