OK, I tested this with my file and tried to get the 10000th row (that is probably about 10G into the file)
Pandas using skiprows=9999, chunksize=1 took 67.771 seconds, the approach I now implemented by indexing the start of line offsets and then directly skipping to the requested line takes (without the indexing which is only done once) 0.016 seconds.