Hi!
You can do dataset = load_dataset("glue", "mrpc", split='train[1:]') to skip the first example while loading the dataset.

The only way I can think of for now is using dataset.select(), and then selecting every index except 0, but that doesn’t seem efficient.

Why do you think select is not efficient? It depends on the ops you use afterward, but select alone is very efficient as it only creates an indices mapping, which is (almost) equal to list(indices), and not a new PyArrow table.
`