I have the same problem here. I was trying to load a file that is 1.4 GB, minutes after the process got killed
>>> REF = data.Field(lower=True, tokenize=tokenize_char, init_token='<sos>',eos_token='<eos>')
>>> SRC = data.Field(lower=True, tokenize=tokenize_char)
>>> train = data.TabularDataset('./train.csv', format='csv', fields=[('src', SRC), ('ref', REF)])
Killed

and this works fine for a smaller dataset.
Anyone can tell me why this is happening? Thanks!