error
## ❓ Questions & Help

12/03/2019 09:12:25 - INFO - transformers.modeling_utils -   loading weights file model_check_points112/pytorch_model.bin
12/03/2019 09:12:40 - INFO - __main__ -   Creating features from dataset file at dev-v1.1.json
Traceback (most recent call last):
  File "run_squad.py", line 558, in <module>
    main()
  File "run_squad.py", line 547, in main
    result = evaluate(args, model, tokenizer, prefix=global_step)
  File "run_squad.py", line 195, in evaluate
    dataset, examples, features = load_and_cache_examples(args, tokenizer, evaluate=True, output_examples=True)
  File "run_squad.py", line 296, in load_and_cache_examples
    version_2_with_negative=args.version_2_with_negative)
  File "/content/drive/My Drive/examples/utils_squad.py", line 97, in read_squad_examples
    input_data = json.load(reader)["data"]
  File "/usr/lib/python3.6/json/__init__.py", line 299, in load
    parse_constant=parse_constant, object_pairs_hook=object_pairs_hook, **kw)
  File "/usr/lib/python3.6/json/__init__.py", line 354, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.6/json/decoder.py", line 355, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 4194293 (char 4194292)

Please, post the command and all the parameters in order to understand deeply your problem. Moreover, please specify your environment (e.g. Python version, PyTorch version, TensorFlow version, Transformers version, OS).

> ##  Questions & Help
> 12/03/2019 09:12:25 - INFO - transformers.modeling_utils - loading weights file model_check_points112/pytorch_model.bin
> 12/03/2019 09:12:40 - INFO - **main** - Creating features from dataset file at dev-v1.1.json
> Traceback (most recent call last):
> File "run_squad.py", line 558, in 
> main()
> File "run_squad.py", line 547, in main
> result = evaluate(args, model, tokenizer, prefix=global_step)
> File "run_squad.py", line 195, in evaluate
> dataset, examples, features = load_and_cache_examples(args, tokenizer, evaluate=True, output_examples=True)
> File "run_squad.py", line 296, in load_and_cache_examples
> version_2_with_negative=args.version_2_with_negative)
> File "/content/drive/My Drive/examples/utils_squad.py", line 97, in read_squad_examples
> input_data = json.load(reader)["data"]
> File "/usr/lib/python3.6/json/**init**.py", line 299, in load
> parse_constant=parse_constant, object_pairs_hook=object_pairs_hook, **kw)
> File "/usr/lib/python3.6/json/**init**.py", line 354, in loads
> return _default_decoder.decode(s)
> File "/usr/lib/python3.6/json/decoder.py", line 339, in decode
> obj, end = self.raw_decode(s, idx=_w(s, 0).end())
> File "/usr/lib/python3.6/json/decoder.py", line 355, in raw_decode
> obj, end = self.scan_once(s, idx)
> json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 4194293 (char 4194292)<|||||>solved.its working now<|||||>> solved.its working now

How do you solve this issue? I have the same errors <|||||>I am also getting same error. How you solved it?
<|||||>just remove non-asciii character from your data-set

On Tue, 9 Jun 2020 at 20:29, Amar Wagh <notifications@github.com> wrote:

> I am also getting same error. How you solved it?
>
> —
> You are receiving this because you modified the open/close state.
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/transformers/issues/2036#issuecomment-641353851>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AIPNMU4BGBNGCNIEFPHRITDRVZE6NANCNFSM4JUWHE5A>
> .
>
