title: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
body: <p>I am trying to install the ernie and tokenizers on Windows, but for both cases it is showing the following error:</p>
  <pre class="lang-none prettyprint-override"><code>ERROR: Command errored out with exit status 1:
     command: 'c:\users\my pc\appdata\local\programs\python\python39\python.exe' 'c:\users\my pc\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\pep517\in_process\_in_process.py' build_wheel 'C:\Users\MYPC~1\AppData\Local\Temp\tmpyfqm86h3'
         cwd: C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7
    Complete output (38 lines):
    running bdist_wheel
    running build
    running build_py
    creating build
    creating build\lib
    creating build\lib\tokenizers
    copying tokenizers\__init__.py -&gt; build\lib\tokenizers
    running build_ext
    running build_rust
        Updating crates.io index
    cargo rustc --lib --manifest-path Cargo.toml --features pyo3/extension-module --target x86_64-pc-windows-msvc --release --verbose -- --crate-type cdylib
    warning: unused manifest key: target.x86_64-apple-darwin.rustflags
       Compiling proc-macro2 v1.0.30
       Compiling unicode-xid v0.2.2
       Compiling syn v1.0.80
       Compiling autocfg v1.0.1
         Running `rustc --crate-name build_script_build --edition=2018 &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\proc-macro2-1.0.30\build.rs&quot; --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg &quot;feature=\&quot;default\&quot;&quot; --cfg &quot;feature=\&quot;proc-macro\&quot;&quot; -C metadata=0b72d9facdf9b740 -C extra-filename=-0b72d9facdf9b740 --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\build\proc-macro2-0b72d9facdf9b740&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow`
         Running `rustc --crate-name unicode_xid &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\unicode-xid-0.2.2\src\lib.rs&quot; --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg &quot;feature=\&quot;default\&quot;&quot; -C metadata=c5404e573edb1c5f -C extra-filename=-c5404e573edb1c5f --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow`
         Running `rustc --crate-name build_script_build --edition=2018 &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\syn-1.0.80\build.rs&quot; --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg &quot;feature=\&quot;clone-impls\&quot;&quot; --cfg &quot;feature=\&quot;default\&quot;&quot; --cfg &quot;feature=\&quot;derive\&quot;&quot; --cfg &quot;feature=\&quot;extra-traits\&quot;&quot; --cfg &quot;feature=\&quot;full\&quot;&quot; --cfg &quot;feature=\&quot;parsing\&quot;&quot; --cfg &quot;feature=\&quot;printing\&quot;&quot; --cfg &quot;feature=\&quot;proc-macro\&quot;&quot; --cfg &quot;feature=\&quot;quote\&quot;&quot; -C metadata=b3126876d28730d4 -C extra-filename=-b3126876d28730d4 --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\build\syn-b3126876d28730d4&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow`
         Running `rustc --crate-name autocfg &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\autocfg-1.0.1\src\lib.rs&quot; --error-format=json --json=diagnostic-rendered-ansi --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=077a4bc4a690ef7e -C extra-filename=-077a4bc4a690ef7e --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow`
       Compiling memchr v2.4.1
         Running `rustc --crate-name build_script_build --edition=2018 &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\memchr-2.4.1\build.rs&quot; --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg &quot;feature=\&quot;default\&quot;&quot; --cfg &quot;feature=\&quot;std\&quot;&quot; -C metadata=420338dd5ea363a5 -C extra-filename=-420338dd5ea363a5 --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\build\memchr-420338dd5ea363a5&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow`
    error: linker `link.exe` not found
      |
      = note: The system cannot find the file specified. (os error 2)
  
    note: the msvc targets depend on the msvc linker but `link.exe` was not found
  
    note: please ensure that VS 2013, VS 2015, VS 2017 or VS 2019 was installed with the Visual C++ option
  
    error: could not compile `syn` due to previous error
  
    Caused by:
      process didn't exit successfully: `rustc --crate-name build_script_build --edition=2018 &quot;C:\Users\my pc\.cargo\registry\src\github.com-1ecc6299db9ec823\syn-1.0.80\build.rs&quot; --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg &quot;feature=\&quot;clone-impls\&quot;&quot; --cfg &quot;feature=\&quot;default\&quot;&quot; --cfg &quot;feature=\&quot;derive\&quot;&quot; --cfg &quot;feature=\&quot;extra-traits\&quot;&quot; --cfg &quot;feature=\&quot;full\&quot;&quot; --cfg &quot;feature=\&quot;parsing\&quot;&quot; --cfg &quot;feature=\&quot;printing\&quot;&quot; --cfg &quot;feature=\&quot;proc-macro\&quot;&quot; --cfg &quot;feature=\&quot;quote\&quot;&quot; -C metadata=b3126876d28730d4 -C extra-filename=-b3126876d28730d4 --out-dir &quot;C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\build\syn-b3126876d28730d4&quot; -L &quot;dependency=C:\Users\my pc\AppData\Local\Temp\pip-install-504a8mvv\tokenizers_a45d458877334719a3bf67c944dce6d7\target\release\deps&quot; --cap-lints allow` (exit code: 1)
    warning: build failed, waiting for other jobs to finish...
    error: build failed
    error: cargo failed with code: 101
  
    ----------------------------------------
    ERROR: Failed building wheel for tokenizers
  Failed to build tokenizers
  ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
  </code></pre>