<p dir="auto">In tensorflow document of class tf.DType: <a href="https://www.tensorflow.org/versions/master/api_docs/python/framework.html#DType" rel="nofollow">https://www.tensorflow.org/versions/master/api_docs/python/framework.html#DType</a></p>
<p dir="auto">There are three types:<br>
tf.qint8: Quantized 8-bit signed integer.<br>
tf.quint8: Quantized 8-bit unsigned integer.<br>
tf.qint32: Quantized 32-bit signed integer.</p>
<p dir="auto">And also related method about quantized data type. I searched online, but did not find useful resource about it.<br>
Could you add some explanation in the document?</p>
<h3 dir="auto">System information</h3>
<ul dir="auto">
<li><strong>Have I written custom code (as opposed to using a stock example script provided in TensorFlow)</strong>: No</li>
<li><strong>OS Platform and Distribution (e.g., Linux Ubuntu 16.04)</strong>: Tx2</li>
<li><strong>TensorFlow installed from (source or binary)</strong>: source</li>
<li><strong>TensorFlow version (use command below)</strong>: r1.6, r1.7, r1.8</li>
<li><strong>Python version</strong>: 3.5</li>
<li><strong>Bazel version (if compiling from source)</strong>:.13.0- (@non-git)</li>
<li><strong>GCC/Compiler version (if compiling from source)</strong>:5.4.0</li>
<li><strong>CUDA/cuDNN version</strong>: 8.0 / 6.0</li>
<li><strong>GPU model and memory</strong>:  Denver2 8GB</li>
<li><strong>Exact command to reproduce</strong>: bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package</li>
</ul>
<p dir="auto">You can collect some of this information using our environment capture script:</p>
<p dir="auto"><a href="https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh">https://github.com/tensorflow/tensorflow/tree/master/tools/tf_env_collect.sh</a></p>
<p dir="auto">You can obtain the TensorFlow version with</p>
<p dir="auto">python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"</p>
<h3 dir="auto">Describe the problem</h3>
<p dir="auto">Describe the problem clearly here. Be sure to convey here why it's a bug in TensorFlow or a feature request.</p>
<h3 dir="auto">Source code / logs</h3>
<p dir="auto">Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached. Try to provide a reproducible test case that is the bare minimum necessary to generate the problem.</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::Eigen::half, int, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::Eigen::half, long long, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::Eigen::half, long long, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;float, int, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;float, int, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;float, long long, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;float, long long, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;double, int, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;double, int, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;double, long long, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt;double, long long, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , int, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , int, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , long long, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , long long, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , int, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , int, (bool)0&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , long long, (bool)1&gt; &quot;) is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function(&quot;__builtin_expect&quot;) from a __global__ function(&quot;tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , long long, (bool)0&gt; &quot;) is not allowed

20 errors detected in the compilation of &quot;/tmp/tmpxft_0000294e_00000000-9_gather_functor_gpu.cu.compute_52.cpp1.ii&quot;.
ERROR: /home/nvidia/tensorflow/tensorflow/core/kernels/BUILD:1201:1: output 'tensorflow/core/kernels/_objs/gather_functor_gpu/tensorflow/core/kernels/gather_functor_gpu.cu.pic.o' was not created
ERROR: /home/nvidia/tensorflow/tensorflow/core/kernels/BUILD:1201:1: not all outputs were created or valid"><pre class="notranslate"><code class="notranslate">./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::Eigen::half, int, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::Eigen::half, long long, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::Eigen::half, long long, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;float, int, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;float, int, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;float, long long, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;float, long long, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;double, int, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;double, int, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;double, long long, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt;double, long long, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , int, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , int, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , long long, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;float&gt; , long long, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , int, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , int, (bool)0&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , long long, (bool)1&gt; ") is not allowed

./tensorflow/core/kernels/gather_functor_gpu.cu.h(57): error: calling a __host__ function("__builtin_expect") from a __global__ function("tensorflow::GatherOpKernel&lt; ::std::complex&lt;double&gt; , long long, (bool)0&gt; ") is not allowed

20 errors detected in the compilation of "/tmp/tmpxft_0000294e_00000000-9_gather_functor_gpu.cu.compute_52.cpp1.ii".
ERROR: /home/nvidia/tensorflow/tensorflow/core/kernels/BUILD:1201:1: output 'tensorflow/core/kernels/_objs/gather_functor_gpu/tensorflow/core/kernels/gather_functor_gpu.cu.pic.o' was not created
ERROR: /home/nvidia/tensorflow/tensorflow/core/kernels/BUILD:1201:1: not all outputs were created or valid
</code></pre></div>
<p dir="auto">and this is my configure settings</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="You have bazel 0.13.0- (@non-git) installed.
Please specify the location of python. [Default is /usr/bin/python]: /usr/bin/python3.5


Found possible Python library paths:
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
Please input the desired Python library path to use.  Default is [/usr/local/lib/python3.5/dist-packages]

Do you wish to build TensorFlow with jemalloc as malloc support? [Y/n]: 
jemalloc as malloc support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Google Cloud Platform support? [Y/n]: 
Google Cloud Platform support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Hadoop File System support? [Y/n]: 
Hadoop File System support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Amazon S3 File System support? [Y/n]: 
Amazon S3 File System support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Apache Kafka Platform support? [Y/n]: 
Apache Kafka Platform support will be enabled for TensorFlow.

Do you wish to build TensorFlow with XLA JIT support? [y/N]: 
No XLA JIT support will be enabled for TensorFlow.

Do you wish to build TensorFlow with GDR support? [y/N]: 
No GDR support will be enabled for TensorFlow.

Do you wish to build TensorFlow with VERBS support? [y/N]: 
No VERBS support will be enabled for TensorFlow.

Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]: 
No OpenCL SYCL support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Please specify the CUDA SDK version you want to use, e.g. 7.0. [Leave empty to default to CUDA 9.0]: 8


Please specify the location where CUDA 8.0 toolkit is installed. Refer to README.md for more details. [Default is /usr/local/cuda]: 


Please specify the cuDNN version you want to use. [Leave empty to default to cuDNN 7.0]: 6


Please specify the location where cuDNN 6 library is installed. Refer to README.md for more details. [Default is /usr/local/cuda]:/usr/libaarch64-linux-gnu


Do you wish to build TensorFlow with TensorRT support? [y/N]: 
No TensorRT support will be enabled for TensorFlow.

Please specify the NCCL version you want to use. [Leave empty to default to NCCL 1.3]: 


Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 3.5,5.2]


Do you want to use clang as CUDA compiler? [y/N]: 
nvcc will be used as CUDA compiler.

Please specify which gcc should be used by nvcc as the host compiler. [Default is /usr/bin/gcc]: 


Do you wish to build TensorFlow with MPI support? [y/N]: 
No MPI support will be enabled for TensorFlow.

Please specify optimization flags to use during compilation when bazel option &quot;--config=opt&quot; is specified [Default is -march=native]: 


Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: 
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding &quot;--config=&lt;&gt;&quot; to your build command. See tools/bazel.rc for more details.
	--config=mkl         	# Build with MKL support.
	--config=monolithic  	# Config for mostly static monolithic build."><pre class="notranslate"><code class="notranslate">You have bazel 0.13.0- (@non-git) installed.
Please specify the location of python. [Default is /usr/bin/python]: /usr/bin/python3.5


Found possible Python library paths:
  /usr/local/lib/python3.5/dist-packages
  /usr/lib/python3/dist-packages
Please input the desired Python library path to use.  Default is [/usr/local/lib/python3.5/dist-packages]

Do you wish to build TensorFlow with jemalloc as malloc support? [Y/n]: 
jemalloc as malloc support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Google Cloud Platform support? [Y/n]: 
Google Cloud Platform support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Hadoop File System support? [Y/n]: 
Hadoop File System support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Amazon S3 File System support? [Y/n]: 
Amazon S3 File System support will be enabled for TensorFlow.

Do you wish to build TensorFlow with Apache Kafka Platform support? [Y/n]: 
Apache Kafka Platform support will be enabled for TensorFlow.

Do you wish to build TensorFlow with XLA JIT support? [y/N]: 
No XLA JIT support will be enabled for TensorFlow.

Do you wish to build TensorFlow with GDR support? [y/N]: 
No GDR support will be enabled for TensorFlow.

Do you wish to build TensorFlow with VERBS support? [y/N]: 
No VERBS support will be enabled for TensorFlow.

Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]: 
No OpenCL SYCL support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Please specify the CUDA SDK version you want to use, e.g. 7.0. [Leave empty to default to CUDA 9.0]: 8


Please specify the location where CUDA 8.0 toolkit is installed. Refer to README.md for more details. [Default is /usr/local/cuda]: 


Please specify the cuDNN version you want to use. [Leave empty to default to cuDNN 7.0]: 6


Please specify the location where cuDNN 6 library is installed. Refer to README.md for more details. [Default is /usr/local/cuda]:/usr/libaarch64-linux-gnu


Do you wish to build TensorFlow with TensorRT support? [y/N]: 
No TensorRT support will be enabled for TensorFlow.

Please specify the NCCL version you want to use. [Leave empty to default to NCCL 1.3]: 


Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 3.5,5.2]


Do you want to use clang as CUDA compiler? [y/N]: 
nvcc will be used as CUDA compiler.

Please specify which gcc should be used by nvcc as the host compiler. [Default is /usr/bin/gcc]: 


Do you wish to build TensorFlow with MPI support? [y/N]: 
No MPI support will be enabled for TensorFlow.

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -march=native]: 


Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: 
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=&lt;&gt;" to your build command. See tools/bazel.rc for more details.
	--config=mkl         	# Build with MKL support.
	--config=monolithic  	# Config for mostly static monolithic build.
</code></pre></div>