In the meantime see more at:

  

      github.com
  

  
    tensorflow/runtime/blob/master/documents/cuda-proposal.md#streams


    # CUDA in TensorFlow Runtime

<!--*
# Document freshness: For more information, see go/fresh-source.
freshness: { owner: 'xldrx' reviewed: '2021-04-26' }
*-->

## CUDA in TensorFlow Runtime

This document describes the proposed design for supporting CUDA devices in
TensorFlow Runtime (TFRT). Please note this preliminary proposal was written in
the early stages of the TFRT project and the overall design has changed
considerably. We are working on an updated document.

<!-- TOC -->

## Introduction

TFRT supports CUDA by defining a set of ops which are collectively called the
CUDA RunTime dialect or CRT dialect for short[^1]. This document discusses key



  This file has been truncated. show original