TensorRT. TensorRT is a C++ library that facilitates high performance inference on NVIDIA GPUs and deep learning accelerators.