TensorRT. TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.