Dustin Franklin

jetson-inference. Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

jetson-containers. Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

ros_deep_learning. Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT

jetson-reinforcement. Deep reinforcement learning GPU libraries for NVIDIA Jetson TX1/TX2 with PyTorch, OpenAI Gym, and Gazebo robotics simulator.

jetson-utils. C++/CUDA/Python multimedia utilities for NVIDIA Jetson

jetbot_ros. ROS nodes and Gazebo model for NVIDIA JetBot with Jetson Nano

NanoLLM. Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

jetson-voice. ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT

jetson-scripts. Configuration scripts and install guides for NVIDIA Jetson platform

turbo2. Tegra Unmanned Retrieval Bot gen2, with NVIDIA Jetson and deep reinforcement learning

NanoDB. Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP

jetson-presentations. PDF slides about NVIDIA's Jetson embedded platform and deep learning.

pytorch-ssd. MobileNetV1, MobileNetV2, VGG based SSD/SSD-lite implementation in PyTorch. Out-of-box support for retraining on Open Images dataset. ONNX and Caffe2 support. Experiment Ideas like CoordConv.

camera-capture. GUI tool for collecting & labeling data from live camera feed

rovernet. Deep reinforcement learning-driven robotic controller and navigation library using Torch.

clip_trt. CLIP and SigLIP models optimized with TensorRT with a Transformers-like API

pytorch-classification. Training of image classification models with PyTorch

pytorch-segmentation. Training of semantic segmentation networks with PyTorch

super-resolution. PyTorch super resolution model with RGB support and ONNX exporter

jetson-ai-lab. Python

pytorch-detection. Training of object detection networks with PyTorch

pytorch-odometry. Training of visual odometry estimation networks using PyTorch

jetson-screencasts-sources. Code for accompanying our OpenCV video tutorial series.

sudonim. NIMs powershell for launching local AI microservices and open-stack model templates

pytorch-depth. MonoDepth Estimation - ICRA 2018 "Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image"

pytorch-timeseries. Python

openvla. OpenVLA: An open-source vision-language-action model for robotic manipulation.

gtc-llm-lab. Jetson AI Lab - LLM Inference

small-stable-diffusion. Python

vision. Datasets, Transforms and Models specific to Computer Vision

awesome-foundation-model-ros. A collection ROS projects utilizing foundation models.

ros2_pololu. ROS2 nodes for Pololu Maestro, Jrk, and Simple Motor Controller

whisper_trt. A project that optimizes Whisper for low latency inference using NVIDIA TensorRT

VILA. VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

homography-dlt. Normalized Direct Linear Transform (DLT) for 4-point Homography Estimation

bitsandbytes. 8-bit CUDA functions for PyTorch, modified to build on NVIDIA Jetson

ORB_SLAM2_CUDA. ORB_SLAM2 with GPU Enhancement running on NVIDIA Jetson TX1. Focus on ROS part.

TTS. 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

trt_pose. Real-time pose estimation accelerated with NVIDIA TensorRT

transfusion-pytorch. Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

robosuite. robosuite: A Modular Simulation Framework and Benchmark for Robot Learning

a3c_continuous. A continuous action space version of A3C LSTM in pytorch plus A3G design

pypopsift. Python module for CUDA accelerated SIFT on GPUs

3D-Diffusion-Policy. [RSS 2024] 3D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations

IsaacLab. Unified framework for robot learning built on NVIDIA Isaac Sim

zed-ros2-wrapper. ROS 2 wrapper beta for the ZED SDK

pytorch. Tensors and Dynamic neural networks in Python with strong GPU acceleration

llama-cpp-python. Python bindings for llama.cpp

llama.cpp. Port of Facebook's LLaMA model in C/C++

imagenet_downloader. Download ImageNet images from list of IDs and URLs

diffusion_policy. [RSS 2023] Diffusion Policy Visuomotor Policy Learning via Action Diffusion

mimicgen. This code corresponds to simulation environments used as part of the MimicGen project.

cuml. cuML - RAPIDS Machine Learning Library

git. Git Source Code Mirror - This is a publish-only repository and all pull requests are ignored. Please follow Documentation/SubmittingPatches procedure for any of your improvements.

stable-diffusion-webui-tensorrt. Python