Welcome to our instructional guide for inference and realtime vision DNN library for NVIDIA Jetson devices. This project uses TensorRT to run optimized networks on GPUs from C++ or Python, and PyTorch for training models.

Supported DNN vision primitives include imageNet for image classification, detectNet for object detection, segNet for semantic segmentation, poseNet for pose estimation, and actionNet for action recognition. Examples are provided for streaming from live camera feeds, making webapps with WebRTC, and support for ROS/ROS2.

Follow the Hello AI World tutorial for running inference and transfer learning onboard your Jetson, including collecting your own datasets, training your own models with PyTorch, and deploying them with TensorRT.

• Hello AI World
• Video Walkthroughs
• API Reference
• Code Examples
• Pre-Trained Models
• System Requirements
• Change Log

>   JetPack 5 is now supported, along with Jetson Orin Nano.
>   Recent post: Deploying Edge AI Web Apps (see WebRTC support)
>   See the Change Log for the latest updates and new features.

Hello AI World can be run completely onboard your Jetson, including live inferencing with TensorRT and transfer learning with PyTorch. For installation instructions, see System Setup. It's then recommended to start with the Inference section to familiarize yourself with the concepts, before diving into Training your own models.

• Setting up Jetson with JetPack
• Running the Docker Container
• Building the Project from Source

• Image Classification
  • Using the ImageNet Program on Jetson
  • Coding Your Own Image Recognition Program (Python)
  • Coding Your Own Image Recognition Program (C++)
  • Running the Live Camera Recognition Demo
  • Multi-Label Classification for Image Tagging
• Object Detection
  • Detecting Objects from Images
  • Running the Live Camera Detection Demo
  • Coding Your Own Object Detection Program
  • Using TAO Detection Models
  • Object Tracking on Video
• Semantic Segmentation
  • Segmenting Images from the Command Line
  • Running the Live Camera Segmentation Demo
• Pose Estimation
• Action Recognition
• Background Removal
• Monocular Depth

• Transfer Learning with PyTorch
• Classification/Recognition (ResNet-18)
  • Re-training on the Cat/Dog Dataset
  • Re-training on the PlantCLEF Dataset
  • Collecting your own Classification Datasets
• Object Detection (SSD-Mobilenet)
  • Re-training SSD-Mobilenet
  • Collecting your own Detection Datasets

• WebRTC Server
• HTML / JavaScript
• Flask + REST
• Plotly Dashboard
• Recognizer (Interactive Training)

• Camera Streaming and Multimedia
• Image Manipulation with CUDA
• DNN Inference Nodes for ROS/ROS2

Below are screencasts of Hello AI World that were recorded for the Jetson AI Certification course:

Description	Video
Hello AI World Setup Download and run the Hello AI World container on Jetson Nano, test your camera feed, and see how to stream it over the network via RTP.
Image Classification Inference Code your own Python program for image classification using Jetson Nano and deep learning, then experiment with realtime classification on a live camera stream.
Training Image Classification Models Learn how to train image classification models with PyTorch onboard Jetson Nano, and collect your own classification datasets to create custom models.
Object Detection Inference Code your own Python program for object detection using Jetson Nano and deep learning, then experiment with realtime detection on a live camera stream.
Training Object Detection Models Learn how to train object detection models with PyTorch onboard Jetson Nano, and collect your own detection datasets to create custom models.
Semantic Segmentation Experiment with fully-convolutional semantic segmentation networks on Jetson Nano, and run realtime segmentation on a live camera stream.

Below are links to reference documentation for the C++ and Python libraries from the repo:

• C++
• Python

These libraries are able to be used in external projects by linking to libjetson-inference and libjetson-utils.

Introductory code walkthroughs of using the library are covered during these steps of the Hello AI World tutorial:

• Coding Your Own Image Recognition Program (Python)
• Coding Your Own Image Recognition Program (C++)

Additional C++ and Python samples for running the networks on images and live camera streams can be found here:

note: see the Array Interfaces section for using memory with other Python libraries (like Numpy, PyTorch, ect)

These examples will automatically be compiled while Building the Project from Source, and are able to run the pre-trained models listed below in addition to custom models provided by the user. Launch each example with --help for usage info.

The project comes with a number of pre-trained models that are available to use and will be automatically downloaded: