Running a Local LLM on the NVIDIA Jetson Orin Nano Super
The Jetson Orin Nano Super is a compact edge AI board that packs a serious punch: an Ampere GPU with 1024 CUDA cores, 8GB of unified memory shared between CPU and GPU, and full JetPack 6 support. In this tutorial, I'll go from a fresh Jetson to a