Skip to content

snowolf-zlex/Jetson-Mamba-SSM

Repository files navigation

Jetson Mamba-SSM

Complete Solution for Running YOLOv10 + Mamba SSM on NVIDIA Jetson

Platform Architecture Python CUDA TensorRT License


🌍 Language / 语言选择


📌 Quick Overview / 快速概览

Jetson-Mamba-SSM enables YOLOv10 with Mamba SSM modules on NVIDIA Jetson devices (Orin/Xavier/Nano).

Feature Status
Mamba-SSM Runtime on Jetson ✅ Supported
ONNX Export ✅ Supported
TensorRT Engine (FP32/FP16/INT8) ✅ Supported
TensorRT 10.x API ✅ Supported

Performance on Jetson Orin

Precision Inference Time VRAM
FP32 80ms 2.1 GB
FP16 40ms 1.1 GB
INT8 25ms 0.6 GB

🚀 Quick Start / 快速开始

Install / 安装

# Install dependencies / 安装依赖
pip install torch einops ninja packaging transformers triton

# Install from GitHub Release / 从 GitHub Release 安装
pip install causal_conv1d-1.6.0+jetson-*.whl
pip install mamba_ssm-2.2.4+jetson-*.whl

Export TensorRT / 导出 TensorRT

# Export FP16 engine / 导出 FP16 引擎
yolo export model=best.pt format=engine imgsz=640

# Run inference / 运行推理
yolo detect predict model=best.engine source=image.jpg

📚 Full Documentation / 完整文档

Document Description
English Docs Complete English documentation
中文文档 完整的中文使用指南
TensorRT Export Guide Step-by-step export guide
Build Guide Build from source instructions

🔧 Key Features / 核心特性

  • 🎯 One-Click Installation - Wheel packages with all patches included
  • 🔧 libc10.so Fixed - Resolves Jetson platform dependencies
  • 📦 ONNX Export - Mamba modules exportable to ONNX format
  • 🚀 TensorRT Optimized - FP32/FP16/INT8 multi-precision support
  • 📱 Cross-Platform - Supports Orin, Xavier, Nano

📦 Project Structure / 项目结构

jetson-mamba-ssm/
├── README.md              # Main entry (this file)
├── README.en-US.md        # English documentation
├── README.zh-CN.md        # Chinese documentation
├── wheels/                # Pre-compiled wheel packages
├── release/               # GitHub Release packages
├── patches/               # Git patches for source build
├── scripts/               # Utility scripts
│   ├── main.py            # Unified entry point
│   ├── install/           # Installation scripts
│   ├── test/              # Test scripts
│   └── utils/             # Utility scripts
└── docs/                  # Detailed documentation

📋 System Requirements / 系统要求

Component Version
Hardware Jetson Orin / Xavier / Nano
OS Linux (JetPack R36)
CUDA 12.6
TensorRT 10.7.0
Python 3.10+

🤝 Contributing / 贡献

Contributions are welcome! Please visit our GitHub Repository to:

  • Report issues
  • Submit pull requests
  • Suggest features

📄 License / 许可证

MIT License - See LICENSE file for details.


🙏 Acknowledgments / 致谢


Keywords: Jetson Mamba SSM, YOLOv10, TensorRT, ONNX, NVIDIA Jetson, ARM64, Deep Learning, Object Detection, State Space Model, Edge AI