NelsaHost
search Login

Can I run SD 3 Medium on NVIDIA Jetson Orin Nano 8GB?

thumb_up
Good
Yes, you can run this model!
GPU VRAM
8.0GB
Required
6.0GB
Headroom
+2.0GB

VRAM Usage

0GB 75% used 8.0GB

Performance Estimate

Tokens/sec ~63.0
Batch size 3

info Technical Analysis

NVIDIA Jetson Orin Nano 8GB is well-suited for running SD 3 Medium. The 8.0GB VRAM provides adequate headroom (2.0GB) beyond the 6.0GB requirement for standard inference workloads.

lightbulb Recommendation

This is a solid configuration for SD 3 Medium. Use standard settings and you should experience good performance for most use cases.

tune Recommended Settings

Batch_Size
3
Context_Length
77
Inference_Framework
llama.cpp or vLLM

help Frequently Asked Questions

Can I run SD 3 Medium on NVIDIA Jetson Orin Nano 8GB? expand_more
NVIDIA Jetson Orin Nano 8GB with 8.0GB VRAM can run SD 3 Medium (2.00B) (6.0GB required) with 2.0GB headroom. This provides comfortable room for inference with standard settings.
How much VRAM does SD 3 Medium need? expand_more
SD 3 Medium requires approximately 6.0GB of VRAM.
What performance can I expect? expand_more
Estimated 63 tokens per second.

GPU

memory
NVIDIA Jetson Orin Nano 8GB
8.0GB VRAM

AI Model

smart_toy
SD 3 Medium (2.00B)
2.00B params

More with Jetson Orin Nano 8GB

Whisper Small Perfect Whisper Medium Perfect Whisper Base Perfect SD 2.1 Good