smart_toy

GPUs for LLaVA 1.6 13B (13.00B)

13.00B parameters • 26.0GB VRAM (FP16) • LLaVA

info Model Details
check_circle 9 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 26 Fail

Recommended minimum: Jetson AGX Orin 32GB (32.0GB) or higher for optimal performance

check_circle

Jetson AGX Orin 32GB

NVIDIA • 32.0GB

PERFECT
32.0GB available +6.0GB headroom
check_circle

RTX 5000 Ada

NVIDIA • 32.0GB

PERFECT
32.0GB available +6.0GB headroom
check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +14.0GB headroom
check_circle

RTX 6000 Ada

NVIDIA • 48.0GB

PERFECT
48.0GB available +22.0GB headroom
check_circle

RTX A6000

NVIDIA • 48.0GB

PERFECT
48.0GB available +22.0GB headroom
check_circle

Jetson AGX Orin 64GB

NVIDIA • 64.0GB

PERFECT
64.0GB available +38.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +54.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +54.0GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +54.0GB headroom
cancel

RTX 4060

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

RTX 3070

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

RTX 3060 Ti

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

Jetson Orin Nano 8GB

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

RTX 3070 Ti

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

RTX 4060 Ti 8GB

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -18.0GB headroom
cancel

RTX 3080 10GB

NVIDIA • 10.0GB

FAIL/OOM
10.0GB available -16.0GB headroom
cancel

RTX 3080 12GB

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RTX 3080 Ti

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RTX 4070

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RTX 4070 SUPER

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RTX 4070 Ti

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RTX 3060 12GB

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -14.0GB headroom
cancel

RX 7800 XT

AMD • 16.0GB

FAIL/OOM
16.0GB available -10.0GB headroom
cancel

RTX A4000

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -10.0GB headroom
Page 1 of 2 Next