NelsaHost
search Login
smart_toy

GPUs for LLaVA 1.6 34B (34.00B)

34.00B parameters • 68.0GB VRAM (FP16) • LLaVA

info Model Details
check_circle 3 Perfect
thumb_up 0 Good
warning 0 Marginal
cancel 32 Fail

Recommended minimum: H100 SXM (80.0GB) or higher for optimal performance

check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +12.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +12.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +12.0GB headroom
cancel

RTX 3070 Ti

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

RTX 3070

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

RTX 4060

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

Jetson Orin Nano 8GB

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

RTX 3060 Ti

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

RTX 4060 Ti 8GB

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -60.0GB headroom
cancel

RTX 3080 10GB

NVIDIA • 10.0GB

FAIL/OOM
10.0GB available -58.0GB headroom
cancel

RTX 4070

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 3080 Ti

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 4070 SUPER

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 3060 12GB

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 4070 Ti

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 3080 12GB

NVIDIA • 12.0GB

FAIL/OOM
12.0GB available -56.0GB headroom
cancel

RTX 4080

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RTX 4060 Ti 16GB

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RTX A4000

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RX 7800 XT

AMD • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RTX 4070 Ti SUPER

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RTX 4080 SUPER

NVIDIA • 16.0GB

FAIL/OOM
16.0GB available -52.0GB headroom
cancel

RX 7900 XT

AMD • 20.0GB

FAIL/OOM
20.0GB available -48.0GB headroom
cancel

RTX 4000 Ada

NVIDIA • 20.0GB

FAIL/OOM
20.0GB available -48.0GB headroom
Page 1 of 2 Next