NelsaHost
search Login
smart_toy

GPUs for LLaVA 1.6 7B (7.00B)

7.00B parameters • 14.0GB VRAM (FP16) • LLaVA

info Model Details
check_circle 16 Perfect
thumb_up 6 Good
warning 0 Marginal
cancel 13 Fail

Recommended minimum: RX 7900 XT (20.0GB) or higher for optimal performance

check_circle

RX 7900 XT

AMD • 20.0GB

PERFECT
20.0GB available +6.0GB headroom
check_circle

RTX 4000 Ada

NVIDIA • 20.0GB

PERFECT
20.0GB available +6.0GB headroom
check_circle

RTX A5000

NVIDIA • 24.0GB

PERFECT
24.0GB available +10.0GB headroom
check_circle

RTX 4090

NVIDIA • 24.0GB

PERFECT
24.0GB available +10.0GB headroom
check_circle

RTX 3090

NVIDIA • 24.0GB

PERFECT
24.0GB available +10.0GB headroom
check_circle

RX 7900 XTX

AMD • 24.0GB

PERFECT
24.0GB available +10.0GB headroom
check_circle

RTX 3090 Ti

NVIDIA • 24.0GB

PERFECT
24.0GB available +10.0GB headroom
check_circle

RTX 5000 Ada

NVIDIA • 32.0GB

PERFECT
32.0GB available +18.0GB headroom
check_circle

Jetson AGX Orin 32GB

NVIDIA • 32.0GB

PERFECT
32.0GB available +18.0GB headroom
check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +26.0GB headroom
check_circle

RTX 6000 Ada

NVIDIA • 48.0GB

PERFECT
48.0GB available +34.0GB headroom
check_circle

RTX A6000

NVIDIA • 48.0GB

PERFECT
48.0GB available +34.0GB headroom
check_circle

Jetson AGX Orin 64GB

NVIDIA • 64.0GB

PERFECT
64.0GB available +50.0GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +66.0GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +66.0GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +66.0GB headroom
thumb_up

RTX 4080 SUPER

NVIDIA • 16.0GB

GOOD
16.0GB available +2.0GB headroom
thumb_up

RX 7800 XT

AMD • 16.0GB

GOOD
16.0GB available +2.0GB headroom
thumb_up

RTX 4080

NVIDIA • 16.0GB

GOOD
16.0GB available +2.0GB headroom
thumb_up

RTX A4000

NVIDIA • 16.0GB

GOOD
16.0GB available +2.0GB headroom
thumb_up

RTX 4060 Ti 16GB

NVIDIA • 16.0GB

GOOD
16.0GB available +2.0GB headroom
thumb_up

RTX 4070 Ti SUPER

NVIDIA • 16.0GB

GOOD
16.0GB available +2.0GB headroom
cancel

RTX 4060

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -6.0GB headroom
cancel

RTX 3070

NVIDIA • 8.0GB

FAIL/OOM
8.0GB available -6.0GB headroom
Page 1 of 2 Next