NelsaHost
search Login
smart_toy

GPUs for Mixtral 8x7B (46.70B)

46.70B parameters • 93.4GB VRAM (FP16) • Mistral

info Model Details
check_circle 14 Perfect
thumb_up 0 Good
warning 3 Marginal
cancel 11 Fail

Recommended minimum: RTX 4090 (24.0GB) or higher for optimal performance

check_circle

RTX 3090

NVIDIA • 24.0GB

PERFECT
24.0GB available +5.3GB headroom
check_circle

RTX 3090 Ti

NVIDIA • 24.0GB

PERFECT
24.0GB available +5.3GB headroom
check_circle

RTX 4090

NVIDIA • 24.0GB

PERFECT
24.0GB available +5.3GB headroom
check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +21.3GB headroom
check_circle

A100 40GB

NVIDIA • 40.0GB

PERFECT
40.0GB available +16.6GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +61.3GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +56.6GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +56.6GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +61.3GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +33.3GB headroom
check_circle

H100 PCIe

NVIDIA • 80.0GB

PERFECT
80.0GB available +61.3GB headroom
check_circle

A100 80GB

NVIDIA • 80.0GB

PERFECT
80.0GB available +33.3GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +56.6GB headroom
check_circle

H100 SXM

NVIDIA • 80.0GB

PERFECT
80.0GB available +33.3GB headroom
warning

RTX 4090

NVIDIA • 24.0GB

MARGINAL
24.0GB available +0.6GB headroom
warning

RTX 3090

NVIDIA • 24.0GB

MARGINAL
24.0GB available +0.6GB headroom
warning

RTX 3090 Ti

NVIDIA • 24.0GB

MARGINAL
24.0GB available +0.6GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -22.7GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -22.7GB headroom
cancel

RTX 4090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -69.4GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -69.4GB headroom
cancel

RTX 3090 Ti

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -69.4GB headroom
cancel

RTX 3090

NVIDIA • 24.0GB

FAIL/OOM
24.0GB available -22.7GB headroom
cancel

A100 40GB

NVIDIA • 40.0GB

FAIL/OOM
40.0GB available -53.4GB headroom
Page 1 of 2 Next