NelsaHost
search Login

Can I run LLaVA 1.6 13B on NVIDIA RTX 4060 Ti 8GB?

cancel
Fail/OOM
This GPU doesn't have enough VRAM
GPU VRAM
8.0GB
Required
26.0GB
Headroom
-18.0GB

VRAM Usage

0GB 100% used 8.0GB

info Technical Analysis

GPU

memory
NVIDIA RTX 4060 Ti 8GB
8.0GB VRAM

AI Model

smart_toy
LLaVA 1.6 13B (13.00B)
13.00B params

More with RTX 4060 Ti 8GB

Whisper Small Perfect Whisper Medium Perfect Whisper Base Perfect SD 3 Medium Good