NelsaHost
search Login

Can I run Phi-3 Mini 3.8B on NVIDIA RTX 3090?

check_circle
Perfect
Yes, you can run this model!
GPU VRAM
24.0GB
Required
7.6GB
Headroom
+16.4GB

VRAM Usage

0GB 32% used 24.0GB

Performance Estimate

Tokens/sec ~90.0
Batch size 21
Context 128000K

info Technical Analysis

GPU

memory
NVIDIA RTX 3090
24.0GB VRAM

AI Model

smart_toy
Phi-3 Mini 3.8B (3.80B)
3.80B params

Alternative Quantizations

q3_k_m Perfect Q4_K_M (GGUF 4-bit) Perfect INT8 (8-bit Integer) Perfect

More with RTX 3090

Qwen 2.5 7B Perfect Qwen 2.5 7B Perfect Qwen 2.5 7B Perfect Qwen 2.5 7B Perfect