Compatibility Reports

check_circle

Mixtral 8x22B

A100 80GB

PERFECT

56.4GB / 80.0GB VRAM +23.6GB

check_circle

Whisper Medium

RTX 3080 12GB

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Phi-3 Small 7B

RTX 4090

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

check_circle

Phi-3 Small 7B

A100 80GB

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

Phi-3 Mini 3.8B

RTX 3090 Ti

PERFECT

3.8GB / 24.0GB VRAM +20.2GB

check_circle

Whisper Medium

RTX A6000

PERFECT

1.5GB / 48.0GB VRAM +46.5GB

check_circle

Llama 3.1 8B

H100 SXM

PERFECT

4.0GB / 80.0GB VRAM +76.0GB

check_circle

Llama 3.1 8B

H100 PCIe

PERFECT

4.0GB / 80.0GB VRAM +76.0GB

check_circle

Mixtral 8x7B

A100 80GB

PERFECT

46.7GB / 80.0GB VRAM +33.3GB

check_circle

Gemma 2 9B

A100 80GB

PERFECT

3.6GB / 80.0GB VRAM +76.4GB

check_circle

Phi-3 Mini 3.8B

A100 40GB

PERFECT

7.6GB / 40.0GB VRAM +32.4GB

check_circle

Qwen 2.5 7B

RTX 4090

PERFECT

7.0GB / 24.0GB VRAM +17.0GB

check_circle

Qwen 2.5 7B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

check_circle

Qwen 2.5 7B

RTX 3090 Ti

PERFECT

3.5GB / 24.0GB VRAM +20.5GB

check_circle

SD 3 Medium

RTX 4080

PERFECT

6.0GB / 16.0GB VRAM +10.0GB

check_circle

Gemma 2 9B

A100 80GB

PERFECT

9.0GB / 80.0GB VRAM +71.0GB

check_circle

Gemma 2 27B

RTX 3090

PERFECT

13.5GB / 24.0GB VRAM +10.5GB

check_circle

Llama 3.1 8B

A100 80GB

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

Qwen 2.5 72B

H100 PCIe

PERFECT

72.0GB / 80.0GB VRAM +8.0GB

check_circle

Qwen 2.5 7B

RTX 3090 Ti

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Qwen 2.5 7B

RTX 3090

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

thumb_up

LLaVA 1.6 7B

RTX A4000

GOOD

14.0GB / 16.0GB VRAM +2.0GB

check_circle

Whisper Large v3

A100 80GB

PERFECT

3.0GB / 80.0GB VRAM +77.0GB

check_circle

Phi-3 Medium 14B

RTX 4090

PERFECT

5.6GB / 24.0GB VRAM +18.4GB