Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

30,009

Base only

Active filters: 8-bit

deepseek-ai/DeepSeek-V4-Pro

Text Generation • 862B • Updated 27 days ago • 5.83M • • 4.55k

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 4 days ago • 313k • 128

deepseek-ai/DeepSeek-V4-Flash

Text Generation • 158B • Updated 27 days ago • 3.53M • • 1.35k

nvidia/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated 4 days ago • 3.77k • 45

stepfun-ai/Step-3.7-Flash-NVFP4

Image-Text-to-Text • 104B • Updated 1 day ago • 34.8k • 36

openai/gpt-oss-120b

Text Generation • 120B • Updated Aug 26, 2025 • 4.61M • • 4.84k

nvidia/GLM-5.1-NVFP4

Text Generation • 382B • Updated 6 days ago • 16.7k • 29

CohereLabs/command-a-plus-05-2026-w4a4

Image-Text-to-Text • 126B • Updated 6 days ago • 83.8k • • 216

LiquidAI/LFM2.5-8B-A1B-MLX-8bit

Text Generation • 8B • Updated about 23 hours ago • 3.95k • 12

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated May 1 • 1.56M • 326

unsloth/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 19B • Updated 2 days ago • 539k • 65

nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4

Any-to-Any • 18B • Updated 28 days ago • 1.12M • 126

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated 22 days ago • 1.29M • 71

0xSero/DeepSeek-V4-Flash-180B

Text Generation • 102B • Updated 3 days ago • 574 • 10

0xSero/DeepSeek-V4-Flash-162B

Text Generation • 92B • Updated 3 days ago • 787 • 8

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26, 2025 • 7.91M • • 4.67k

sakamakismile/Huihui-Qwen3.6-27B-abliterated-NVFP4-MTP

Text Generation • 17B • Updated 2 days ago • 147k • 55

mlx-community/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-8bit

Text Generation • 39B • Updated 30 days ago • 22.5k • 18

unsloth/Qwen3.6-35B-A3B-NVFP4

Image-Text-to-Text • 22B • Updated 2 days ago • 191k • 31

sakamakismile/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated Apr 29 • 780k • 66

canada-quant/DeepSeek-V4-Flash-NVFP4-FP8-MTP

171B • Updated 4 days ago • 2.97k • 7

junwatu/Marlin-2B-MLX-8bit

Video-Text-to-Text • 0.9B • Updated 6 days ago • 25 • 4

AEON-7/Step-3.7-Flash-AEON-Ultimate-Abliterated-NVFP4

Image-Text-to-Text • 104B • Updated 1 day ago • 475 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 183k • 142

microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated Dec 17, 2025 • 12.9k • 1.45k

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4

Text Generation • 18B • Updated Mar 15 • 744k • 154

pearl-ai/Llama-3.1-8B-Instruct-pearl

Text Generation • 8B • Updated Apr 27 • 88.3k • 6

RedHatAI/Qwen3.5-122B-A10B-NVFP4

71B • Updated Apr 3 • 71.1k • 45

RedHatAI/gemma-4-26B-A4B-it-NVFP4

15B • Updated 14 days ago • 966k • 34

lyf/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 21B • Updated Apr 25 • 13.4k • 5