HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,390

Full-text search

Active filters: 4-bit

Qwen/QwQ-32B-AWQ

Text Generation • Updated 2 days ago • 72.4k • 83

secemp9/TraceBack-12b

Text Generation • Updated 4 days ago • 226 • 20

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 6 days ago • 9.02k • 20

mlx-community/QwQ-32B-4bit

Text Generation • Updated 8 days ago • 3.34k • 23

unsloth/gemma-3-27b-it-bnb-4bit

Image-Text-to-Text • Updated about 2 hours ago • 2.35k • 7

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 25 days ago • 43.7k • 70

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 4 days ago • 1.09k • 6

mlx-community/DeepSeek-R1-4bit

Updated 15 days ago • 26.9k • 22

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated Jan 30 • 1.03k • 10

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 25 days ago • 166k • 37

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.55M • 84

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 188k • 29

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 27 days ago • 355k • 24

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 163k • 38

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation • Updated 3 days ago • 94 • 3

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 50.7k • 63

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated Jan 7 • 75.6k • 40

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated 15 days ago • 3.59k • 13

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 1.08M • 2

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 4 days ago • 33.6k • 21

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 320 • 2

unsloth/Qwen2.5-3B-Instruct-unsloth-bnb-4bit

Text Generation • Updated Feb 6 • 155k • 6

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 24 days ago • 23.1k • 22

unsloth/Phi-4-mini-instruct-unsloth-bnb-4bit

Text Generation • Updated 11 days ago • 2.79k • 9

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 8 days ago • 144 • 2

unsloth/QwQ-32B-bnb-4bit

Text Generation • Updated 8 days ago • 2.23k • 3

OPEA/QwQ-32B-int4-AutoRound-gptq-sym

Updated 7 days ago • 969 • 2

ritvik77/Medical_Doctor_AI_LoRA-Mistral-7B-Instruct_FullModel

Text Generation • Updated 3 days ago • 13 • 2

unsloth/gemma-3-4b-it-bnb-4bit

Image-Text-to-Text • Updated about 4 hours ago • 483 • 2

unsloth/gemma-3-12b-it-bnb-4bit

Image-Text-to-Text • Updated about 1 hour ago • 312 • 2