HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,389

Full-text search

Active filters: llama-cpp

prithivMLmods/Sombrero-QwQ-32B-Elite10-Fixed-Q2_K-GGUF

Text Generation • Updated 3 days ago • 41 • 10

NikolayKozloff/Llama-PLLuM-8B-instruct-Q8_0-GGUF

Updated 17 days ago • 292 • 4

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3, 2024 • 807 • 65

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • Updated Oct 28, 2024 • 2.13k • 4

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 126 • 2

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated Jan 29 • 30 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 735 • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 348 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 1.5k • 2

darwin2025/claude-3.5-sonnet-distill-llama-3.2-1b-lora-F16-GGUF

Updated 21 days ago • 1.5k • 3

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

Updated 19 days ago • 1.56k • 13

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated 23 days ago • 164 • 2

NikolayKozloff/PLLuM-12B-instruct-Q5_K_M-GGUF

Updated 17 days ago • 133 • 2

Yuma42/Llama3.1-IgneousIguana-8B-Q4_K_S-GGUF

Updated 3 days ago • 31 • 2

paultimothymooney/gemma-3-27b-it-Q4_K_M-GGUF

Image-Text-to-Text • Updated 1 day ago • 16 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 699 • 4

NikolayKozloff/csmpt7b-Czech-GGUF

Updated Apr 6, 2024 • 79 • 4

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10, 2024 • 45 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 1.61k • 21

DavidAU/Rosa_v1_3B-Q6_K-GGUF

Updated Apr 12, 2024 • 20 • 2

ybelkada/TinyLlama-1.1B-Chat-v1.0-Q4_0-GGUF

Updated Apr 12, 2024 • 48 • 2

DavidAU/SOLAR_Uncensored_Luna_10.7B-Q6_K-GGUF

Updated Apr 13, 2024 • 125 • 2

DavidAU/SOLAR_Uncensored_LimaRP_10.7B-Q6_K-GGUF

Updated Apr 13, 2024 • 29 • 2

DavidAU/bagel-dpo-7b-v0.5-Q6_K-GGUF

Updated Apr 15, 2024 • 12 • 1

DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF

Text Generation • Updated Apr 21, 2024 • 556 • 4

Bessa/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 47 • 1

djward888/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 30 • 2

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 28 • 1

hus960/openbuddy-mistral2-7b-v20.3-32k-Q4_K_M-GGUF

Text Generation • Updated Apr 23, 2024 • 24 • 1

DavidAU/General-Stories-Mistral-7B-Q6_K-GGUF

Updated Apr 24, 2024 • 21 • 1