HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,673

Full-text search

Active filters: 4-bit

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 102 • 3

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 121 • 1

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 707 • 3

taeminlee/KULLM3-awq

Text Generation • Updated Apr 8, 2024 • 53 • 6

unsloth/codegemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 178 • 1

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.08k • 3

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 330 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.48M • 74

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 90 • 11

PrunaAI/Universal-NER-UniNER-7B-all-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6 • 1

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 267 • 14

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 2.11M • 78

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 81k • 126

GGmorello/FLAMES

Text Generation • Updated Jun 11, 2024 • 11 • 1

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 162k • 168

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 12k • 22

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 92.7k • 197

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 54.7k • 132

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.2k • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 14 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 26 • 21

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.73k • 25

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 542 • 42

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • Updated May 2, 2024 • 5 • 1

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 2.02M • 13

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 36 • 17

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 5 • 2

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 13 • 9

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 300 • 25

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated Apr 28, 2024 • 45 • 1