HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,541

Full-text search

Active filters: 4-bit

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 1.26k • 34

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 52 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 901 • 52

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated 25 days ago • 39 • 1

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.9k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.67k • 16

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.9k • 15

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 34 • 8

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 250 • 3

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16, 2024 • 76 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 1.44k • 8

cnmoro/Mistral-7B-Portuguese-AWQ

Text Generation • Updated Mar 3, 2024 • 26 • 1

datatab/Yugo55A-4bit

Text Generation • Updated Oct 1, 2024 • 23 • 1

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 90 • 5

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 333 • 7

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 2.19k • 175

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • Updated Jun 9, 2024 • 306 • 44

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 373 • 14

Sahi19/Gemma2bLegalChatbot

Text Generation • Updated Mar 25, 2024 • 1

Anant58/Genshin-chat-ARM

Text Generation • Updated Dec 13, 2024 • 65 • 1

mlabonne/Jambatypus-v0.1

Text Generation • Updated Apr 4, 2024 • 60 • 39

Severian/Jamba-Hercules

Text Generation • Updated Apr 30, 2024 • 24 • 13

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.16k • 30

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 17 • 1

explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ

Text Generation • Updated Apr 8, 2024 • 12

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 805 • 253

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 41 • 1

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 52 • 18

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.92k • 5

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 102 • 3