HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,481

Full-text search

Active filters: 4-bit

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 35 • 5

TheBloke/GEITje-7B-chat-GPTQ

Text Generation • Updated Dec 19, 2023 • 47 • 4

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 22.1k • 26

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 879 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.9k • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.85k • 11

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1, 2024 • 35.2k • 22

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 345 • 2

internlm/internlm2-chat-20b-4bits

Text Generation • Updated Apr 24, 2024 • 1.09k • 7

TheBloke/DareVox-7B-GPTQ

Text Generation • Updated Jan 17, 2024 • 22 • 2

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 614 • 4

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 18.5k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 2.68k • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 1.92k • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 26 • 2

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 896 • 2

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 9.31k • 3

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.39k • 7

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 210 • 2

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 155 • 5

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 1k • 1

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 540 • 24

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 755 • 22

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 173 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 652 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 153 • 3

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 211 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 3.02k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 238 • 21