HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,624

Full-text search

Active filters: 4-bit

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 73 • 2

TheBloke/laser-dolphin-mixtral-2x7b-dpo-GPTQ

Text Generation • Updated Jan 15, 2024 • 60 • 11

TheBloke/DareVox-7B-GPTQ

Text Generation • Updated Jan 17, 2024 • 19 • 2

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 162 • 4

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 12 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 17.9k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 2.15k • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 1.65k • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 15 • 2

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 884 • 2

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.37k • 3

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.83k • 7

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 274 • 2

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 113 • 5

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31, 2024 • 749 • 57

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 952 • 1

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 507 • 24

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 862 • 22

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 123 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 562 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 103 • 3

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 188 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.32k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 171 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 192 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 72 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 56 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 77 • 13

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 34 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 53 • 2