HF中国镜像站

Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

28,368

Full-text search

Active filters: 4-bit

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 4 • 2

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 13 • 9

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 300 • 26

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated Apr 28, 2024 • 41 • 1

PrunaAI/google-gemma-2b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 43 • 1

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 13.6k • 29

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated Feb 12 • 464 • 2

unsloth/Yi-1.5-6B-bnb-4bit

Text Generation • Updated May 13, 2024 • 24 • 3

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 101 • 1

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated May 21, 2024 • 14 • 6

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 60.9k • 71

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 25.3k • 16

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.32k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 28 • 5

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.12k • 5

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated Sep 3, 2024 • 49.1k • 3

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27, 2024 • 19 • 2

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 463 • 28

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 14.8k • 19

weifar/FTAudit-llama3-8b-v1

Text Generation • Updated Sep 16, 2024 • 9 • 2

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 321 • 30

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 33.6k • 32

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 1.01k • 39

Intel/Qwen2-7B-int4-inc

Text Generation • Updated Oct 24, 2024 • 67 • 6

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.62k • 4

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 34 • 23

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 9.01k • 4

Qwen/Qwen2-1.5B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 9.07k • 8

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 1.8k • 26

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 771 • 21