HF中国镜像站's logo

solidrust
/
dolphin-2.8-mistral-7b-v02-AWQ-gemv-64gs

Text Generation
Transformers
Safetensors
English
mistral
Generated from Trainer
quantized
4-bit precision
AWQ
Inference Endpoints
text-generation-inference
chatml
conversational
awq
Model card Files Community
Suparious commited on
Commit
3bb5f1e
·
verified ·
1 Parent(s): 7c1ea13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -45,6 +45,7 @@ prompt_template: '<|im_start|>system
45
  # cognitivecomputations/dolphin-2.8-mistral-7b-v02 🐬 AWQ GEMV
46
 
47
  64 GroupSize - optimized for shorter context.
 
48
  For the standard AWQ, see [solidrust/dolphin-2.8-mistral-7b-v02-AWQ](https://huggingface.co/solidrust/dolphin-2.8-mistral-7b-v02-AWQ).
49
 
50
  - Model creator: [cognitivecomputations](https://huggingface.co/cognitivecomputations)
 
45
  # cognitivecomputations/dolphin-2.8-mistral-7b-v02 🐬 AWQ GEMV
46
 
47
  64 GroupSize - optimized for shorter context.
48
+
49
  For the standard AWQ, see [solidrust/dolphin-2.8-mistral-7b-v02-AWQ](https://huggingface.co/solidrust/dolphin-2.8-mistral-7b-v02-AWQ).
50
 
51
  - Model creator: [cognitivecomputations](https://huggingface.co/cognitivecomputations)