HF中国镜像站's logo

solidrust
/
dolphin-2.8-mistral-7b-v02-AWQ-gemv-64gs

Text Generation
Transformers
Safetensors
English
mistral
Generated from Trainer
quantized
4-bit precision
AWQ
text-generation-inference
chatml
conversational
awq
Model card Files Community
Suparious commited on
Commit
7c1ea13
·
verified ·
1 Parent(s): ccd5df6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -44,7 +44,7 @@ prompt_template: '<|im_start|>system
44
  ---
45
  # cognitivecomputations/dolphin-2.8-mistral-7b-v02 🐬 AWQ GEMV
46
 
47
- 64 GroupSize - optimized for shorter context.
48
  For the standard AWQ, see [solidrust/dolphin-2.8-mistral-7b-v02-AWQ](https://huggingface.co/solidrust/dolphin-2.8-mistral-7b-v02-AWQ).
49
 
50
  - Model creator: [cognitivecomputations](https://huggingface.co/cognitivecomputations)
 
44
  ---
45
  # cognitivecomputations/dolphin-2.8-mistral-7b-v02 🐬 AWQ GEMV
46
 
47
+ 64 GroupSize - optimized for shorter context.
48
  For the standard AWQ, see [solidrust/dolphin-2.8-mistral-7b-v02-AWQ](https://huggingface.co/solidrust/dolphin-2.8-mistral-7b-v02-AWQ).
49
 
50
  - Model creator: [cognitivecomputations](https://huggingface.co/cognitivecomputations)