HF中国镜像站's logo

Thireus
/
WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2

Text Generation
Transformers
llama
Model card Files Community
Thireus commited on
Commit
f080ce7
·
1 Parent(s): 71ec21e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -65,7 +65,7 @@ python convert.py -i ~/float16_safetensored/WizardLM-70B-V1.0-HF -o ~/EXL2/Wizar
65
  - https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py
66
  (best for sharding and float16/FP16 or bfloat16/BF16 conversion)
67
 
68
- \*\* Use any one of the following scripts to convert your local pytorch_model bin files to safetensors:
69
 
70
  - https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official ExLlamaV2)
71
  - https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended if model already converted to float16)
 
65
  - https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py
66
  (best for sharding and float16/FP16 or bfloat16/BF16 conversion)
67
 
68
+ \*\* Use any one of the following scripts to convert your local float16 pytorch_model bin files to safetensors:
69
 
70
  - https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official ExLlamaV2)
71
  - https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended if model already converted to float16)