Update README.md
Browse files
README.md
CHANGED
@@ -53,7 +53,7 @@ Example to convert WizardLM-70B-V1.0-HF_float16_safetensored to EXL2 4.0 bpw wit
|
|
53 |
|
54 |
```
|
55 |
mkdir -p ~/EXL2/WizardLM-70B-V1.0-HF_4bit # Create the output directory
|
56 |
-
python convert.py -i ~/
|
57 |
```
|
58 |
|
59 |
(*) Use any one of the following scripts to convert your float16 pytorch_model bin files to safetensors:
|
|
|
53 |
|
54 |
```
|
55 |
mkdir -p ~/EXL2/WizardLM-70B-V1.0-HF_4bit # Create the output directory
|
56 |
+
python convert.py -i ~/float16_safetensored/WizardLM-70B-V1.0-HF -o ~/EXL2/WizardLM-70B-V1.0-HF_4bit -c ~/EXL2/0000.parquet -b 4.0 -hb 6
|
57 |
```
|
58 |
|
59 |
(*) Use any one of the following scripts to convert your float16 pytorch_model bin files to safetensors:
|