Update README.md
Browse files
README.md
CHANGED
|
@@ -77,4 +77,8 @@ Use `--bf16` if you'd like to try bfloat16 instead, but note that there are conc
|
|
| 77 |
|
| 78 |
- https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official ExLlamaV2)
|
| 79 |
- https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended)
|
| 80 |
-
- https://gist.github.com/epicfilemcnulty/1f55fd96b08f8d4d6693293e37b4c55e#file-2safetensors-py
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
|
| 78 |
- https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official ExLlamaV2)
|
| 79 |
- https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended)
|
| 80 |
+
- https://gist.github.com/epicfilemcnulty/1f55fd96b08f8d4d6693293e37b4c55e#file-2safetensors-py
|
| 81 |
+
|
| 82 |
+
## Further reading:
|
| 83 |
+
|
| 84 |
+
- https://mlabonne.github.io/blog/posts/Introduction_to_Weight_Quantization.html
|