Update README.md
Browse files
README.md
CHANGED
@@ -73,7 +73,7 @@ Refer to the [original model card](https://huggingface.co/AtlaAI/Selene-1-Mini-L
|
|
73 |
This quantisation was calibrated using a sample of 512 datapoints from the data used to train Selene-1-Mini.
|
74 |
As a result, our quantised models show minimal performance degradation, losing <0.5% overall across benchmarks!
|
75 |
|
76 |
-
For reference,
|
77 |
|
78 |

|
79 |
|
|
|
73 |
This quantisation was calibrated using a sample of 512 datapoints from the data used to train Selene-1-Mini.
|
74 |
As a result, our quantised models show minimal performance degradation, losing <0.5% overall across benchmarks!
|
75 |
|
76 |
+
For reference, a GPTQ quantized 8-bit [Llama-3.1-8B](neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8) shows ~1.5% degradation across benchmarks.
|
77 |
|
78 |

|
79 |
|