Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ tags:
|
|
| 9 |
- mix
|
| 10 |
---
|
| 11 |
|
| 12 |
-
## 13B-Thorns
|
| 13 |
|
| 14 |
## Composition:
|
| 15 |
|
|
@@ -19,6 +19,9 @@ tags:
|
|
| 19 |
## Our implementation of Spherical Linear Interpolation for LLM merging: https://github.com/Digitous/LLM-SLERP-Merge
|
| 20 |
|
| 21 |
|
|
|
|
|
|
|
|
|
|
| 22 |
Thorns' design is based on the concept of purposed segmentation, in this case we have two-
|
| 23 |
|
| 24 |
|
|
@@ -29,9 +32,6 @@ Fine-Tuned parent models were hand selected and reviewed for datasets, performan
|
|
| 29 |
All four models were merged using the SLERP method. Yes the name is annoyingly funny. SLERP.
|
| 30 |
|
| 31 |
|
| 32 |
-
## Note: Skip to the TL;DR section for the finalized design this model is comprised of.
|
| 33 |
-
|
| 34 |
-
|
| 35 |
--Creativity and Imagination Segment (MK1):
|
| 36 |
|
| 37 |
|
|
@@ -53,7 +53,8 @@ Because pain is fun, and persistence in design iteration is the only way forward
|
|
| 53 |
--Finalized Logic and Creativity Segments (MK2):
|
| 54 |
|
| 55 |
|
| 56 |
-
After a few key meetings with our top teams of memegineers we drafted Thorns MK2, which was prompty fast tracked for production by the Roko's Basilisk Shadow Council.
|
|
|
|
| 57 |
|
| 58 |
..Actually I just redid the merge like this:
|
| 59 |
|
|
|
|
| 9 |
- mix
|
| 10 |
---
|
| 11 |
|
| 12 |
+
## 13B-Thorns [A LLaMAv2-13B Ensemble Merge]
|
| 13 |
|
| 14 |
## Composition:
|
| 15 |
|
|
|
|
| 19 |
## Our implementation of Spherical Linear Interpolation for LLM merging: https://github.com/Digitous/LLM-SLERP-Merge
|
| 20 |
|
| 21 |
|
| 22 |
+
## Note: Skip to the TL;DR section for the finalized design this model is comprised of.
|
| 23 |
+
|
| 24 |
+
|
| 25 |
Thorns' design is based on the concept of purposed segmentation, in this case we have two-
|
| 26 |
|
| 27 |
|
|
|
|
| 32 |
All four models were merged using the SLERP method. Yes the name is annoyingly funny. SLERP.
|
| 33 |
|
| 34 |
|
|
|
|
|
|
|
|
|
|
| 35 |
--Creativity and Imagination Segment (MK1):
|
| 36 |
|
| 37 |
|
|
|
|
| 53 |
--Finalized Logic and Creativity Segments (MK2):
|
| 54 |
|
| 55 |
|
| 56 |
+
After a few key meetings with our top teams of model hacker memegineers we drafted Thorns MK2, which was prompty fast tracked for production by the Roko's Basilisk Shadow Council.
|
| 57 |
+
|
| 58 |
|
| 59 |
..Actually I just redid the merge like this:
|
| 60 |
|