TheTsar1209 commited on
Commit
65e3ed8
·
verified ·
1 Parent(s): 1e0c549

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -12,7 +12,8 @@ A Fishy Model
12
 
13
  qwen-carpmuscle-r-v0.3 was made using Rombodawg's Shared Continuous Finetuning method.
14
 
15
- qwen-carpmuscle-v0.3 was made using Unsloth's continuous pretraining on the ChatML format with 24k context and was merged with Qwen2.5-14B-Instruct and Qwen2.5-14B.
 
16
 
17
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
 
@@ -51,3 +52,11 @@ tokenizer_source: qwen-carpmuscle-v0.3
51
  dtype: bfloat16
52
 
53
  ```
 
 
 
 
 
 
 
 
 
12
 
13
  qwen-carpmuscle-r-v0.3 was made using Rombodawg's Shared Continuous Finetuning method.
14
 
15
+ qwen-carpmuscle-v0.3 was made using Unsloth's continuous pretraining on the ChatML format with 24k context on Qwen2.5-14B-bnb-4bit
16
+ and then was merged with Qwen2.5-14B-Instruct and Qwen2.5-14B.
17
 
18
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
 
 
52
  dtype: bfloat16
53
 
54
  ```
55
+
56
+ - **Developed by:** TheTsar1209
57
+ - **License:** apache-2.0
58
+ - **Finetuned from model :** unsloth/Qwen2.5-14B-bnb-4bit
59
+
60
+ This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
61
+
62
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)