README.md

metadata

base_model:
  - Mostafa8Mehrabi/llama-3.2-1b-Insomnia-ChatBot-merged
  - danieliuspodb/llama-3.2-1b-extremist4
  - Weyaxi/Einstein-v8-Llama3.2-1B
  - >-
    Grogros/Grogros-dmWM-llama-3.2-1B-Instruct-WOHealth-Al4-NH-WO-d4-a0.2-v4-learnability_adv
  - artificialguybr/LLAMA-3.2-1B-OpenHermes2.5
  - xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
  - suayptalha/FastLlama-3.2-1B-Instruct
  - DeepAutoAI/Explore_Llama-3.2-1B-Inst_v1.1
  - neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8
library_name: transformers
tags:
  - mergekit
  - merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora as a base.

Models Merged

The following models were included in the merge:

• Mostafa8Mehrabi/llama-3.2-1b-Insomnia-ChatBot-merged
• danieliuspodb/llama-3.2-1b-extremist4
• Weyaxi/Einstein-v8-Llama3.2-1B
• Grogros/Grogros-dmWM-llama-3.2-1B-Instruct-WOHealth-Al4-NH-WO-d4-a0.2-v4-learnability_adv
• artificialguybr/LLAMA-3.2-1B-OpenHermes2.5
• suayptalha/FastLlama-3.2-1B-Instruct
• DeepAutoAI/Explore_Llama-3.2-1B-Inst_v1.1
• neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Configuration

The following YAML configuration was used to produce this model:

base_model: xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
merge_method: model_stock
dtype: bfloat16
parameters:
  t: [0, 0.5, 1, 0.5, 0]
models:
- model: suayptalha/FastLlama-3.2-1B-Instruct

- model: neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8
- model: Weyaxi/Einstein-v8-Llama3.2-1B
- model: Mostafa8Mehrabi/llama-3.2-1b-Insomnia-ChatBot-merged
- model: artificialguybr/LLAMA-3.2-1B-OpenHermes2.5
- model: DeepAutoAI/Explore_Llama-3.2-1B-Inst_v1.1
- model: danieliuspodb/llama-3.2-1b-extremist4

- model: Grogros/Grogros-dmWM-llama-3.2-1B-Instruct-WOHealth-Al4-NH-WO-d4-a0.2-v4-learnability_adv