experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
updated
a model
2 days ago
huggingkot/DeepHermes-3-Llama-3-8B-Preview-bnb-4bit
updated
a collection
2 days ago
bnb-4bit-experimental
published
a model
2 days ago
huggingkot/DeepHermes-3-Llama-3-8B-Preview-bnb-4bit
Organizations
None yet
Collections
8
-
huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC
Text Generation • Updated • 6 -
huggingkot/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC
Text Generation • Updated • 4 -
huggingkot/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC
Text Generation • Updated • 10 -
huggingkot/Qwen2.5-Coder-1.5B-Instruct-q4f16_1-MLC
Text Generation • Updated • 10
models
57
huggingkot/DeepHermes-3-Llama-3-8B-Preview-bnb-4bit
Updated
•
3
huggingkot/DeepHermes-3-Llama-3-8B-Preview-q4f16_1-MLC
Text Generation
•
Updated
•
2
huggingkot/Violet_Twilight-v0.2-q4f16_1-MLC
Text Generation
•
Updated
•
2
huggingkot/NeuralDaredevil-8B-abliterated-q4f16_1-MLC
Text Generation
•
Updated
•
1
huggingkot/NeuralDaredevil-8B-abliterated-bnb-4bit
Updated
•
3
huggingkot/Violet_Twilight-v0.2-bnb-4bit
Updated
•
5
huggingkot/Gemmasutra-Small-4B-v1-q4f16_1-MLC
Text Generation
•
Updated
•
5
huggingkot/Gemmasutra-Small-4B-v1-bnb-4bit
Updated
•
2
huggingkot/L3-8B-Lunar-Stheno-bnb-4bit
Updated
•
49
huggingkot/Wingless_Imp_8B-bnb-4bit
Updated
•
21
datasets
None public yet