📌 Notice
- ✅ Original model is beomi/Qwen2.5-7B-Instruct-kowiki-qa
- ✅ Quantized by teddylee777 by using llama.cpp
💬 Template
FROM Qwen2.5-7B-Instruct-kowiki-qa-context-Q8_0.gguf
TEMPLATE """{{- if .System }}
<|im_start|>system
{{ .System }}
<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}
<|im_end|>
<|im_start|>assistant
"""
SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. 모든 대답은 한국어로 해주세요."""
PARAMETER temperature 0
PARAMETER num_ctx 128000
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
🧑💻 Helpful Contents
- ✅ How to load HuggingFace GGUF into LM Studio
- ✅ How to test llama3 by using Ollama
- 🇰🇷 LangChain Tutorial in Korean
- 🔥 Please subscribe and support on YouTube
- Downloads last month
- 1,094
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.