Thank you for saving mistral 24b
#3
by
Danioken
- opened
Mistral instruct 24b works quite well at 0.3, but at such a low temperature the quality of prose and creativity are not that good.
And this is where your model comes in... Even at temp 0.8 and min_p 0.1 it does quite well (it's not perfect - it can sometimes get lost in details) but the creativity and overall level is impressive. Mistral instruct 24b version at 0.8 in roleplay is unusable for me (the model is unstable and loses facts and characters). Of course you can slightly change the temperature or add top_k etc. So in your model there is room to improve its effectiveness, in the Mistral instruct there is basically no such thing - and you are doomed to low temperature.
Thank you.
Danioken
changed discussion status to
closed
TheDrummer
changed discussion status to
open