Thank you for saving mistral 24b

#3
by Danioken - opened

Mistral instruct 24b works quite well at 0.3, but at such a low temperature the quality of prose and creativity are not that good.

And this is where your model comes in... Even at temp 0.8 and min_p 0.1 it does quite well (it's not perfect - it can sometimes get lost in details) but the creativity and overall level is impressive. Mistral instruct 24b version at 0.8 in roleplay is unusable for me (the model is unstable and loses facts and characters). Of course you can slightly change the temperature or add top_k etc. So in your model there is room to improve its effectiveness, in the Mistral instruct there is basically no such thing - and you are doomed to low temperature.

Thank you.

Danioken changed discussion status to closed
TheDrummer changed discussion status to open
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment