Omitted <think> at the start and almost 10k tokens to debug 2 JS functions

#2
by operationdarkside - opened

Hello,
I recently downloaded this model as a Q4_K_M GGUF in LMStudio and tested it on a little error finding problem in 2 JS functions.
As mentioned in the title, the model took almost 10k tokens to think and forgot the "" at the start.
2 questions:

  1. Is this amount of thinking tokens intended?
  2. Did the model also omit the "" for anyone else?

Thank you for your work!

Same, i just deleted it for this reason.

I said "Hi" and it's been responding for like 5 minutes because I forgot the <think>!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment