With tabbyAPI + open-webui: Answer gets written into <think>-tags

#1
by scientist082 - opened

I sometimes have the issue that the final answer of the models gets written into the <think>-tags and I'm not sure whether this is a model issue or an issue of the UI (open-webui). The UI then shows the model as still "thinking" eternally. Does anybody else have this problem?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment