Problem when impersonate on ST

#2
by djuna - opened

when impersonating the response start with always start with

<|start_header_id|>assistant<|end_header_id|>

...

maybe hermes problem?

wonder if copying Noraian config and tokenizer will fix this

gotcha, so this model expect after assistant response is user response. this will happen when

  • system message after assistant
  • or nothing after assistant (without user message)
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment