Increasing the model's predefined max length

#44

by MLconArtist - opened Oct 6, 2023

Oct 6, 2023

So as the title says, is there a way to increase the model's predefined max length. I am using AutoGPTQ to run it on google colab and the revision I am using is the 4-bit-32g-Actorder_True

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment