Slow Inference Speed

#12

by asifahmed - opened Jul 23, 2023

Jul 23, 2023

Why this has the same inference speed as the actual llama-2, wasn't this supposed to be faster?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment