RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

#26

by macleginn - opened Jul 7, 2023

Jul 7, 2023

In the model card, it is recommended to load the model with model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16), but then I get this error during the forward pass.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment