RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'
#26
by
macleginn
- opened
In the model card, it is recommended to load the model with model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16)
, but then I get this error during the forward pass.