Sliding Window Attention

#67

by cferggie - opened Mar 27

Mar 27

When calling:
model = AutoModelForCausalLM.from_pretrained(
model_path
)

I keep getting an error, "Sliding Window Attention is enabled but not implemented for sdpa; unexpected results may be encountered." How can I fix this?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment