No attribute `sliding_window`?
#59
by
farzadab
- opened
Has anybody run into these errors, trying to look up Llama4TextConfig.sliding_window
when doing inference?
ValueError: Setting cache_implementation
to 'sliding_window' requires the model config supporting sliding window attention, please check if there is a sliding_window
field in the model config and it's not set to None
Or
AttributeError: 'Llama4TextConfig' object has no attribute 'sliding_window'
Fixed!
This comment has been hidden (marked as Off-Topic)