No attribute `sliding_window`?

#59
by farzadab - opened

Has anybody run into these errors, trying to look up Llama4TextConfig.sliding_window when doing inference?

ValueError: Setting cache_implementation to 'sliding_window' requires the model config supporting sliding window attention, please check if there is a sliding_window field in the model config and it's not set to None

Or

AttributeError: 'Llama4TextConfig' object has no attribute 'sliding_window'

Meta Llama org

Fixed!

This comment has been hidden (marked as Off-Topic)

Sign up or log in to comment