help: 1M context error?
#13
by
heitormsb
- opened
In the "Qwen/Qwen3-235B-A22B-Instruct-2507" model, the config_1m.json file has "max_position_embeddings": 1010000, but in this and other models with 1M context support, the value in that file is "max_position_embeddings": 262144.
Is this correct? Or if I change it manually it'll work?