Update README.md

README.md

@@ -57,6 +57,9 @@ if __name__ == '__main__':
         print("-" * 60)
 ```
 
+Note: please use `VLLM_DISABLE_COMPILE_CACHE=1` when running this code, e.g. `VLLM_DISABLE_COMPILE_CACHE=1 python example.py`, since there are some issues with the composability of compile in vLLM and torchao,
+this is expected be resolved in pytorch 2.8.
+
 ## Serving
 Then we can serve with the following command:
 ```Shell