pytorch 's Collections

TorchAO Quantized Phi-4-mini-instruct

TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch