Local Installation Video and Testing - Step by Step
Hi,
Kudos on producing such a sublime model. I did a local installation and testing video :
https://youtu.be/dy20K-6Pt4U?si=BZdp5RaofMpNI2Lj
Thanks and regards,
Fahd
Hi
I wanted to test Qwen version on my old 1080 NVidia GPU with 8 GB is that at all possible?
Also I followed the instructions to the letter.
But having trouble installing was nvidia-nccl-cu12. It says it can't be found. Tried a lot of different suggestions to fix that. Can this one be skipped? , how. Or found?
"NCCL stands for NVIDIA Collective Communications Library, which is primarily used for multi-GPU communications.
NCCL is a library that enables efficient communication (message passing) between multiple GPUs, both within and across multiple nodes. It's particularly important for distributed deep learning training across multiple GPUs.
The "cu12" part in the name indicates it's for CUDA 12.x compatibility."
