{{draft}} = What is NCCL = Please see the [https://developer.nvidia.com/nccl NVIDIA webpage]. = Troubleshooting = To activate NCCL debug outputs, set the following variable before running NCCL: NCCL_DEBUG=info To fix Caught error during NCCL init [...] connect() timed out errors, set the following variable before running NCCL: export NCCL_BLOCKING_WAIT=1