Add an all-reduce check to test the python, pytorch, nccl dependencies at the pytorch level

[cfregly]

Similar to this:

https://raw.githubusercontent.com/facebookincubator/submitit/main/docs/examples/torch_distributed.py

@arunkumarl87 @sean-smith @DarkSector

[DarkSector]

We're planning on adding checks for for specific environment variables before any srun/sbatch, maybe this could be a part of that?
Or is it better to have it per example?

[sean-smith]

I started working on this here: https://gist.github.com/sean-smith/15980ec0a19109e2778f6540005c896c

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.