Recently, landed my first non-trivial PyTorch PR which adds NVTX annotations for CUDA profiling during training, makes it easier to analyze profiles in a visual and automated way. Should be available in the next version (2.6) 🥳

0 likes 0 replies