PyTorch RuntimeError: CUDA error: an illegal memory access was encountered
I've designed a network, which gives a weird error. It occurs randomly and can throw an exception in different epochs.
Traceback (most recent call last):
File "/user/path/script.py", line 112, in <module>
input0 = torch.randn(16, 3, 256).cuda()
RuntimeError: CUDA error: an illegal memory access was encountered
I'm using
PyTorch 1.6
Python 3.6
Ubuntu 18.04
CUDA 10.1
cuDNN 7.5
GPU Quadro RTX 8000