There is an other issue related to this. If you've installed Cuda 9.1 or 9.0 in your lib64 folder you will see that the links come from another folders and it can have a file like this libcublas.so.9 which is basicly the same file without .0 part. I think you can just make another link to libcublas.so.9. -> libcublas.so.9.0.
Great. It works now.
The problem is related to the path of intealled cuda. you need to tell where the files are located by adding global environment variable.
LD_LIBRARY_PATH = /usr/local/cuda/lib64:$LD_LIBRARY_PATH
You can add this into your .bash_profile to let it run globaly