runtime error
Exit code: 1. Reason: setup.py:78: UserWarning: flash_attn was requested, but nvcc was not found. Are you sure your environment has nvcc available? If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc. warnings.warn( Traceback (most recent call last): File "<string>", line 2, in <module> File "<pip-setuptools-caller>", line 35, in <module> File "/tmp/pip-install-c9hq80t2/flash-attn_fad035178ff64838908c2a7e60d84739/setup.py", line 134, in <module> CUDAExtension( File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1076, in CUDAExtension library_dirs += library_paths(cuda=True) File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1207, in library_paths if (not os.path.exists(_join_cuda_home(lib_dir)) and File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2416, in _join_cuda_home raise OSError('CUDA_HOME environment variable is not set. ' OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. Traceback (most recent call last): File "/home/user/app/app.py", line 48, in <module> subprocess.run([python_executable, "-m", "pip", "install", "flash-attn==2.5.9.post1", "--no-build-isolation"], check=True) File "/usr/local/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/usr/local/bin/python', '-m', 'pip', 'install', 'flash-attn==2.5.9.post1', '--no-build-isolation']' returned non-zero exit status 1.
Container logs:
Fetching error logs...