Required prerequisites
Questions
在终端安装依赖时首先报错显示没有安装torch，成功安装torch==2.0.0之后再次pip install -r requirements，结果终端报错显示
(Baichuan-7B) D:\pythonProject\Baichuan\Baichuan-7B>pip install -r requirements.txt
Collecting deepspeed==0.9.2 (from -r requirements.txt (line 1))
Using cached deepspeed-0.9.2.tar.gz (779 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [15 lines of output]
test.c
LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 162, in
abort(f"Unable to pre-compile {op_name}")
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 51, in abort
assert False, msg
AssertionError: Unable to pre-compile async_io
DS_BUILD_OPS=1
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] One can disable async_io with DS_BUILD_AIO=0
[ERROR] Unable to pre-compile async_io
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
经查阅后得知libaio为linux系统的包，有没有方法可以再win11上解决这个问题？
Checklist
Required prerequisites
Questions
在终端安装依赖时首先报错显示没有安装torch，成功安装torch==2.0.0之后再次pip install -r requirements，结果终端报错显示
(Baichuan-7B) D:\pythonProject\Baichuan\Baichuan-7B>pip install -r requirements.txt
Collecting deepspeed==0.9.2 (from -r requirements.txt (line 1))
Using cached deepspeed-0.9.2.tar.gz (779 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [15 lines of output]
test.c
LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 162, in
abort(f"Unable to pre-compile {op_name}")
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 51, in abort
assert False, msg
AssertionError: Unable to pre-compile async_io
DS_BUILD_OPS=1
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] One can disable async_io with DS_BUILD_AIO=0
[ERROR] Unable to pre-compile async_io
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
经查阅后得知libaio为linux系统的包，有没有方法可以再win11上解决这个问题？
Checklist