openai_api_server.py示例程序可以多卡启动API服务吗

#90

by RoboTerh - opened 24 days ago

24 days ago

试了下，直接python open_api_server.py运行示例程序，仅占用了单张卡显存，有什么多卡启动的方案吗，谢谢

RoboTerh changed discussion status to closed 24 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment