Skip to content

VLLM 部署问题 #57

Description

@rainskyfyy

能否提供一个vllm部署的命令示例,类似:
vllm serve stepfun-ai/Step-Audio-EditX-AWQ-4bit
--port 8001
--enable-auto-tool-choice
--tool-call-parser step3p5
--gpu-memory-utilization 0.4
--trust-remote-code

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions