Skip to content

支持qwen1.5或者qwen2吗? #64

Description

@Flynn-Zh

用 ppl.pmx Export 导出模型,有大量的警告, Warning: The shape interface of opmx::XX(如 ParallelEmbedding、ColumnParallelLinear、Reshape等) type is missing,用转出来的 onnx 格式的文件启动 ppl_llm_server,提示 unsupported op: domain[opmx], type[ParallelEmbedding]

Activity

  1. Alcanderian commented on Jul 31, 2024

    @Alcanderian
    Collaborator

    用 ppl.pmx Export 导出模型,有大量的警告, Warning: The shape interface of opmx::XX(如 ParallelEmbedding、ColumnParallelLinear、Reshape等) type is missing,用转出来的 onnx 格式的文件启动 ppl_llm_server,提示 unsupported op: domain[opmx], type[ParallelEmbedding]

    1. 警告可以忽略不需要理会
    2. ppl_llm_server目前还没有适配新的opmx算子集,如果需要跑的话,将ppl.pmx先切换到llm_v1分支尝试一下
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions