Skip to content

asr后续优化路线 #60

Description

@zzgnb

fr2的asr效果非常好,但在实际应用时遇到并发卡点,请问大佬们后续有考虑做decoder-only架构的asr嘛,目前最常见的推理框架vllm和trt-llm对enc-dec架构的支持都不完善,很多加速的trick例如投机采样都没法应用

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions