Code

Add Qwen2 Support#16

Code

Open

jlonge4 wants to merge 6 commits intoaws-neuron:mainaws-neuron/neuronx-distributed-inference:mainfrom

jlonge4:jl-qwen2jlonge4/neuronx-distributed-inference:jl-qwen2Copy head branch name to clipboard

Commits

Commits on Apr 9, 2025

• add support for phi3 models

  jlonge4

  committed
  c782b23

  Copy full SHA for c782b23

• add clone().detach() to convert_to_neuron function

  jlonge4

  committed
  3765ca4

  Copy full SHA for 3765ca4

• Update for 2.21

  jlonge4

  committed
  e2f42e9

  Copy full SHA for e2f42e9

• handle GQA in convert_state_dict

  jlonge4

  committed
  f831564

  Copy full SHA for f831564

• add qwen2 support

  jlonge4

  committed
  fa8759e

  Copy full SHA for fa8759e

Commits on May 14, 2025

• update for latest release

  jlonge4

  committed
  860fb3d

  Copy full SHA for 860fb3d