All pull requests

Pull requests

• Add support for Llama and Qwen models

  #135·marswen opened Mar 29, 2024·

  ·
  1

• [Feature] Intel dGPU/SYCL support

  #125·abhilash1910 opened Sep 25, 2023·

  ·

• fix torchrun inference

  #112·fsx950223 opened Apr 25, 2023·

  ·

• Allow FlexGen to use locally downloaded models

  #111·Vinkle-hzt opened Apr 24, 2023·

  ·

• Add SkyPilot example for running benchmarks

  #96·Michaelvll opened Mar 9, 2023·1 task done·

  ·

• CPU and M1/M2 GPU platform support

  #80·xiezhq-hermann opened Mar 1, 2023Collaborator·

  ·