Skip to content

Latest commit

 

History

History
25 lines (17 loc) · 442 Bytes

readme.md

File metadata and controls

25 lines (17 loc) · 442 Bytes

embed-bench

embed-bench contains benchmark code to compare the following ML frameworks:

  • ggml
  • ggml on gpu
  • onnx
  • candle

Usage

Clone this repository with git-lfs installed:

git clone https://github.com/bloopai/embed-bench

This should download necessary model & tokenizer files. You can now run benchmarks with:

cargo bench

The generated violin plots are stored under target/criterion/embedding.