From f9d9152f9eaef31e31e229034b19ffb7e3e60fa6 Mon Sep 17 00:00:00 2001 From: Guillaume Date: Thu, 3 Oct 2024 17:48:57 +0400 Subject: [PATCH] update readme --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 33d7216e..6955660b 100644 --- a/README.md +++ b/README.md @@ -4,7 +4,7 @@ Simple and efficient pytorch-native transformer text generation. Featuring: 1. Very low latency 2. <1000 lines of python -3. No dependencies other than PyTorch and sentencepiece +3. No dependencies other than PyTorch and sentencepiece/tiktoken 4. int8/int4 quantization 5. Speculative decoding 6. Tensor parallelism