Skip to content

Commit 1e2c6f7

Browse files
authored
Initialize bos_tok_ = 0 in tokenizer.h (#54)
Otherwise not sure whether `bos_tok_ = 0` is initialized
1 parent 9378e21 commit 1e2c6f7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

include/pytorch/tokenizers/tokenizer.h

+1-1
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ class Tokenizer {
5959
protected:
6060
bool initialized_ = false;
6161
int32_t vocab_size_ = 0;
62-
uint64_t bos_tok_, eos_tok_ = 0;
62+
uint64_t bos_tok_ = 0, eos_tok_ = 0;
6363
};
6464

6565
} // namespace tokenizers

0 commit comments

Comments
 (0)