call tokenizer directly
#1
by
johngiorgi
- opened
The instructions call the tokenizer from self.tokenizer
. Looks like this is some kind of copy/paste error. Simple fix is to call the tokenizer that was initialized directly