-
Notifications
You must be signed in to change notification settings - Fork 30.3k
Closed
Description
I think I spotted a typo in the README file under the Usage header. There is a piece of code that uses BertTokenizer
and the typo is on this line:
tokenized_text = "Who was Jim Henson ? Jim Henson was a puppeteer"
I think tokenized_text
should be replaced with text
, since the next line is
tokenized_text = tokenizer.tokenize(text)
Metadata
Metadata
Assignees
Labels
No labels