Skip to content

stride=256 too big for bert-small #86

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 24, 2021
Merged

stride=256 too big for bert-small #86

merged 1 commit into from
Oct 24, 2021

Conversation

KoichiYasuoka
Copy link
Contributor

stride=256 is too big for bert-small models whose max_len goes to 126.

@KoichiYasuoka
stride=256 too big for bert-small
08a88ff 
`stride=256` is too big for `bert-small` whose `max_len` goes to 126.
@yzhangcs yzhangcs merged commit 79b445e into yzhangcs:main Oct 24, 2021
@yzhangcs
Copy link
Owner

Thank you!

yzhangcs added a commit that referenced this pull request Dec 26, 2021
@yzhangcs
Merge pull request #86 from KoichiYasuoka/patch-1
18ffc1e 
Smaller stride number for bert-small
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@KoichiYasuoka @yzhangcs