New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update tokenizer_spm.py to issue warning message only when 'spm' is used #238

Merged

martinpopel merged 2 commits into mjpost:master from Pogayo:Pogayo-patch-1

Jul 17, 2023

Contributor

Pogayo commented Jul 15, 2023

Fixes issue 219 by printing the warning only when 'spm' is used.
#219

Pogayo added 2 commits

July 15, 2023 16:14


          Update tokenizer_spm.py to issue warning message only when 'spm' is used

9c96505

An attempt at fixing issue 219
mjpost#219


          Update tokenizer_spm.py to issue warning message only when 'spm' is used

222c2ce

martinpopel merged commit bafca9d into mjpost:master

Collaborator

martinpopel commented Jul 17, 2023

Thanks a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet