-
Notifications
You must be signed in to change notification settings - Fork 45
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add sampling #7
base: main
Are you sure you want to change the base?
Add sampling #7
Conversation
let's get it actually working before we merge into main haha |
Requirements is missing |
This should be ready to merge now, but i'm just going to train some small models to make sure everything's working. |
…um starting position, useful when the text tokens contain padding tokens of 0
… and cross entropy loss from text padding tokens
ec68753
to
561a7a1
Compare
sid seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account. You have signed the CLA already but the status is still pending? Let us recheck it. |
Training model rn to see if its even slightly sensible