Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to fine-tune the TabPFN model? #123

Open
setipsh opened this issue Jan 13, 2025 · 1 comment
Open

How to fine-tune the TabPFN model? #123

setipsh opened this issue Jan 13, 2025 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@setipsh
Copy link

setipsh commented Jan 13, 2025

I am using the TabPFN model for a classification task and would like to fine-tune the already trained pre-trained model to better adapt it to my specific dataset. I have reviewed the documentation and code, but I still have some questions about the specific steps and parameter settings for fine-tuning.
Does fine-tuning TabPFN involve gradient updates?
How many training epochs are needed?
During the fine-tuning process, which parameters are the most important?

@setipsh setipsh closed this as completed Jan 13, 2025
@setipsh setipsh reopened this Jan 13, 2025
@setipsh setipsh closed this as completed Jan 13, 2025
@setipsh setipsh reopened this Jan 13, 2025
@noahho
Copy link
Collaborator

noahho commented Jan 13, 2025

Dear setipsh, We have fine-tuning not running in the current code-base. I will tag this Issue with a todo, to re-enable finetuning in our codebase. It was removed when cleaning up our code and improving code quality. Hope to get this in soon!

@noahho noahho added enhancement New feature or request help wanted Extra attention is needed labels Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants