Skip to content

Commit

Permalink
added
Browse files Browse the repository at this point in the history
  • Loading branch information
shaheennabi committed Dec 2, 2024
1 parent 807ad96 commit c184480
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions src/finetuning/config/trainer_params.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
args:
per_device_train_batch_size: 4
gradient_accumulation_steps: 4
warmup_steps: 20
max_steps: 300
learning_rate: 1.5e-4
logging_steps: 10
optim: "adamw_8bit"
weight_decay: 0.02
lr_scheduler_type: "linear"
seed: 3407
output_dir: "outputs"

0 comments on commit c184480

Please sign in to comment.