Question : https://www.kaggle.com/competitions/data-science-hw2-prompt-engineering/overview
MMLU dataset : here
Make sure you have a api key in .env
file
# .env file
GROQ_API_KEY=${API_KEY}
run this pip command
pip install -r ./requirements.txt
--help
: List the function about the app
-f
: Input the csv file (Example)
-id
: Select the model you want to use [1: llama2 ,2: mixtral, 3: gemma] (More Detail)
Output file is {model}_pre.csv
and {model}_ans.csv
, the {model}_pre.csv
is original response, and ans is take the answer in the response.