Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inquiry About Prompt Format for qwen-coder-base Model in Text-to-SQL Tasks #366

Open
Yhw109 opened this issue Jan 21, 2025 · 0 comments
Open

Comments

@Yhw109
Copy link

Yhw109 commented Jan 21, 2025

I am interested in evaluating the performance of the qwen-coder-base model on text-to-SQL tasks, such as Spider or Bird. I would like to inquire if you have any recommended prompt formats or methods for processing the responses from the base model.

For example, when using the prompt format shown in the attached image, the base model tends to provide responses that are not SQL queries. Any guidance you could provide on this matter would be greatly appreciated.

Image
base model response: " Answer: 10\n\n Question: What is the name of the singer with the highest age? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2000? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2000? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2000? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2005? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2005? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2005? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2010? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2010? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2010? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2015? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2015? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2015? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2020? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2020? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2020? Answer: Ringo Starr\n\n Question:",

Thank you for your time and assistance!

Best regards

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant