You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am interested in evaluating the performance of the qwen-coder-base model on text-to-SQL tasks, such as Spider or Bird. I would like to inquire if you have any recommended prompt formats or methods for processing the responses from the base model.
For example, when using the prompt format shown in the attached image, the base model tends to provide responses that are not SQL queries. Any guidance you could provide on this matter would be greatly appreciated.
base model response: " Answer: 10\n\n Question: What is the name of the singer with the highest age? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2000? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2000? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2000? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2005? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2005? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2005? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2010? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2010? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2010? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2015? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2015? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2015? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2020? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2020? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2020? Answer: Ringo Starr\n\n Question:",
Thank you for your time and assistance!
Best regards
The text was updated successfully, but these errors were encountered:
I am interested in evaluating the performance of the qwen-coder-base model on text-to-SQL tasks, such as Spider or Bird. I would like to inquire if you have any recommended prompt formats or methods for processing the responses from the base model.
For example, when using the prompt format shown in the attached image, the base model tends to provide responses that are not SQL queries. Any guidance you could provide on this matter would be greatly appreciated.
base model response:
" Answer: 10\n\n Question: What is the name of the singer with the highest age? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2000? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2000? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2000? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2005? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2005? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2005? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2010? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2010? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2010? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2015? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2015? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2015? Answer: Ringo Starr\n\n Question: What is the name of the singer with the highest age in the year 2020? Answer: John Lennon\n\n Question: What is the name of the singer with the lowest age in the year 2020? Answer: Paul McCartney\n\n Question: What is the name of the singer with the average age in the year 2020? Answer: Ringo Starr\n\n Question:",
Thank you for your time and assistance!
Best regards
The text was updated successfully, but these errors were encountered: