Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

which results of CHAN-DST should we use? #2

Open
fpcsong opened this issue May 30, 2021 · 2 comments
Open

which results of CHAN-DST should we use? #2

fpcsong opened this issue May 30, 2021 · 2 comments

Comments

@fpcsong
Copy link

fpcsong commented May 30, 2021

I notice that CHAN-DST and STAR are both in your git repo, and in paper of STAR you rerun the CHAN and report its joint goal as 53.38% at multi-woz2.1, and in its original paper it was 58.55% at multiwoz2.1, so which is offical?

@smartyfh
Copy link
Owner

I notice that CHAN-DST and STAR are both in your git repo, and in paper of STAR you rerun the CHAN and report its joint goal as 53.38% at multi-woz2.1, and in its original paper it was 58.55% at multiwoz2.1, so which is offical?

The code was forked from the authors' repo. But I rerun the experiments using the same preprocessing as STAR.

@fpcsong
Copy link
Author

fpcsong commented Jun 1, 2021

I also failed to re-produce "58.55%" and I notice that CHAN-DST has been withdrawn from ACL 2020, so be it. 😂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants