Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Group_accuracy #5

Open
Tasneem91 opened this issue Jan 13, 2024 · 3 comments
Open

Group_accuracy #5

Tasneem91 opened this issue Jan 13, 2024 · 3 comments

Comments

@Tasneem91
Copy link

when I run your code, the group accuracy result comes equal to the accuracy result which is not true, and it does not match the results in your paper.
would you please give help in this

@gaiusyu
Copy link
Owner

gaiusyu commented Jan 13, 2024

We have updated some parameters in the code, so the results obtained by running the code are slightly different from the results in the paper, but the average GA should be around 0.98. If you still have questions, please do not hesitate to contact me.

@Tasneem91
Copy link
Author

ga
ga
I just run the code, and print the accuracy, I just have a problem why accuracy equal to group accuracy, the y are different in the definition and the meaning. I need to know the correct way to find GA @gaiusyu would you please help me with this issue

@gaiusyu
Copy link
Owner

gaiusyu commented Jan 13, 2024

"Accuracy" and "F1 score" are obtained by calling the evaluate function in Logpai. In fact, "Accuracy" in LogPai is GA. I re-implemented a GA function to get "Group Accuracy". The difference between the calculation methods of my function and the function in LogPai is the criterion for judging whether the log belongs to the same group. The function in LogPai looks at the log template ID of the log, such as "E12", while my function looks at the specific template. , such as "session closed for user <*>". Previously, LogPai's annotation was incorrect. some IDs belonging to different templates were annotated as the same, which resulted in LogPai's function calculation "Accuracy" being incorrect. Generally speaking, "Accuarcy" and "Group accuracy" are both GA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants