Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Language Detection Score is unreasonably high? #6

Open
rysantos opened this issue Mar 15, 2019 · 0 comments
Open

Language Detection Score is unreasonably high? #6

rysantos opened this issue Mar 15, 2019 · 0 comments

Comments

@rysantos
Copy link

Hi all,

I am working on a bot project at the moment where we use language detection to determine what language the user wants to converse in. (French or English) The user can switch at any moment so we need to be confident on when switches should occur.

I am noticing that alternative languages are always detected with score of 1. This is really throwing off our conversations because we can't accurately determine the confidence level if the user wants to switch languages or not.

See the following Postman screenshot.
"Complete a masterline" - This is very clearly English, but it could contain alternates for French and 'ro' (Not even sure what this language is). But at a score of 1? Seems unrealistic to me. Am I doing something wrong? Can I train this to be more accurate?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant