Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[meta] Translate paragraphs instead of sentences #993

Open
eu9ene opened this issue Jan 15, 2025 · 0 comments
Open

[meta] Translate paragraphs instead of sentences #993

eu9ene opened this issue Jan 15, 2025 · 0 comments
Labels
meta A collection of sub-issues that uses a tasklist quality Improving robustness and translation quality

Comments

@eu9ene
Copy link
Collaborator

eu9ene commented Jan 15, 2025

Based on WMT24, sentence-level translation is going away. There's now more document-level training data available (for example HPLT), and WMT24 used document-level datasets for evaluation.

See Findings of WMT 2024 Shared task

In a shift towards document-level evaluation, we
no longer provide source texts segmented into indi-
vidual sentences. Instead, we keep all paragraphs
intact and evaluated together.

This would require:

  • adapting document level datasets to leave some paragraphs to train on instead of splitting to sentences
  • fix cleaning procedures
  • find evaluation datasets
  • implement inference support
@eu9ene eu9ene added meta A collection of sub-issues that uses a tasklist quality Improving robustness and translation quality labels Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
meta A collection of sub-issues that uses a tasklist quality Improving robustness and translation quality
Projects
None yet
Development

No branches or pull requests

1 participant