Skip to content

Commit

Permalink
change paragraph order
Browse files Browse the repository at this point in the history
  • Loading branch information
ruanchaves committed Sep 10, 2023
1 parent 126e8b1 commit 3d6014a
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ The **Napolab** is your go-to collection of Portuguese datasets with the followi
* 👩‍🔧 **Human**: Expert human annotations only. No automatic or unreliable annotations.
* 🎓 **General**: No domain-specific knowledge or advanced preparation is needed to solve dataset tasks.

Napolab is structured similarly to benchmarks like GLUE and [PLUE](https://github.com/ju-resplande/PLUE). All datasets come with either two or three fields: `'sentence1', 'sentence2', 'label'` or just `'sentence1', 'label'`. To evaluate LLMs using Napolab, you simply need to design prompts to get label predictions from the model.

Napolab currently includes the following datasets:

| | | |
Expand All @@ -20,9 +22,6 @@ Napolab currently includes the following datasets:
|[hatebr](https://huggingface.co/datasets/ruanchaves/hatebr)| [reli-sa](https://huggingface.co/datasets/ruanchaves/reli-sa) | [faquad-nli](https://huggingface.co/datasets/ruanchaves/faquad-nli) |
|[porsimplessent](https://huggingface.co/datasets/ruanchaves/porsimplessent) | | |


Napolab is structured similarly to benchmarks like GLUE and [PLUE](https://github.com/ju-resplande/PLUE). All datasets come with either two or three fields: `'sentence1', 'sentence2', 'label'` or just `'sentence1', 'label'`. To evaluate LLMs using Napolab, you simply need to design prompts to get label predictions from the model.

**💡 Contribute**: We're open to expanding Napolab! Suggest additions in the issues. Plus, if you've evaluated models on this benchmark, we'd love to hear about it, especially results from recent LLMs.

🌍 For broader accessibility, all datasets have translations in **Catalan, English, Galician and Spanish** using the `facebook/nllb-200-1.3B model` via [Easy-Translate](https://github.com/ikergarcia1996/Easy-Translate).
Expand Down

0 comments on commit 3d6014a

Please sign in to comment.