MTEB logo MTEB
semantic-similarity text

Tatoeba

Cite this task

@inproceedings{tiedemann-2020-tatoeba,
  address = {Online},
  author = {Tiedemann, J{\"o}rg},
  booktitle = {Proceedings of the Fifth Conference on Machine Translation},
  doi = {10.18653/v1/2020.wmt-1.139},
  month = nov,
  pages = {1174--1182},
  publisher = {Association for Computational Linguistics},
  title = {The Tatoeba Translation Challenge {--} Realistic Data Sets for Low Resource and Multilingual {MT}},
  url = {https://aclanthology.org/2020.wmt-1.139/},
  year = {2020},
}

1,000 English-aligned sentence pairs for each language based on the Tatoeba corpus

Domains: Written
Languages: AfrikaansAmharicOld English (ca. 450-1100)ArabicAlgerian ArabicEgyptian ArabicAsturianAwadhiAzerbaijaniBelarusianBengaliBerber (Other)BosnianBretonBulgarianCatalanChavacanoCebuanoCzechChamorroMandarin ChineseCornishKashubianWelshDanishGermanLower SorbianKadazan DusunModern Greek (1453-)EnglishEsperantoEstonianBasqueFaroeseFinnishFrenchWestern FrisianScottish GaelicIrishGalicianSwiss GermanHebrewHindiCroatianUpper SorbianHungarianArmenianIdoInterlingueInterlingua (International Auxiliary Language Association)IndonesianIcelandicItalianJavaneseJapaneseKabyleGeorgianKazakhKhmerKoreanKurdishCoastal KadazanLatinLingua Franca NovaLithuanianStandard LatvianMalayalamMarathiNorth Moluccan MalayEastern MariMacedonianMongolianLow GermanDutchNorwegian NynorskNorwegian BokmålNovialOccitan (post 1500)Old RussianPampangaIranian PersianPiemontesePolishPortugueseRomanianRussianSlovakSlovenianSpanishAlbanianSerbianSwedishSwabianSwahili (individual language)TamilTatarTeluguTagalogThaiTurkmenTurkishTalossanUighurUkrainianUrduUzbekVietnameseWaray (Philippines)Wu ChineseXhosaYiddishYue ChineseStandard Malay
Task type
BitextMining
Main metric
f1
License
cc-by-2.0
Dates
2006-01-01 → 2021-12-31
Annotations
human-annotated
Sample creation
found
Models scored …
Dataset preview mteb/tatoeba-bitext-mining Open on HuggingFace →

Model scores

Loading…