MTEB logo MTEB
semantic-similarity text

SemRel24STS

Cite this task

@misc{ousidhoum2024semrel2024,
  archiveprefix = {arXiv},
  author = {Nedjma Ousidhoum and Shamsuddeen Hassan Muhammad and Mohamed Abdalla and Idris Abdulmumin and Ibrahim Said Ahmad and
Sanchit Ahuja and Alham Fikri Aji and Vladimir Araujo and Abinew Ali Ayele and Pavan Baswani and Meriem Beloucif and
Chris Biemann and Sofia Bourhim and Christine De Kock and Genet Shanko Dekebo and
Oumaima Hourrane and Gopichand Kanumolu and Lokesh Madasu and Samuel Rutunda and Manish Shrivastava and
Thamar Solorio and Nirmal Surange and Hailegnaw Getaneh Tilaye and Krishnapriya Vishnubhotla and Genta Winata and
Seid Muhie Yimam and Saif M. Mohammad},
  eprint = {2402.08638},
  primaryclass = {cs.CL},
  title = {SemRel2024: A Collection of Semantic Textual Relatedness Datasets for 14 Languages},
  year = {2024},
}

SemRel2024 is a collection of Semantic Textual Relatedness (STR) datasets for 14 languages, including African and Asian languages. The datasets are composed of sentence pairs, each assigned a relatedness score between 0 (completely) unrelated and 1 (maximally related) with a large range of expected relatedness values.

Domains: SpokenWritten
Languages: AfrikaansAmharicStandard ArabicAlgerian ArabicMoroccan ArabicEnglishHausaHindiIndonesianKinyarwandaMarathiTelugu
Task type
STS
Main metric
cosine_spearman
Source dataset
mteb/SemRel24STS
License
not specified
Dates
2023-01-01 → 2023-12-31
Annotations
human-annotated
Sample creation
created
Models scored …
Dataset preview mteb/SemRel24STS Open on HuggingFace →

Model scores

Loading…