dense Open weights Instruction-tuned ST compatible text
MongoDB/mdbr-leaf-mt
- Languages
- English
- License
- apache-2.0
- Adapted from
- nreimers/MiniLM-L6-H384-uncased
- Trained on
- AmazonQALoTTEMSMARCO
Cite this model
Citation (BibTeX)
@misc{mdbr_leaf,
title={LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations},
author={Robin Vujanic and Thomas Rueckstiess},
year={2025},
eprint={2509.12539},
archivePrefix={arXiv},
primaryClass={cs.IR},
url={https://arxiv.org/abs/2509.12539}
}Parameters 23M
Active parameters 11M
Embedding dim 1,024
Max tokens 512
Memory 86 MB
Released 2025-08-27
Openness
4/6
- Open weights
- Open license
- Training code
- Training data
- Paper
- Model card