lightonai/ColBERT-Zero-supervised

Reference

https://huggingface.co/lightonai/ColBERT-Zero-supervised

Languages

English

License

apache-2.0

Training code

https://github.com/lightonai/pylate/blob/main/examples/train/ColBERT-zero/supervised.py

Training data

https://huggingface.co/datasets/nomic-ai/nomic-embed-supervised

Adapted from

lightonai/ColBERT-Zero-unsupervised

Trained on

COIRCodeSearchNetRetrievalCodeSearchNetCCRetrievalCodeSearchNetRetrievalFEVERFEVERHardNegatives.v2HotpotQAHotpotQAHardNegatives.v2MSMARCO +9 more Show fewer

MSMARCOHardNegativesMSMARCOv2NQNQHardNegativesNanoFEVERRetrievalNanoHotpotQARetrievalNanoMSMARCORetrievalNanoNQRetrievalQuoraRetrieval

@misc{chaffin2026colbertzeropretrainpretraincolbert,
  title         = {ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models},
  author        = {Antoine Chaffin and Luca Arnaboldi and Amélie Chatelain and Florent Krzakala},
  year          = {2026},
  eprint        = {2602.16609},
  archivePrefix = {arXiv},
  primaryClass  = {cs.CL},
  url           = {https://arxiv.org/abs/2602.16609},
}