ColBERT2 articles

ColBERT

Articles

Sentence Transformers 6.0 Adds MultiVectorEncoder for ColBERT Late-Interaction Training
Hugging Face has released Sentence Transformers v6.0, adding native architecture and training workflows for multi-vector late-interaction retrieval models. The update introduces MultiVectorEncoder, bringing ColBERT-style token-level representations directly into the library alongside existing dense embedding, sparse embedding, and cross-encoder reranker classes. While traditional dense retrieval compresses an entire document into a single fixed-dimension vector, multi-vector models preserve ind
August 26, 20261 min
Late Interaction and ColBERT: How Multi-Vector Embeddings and the MaxSim Operator Transform Neural Retrieval
Information retrieval systems have long wrestled with a fundamental tension between computational efficiency and semantic expressiveness. Traditional dense bi-encoders like DPR compress an entire passage into a single dense vector, allowing sub-linear approximate nearest neighbor (ANN) search over millions of documents. However, forcing multi-sentence passages into a single vector representation creates an information bottleneck that discards fine-grained token-level nuances, entities, and keywo
August 20, 20261 min