AI Tools.

Search
sentence similarity

all-MiniLM-L6-v2

Distilled BERT model that encodes sentences into 384-dimensional vectors for measuring semantic similarity. Trained on over a billion sentence pairs spanning scientific papers, web QA, NLI datasets, and community forums. At 22M parameters and 6 transformer layers, it is fast enough for CPU inference while remaining competitive on standard sentence similarity benchmarks.

Last reviewed

Share: X Reddit HN LinkedIn

Use cases

  • Semantic search over document collections at scale
  • Clustering similar support tickets automatically
  • Duplicate detection in FAQ or knowledge base entries
  • Cross-sentence relevance scoring in retrieval pipelines
  • Building paraphrase detection for content deduplication

Pros

  • Fast CPU-friendly inference due to compact 22M parameters
  • 384-dim output keeps vector store costs low at scale
  • Apache 2.0 license; ONNX and OpenVINO export supported
  • Broad training data reduces out-of-domain gaps for general English text
  • Drop-in compatible with sentence-transformers library

Cons

  • English-only; no cross-lingual transfer capability
  • 384-dim precision ceiling lags behind 768-dim alternatives on hard STS benchmarks
  • Sensitive to input phrasing — asymmetric queries degrade similarity scores
  • No instruction prefix support, unlike newer embedding models

FAQ

What is all-MiniLM-L6-v2 used for?

Semantic search over document collections at scale. Clustering similar support tickets automatically. Duplicate detection in FAQ or knowledge base entries. Cross-sentence relevance scoring in retrieval pipelines. Building paraphrase detection for content deduplication.

Is all-MiniLM-L6-v2 free to use?

all-MiniLM-L6-v2 is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.

How do I run all-MiniLM-L6-v2 locally?

Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.

Tags

sentence-transformerspytorchtfrustonnxsafetensorsopenvinobertfeature-extractionsentence-similaritytransformersendataset:s2orcdataset:flax-sentence-embeddings/stackexchange_xmldataset:ms_marcodataset:gooaqdataset:yahoo_answers_topicsdataset:code_search_netdataset:search_qadataset:eli5