Qwen3-Reranker-8B
Qwen3-Reranker-8B is an 8-billion parameter text reranking model from Alibaba's Qwen team, designed to score and rank query-document pairs. It supports 100+ languages, processes up to 32k token contexts, and is instruction-aware (customizable task descriptions improve results by 1-5%). The model is open-source (Apache 2.0), ungated, and ranks as a top performer on multilingual retrieval benchmarks.
Key facts
Objective fields from the source. Values we can't verify are shown as “Unknown” rather than guessed.
| Field | Value |
|---|---|
| Developer | Qwen |
| Parameters | 8.2B |
| Context window | Unknown |
| License | apache-2.0 — OSI-approved |
| Modality / task | text-ranking |
| Gated on HuggingFace | No |
| Downloads | 984.2k |
| Likes | 248 |
| Last updated | 2026-04-16 |
| Source | Qwen/Qwen3-Reranker-8B |
What Qwen3-Reranker-8B is
Cross-encoder architecture optimized for pairwise relevance scoring. Based on Qwen3-8B-Base with 36 transformer layers. Outputs raw logits (or calibrated 0-1 scores via sigmoid). Accepts formatted input triples: [Instruction, Query, Document]. Requires transformers ≥4.51.0 for qwen3 architecture support. Inference via Sentence Transformers (CrossEncoder) or raw transformers; no embedding dimension specification (unlike companion embedding models).
Run Qwen3-Reranker-8B locally
Load the open weights with 🤗 Transformers and generate — the same model, self-hosted.
from transformers import pipelinepipe = pipeline("text-generation", model="Qwen/Qwen3-Reranker-8B")out = pipe("Explain retrieval-augmented generation in one sentence.", max_new_tokens=128)print(out[0]["generated_text"])Swap in vLLM or Ollama for production-grade serving. DEV.co can stand up the inference stack.
How you'd run it
A typical self-hosted path — open weights, an inference server, your application.
DEV.co builds each layer — from GPU infrastructure to the application.
Best use cases
Running & fine-tuning it
Estimated FP16 inference: ~16–20 GB GPU VRAM (e.g., A100 40GB, RTX 4090, A10G). FP32: ~32 GB. Batch size and max_length tune memory usage. Transformers with flash_attention_2 reduces memory ~20–30%. CPU inference possible but ~10–100× slower; not recommended for production.
Card does not specify LoRA/QLoRA support or fine-tuning examples. Model is fine-tuned from Qwen3-8B-Base; likelihood of successful domain-specific adaptation is high (standard cross-encoder architecture) but requires custom training code or adapter libraries. No official guidance provided; recommend consulting Qwen GitHub or testing on a validation set.
When to avoid it — and what to weigh
- Embedding-based dense retrieval — This is a reranker (cross-encoder), not an embedding model. It requires pre-filtered candidate sets and pair-wise inference. Use Qwen3-Embedding-8B for initial retrieval and dense vector search.
- Latency-critical single-pass ranking — Cross-encoder inference is O(n) per query (one forward pass per document pair). For ranking thousands of candidates per query, batching and GPU availability are critical; dense retrieval + reranking two-stage is standard.
- Single-GPU or CPU-only environments — 8B parameters require ~16–24 GB VRAM in FP16; CPU inference is impractical for production latency. Edge deployment favors smaller models (0.6B, 4B variants).
- Structured or SQL-based relevance — Reranker is text-only. If relevance depends on relational data (e.g., date, price filtering), combine this model with rule-based pre/post-filtering.
License & commercial use
Apache License 2.0. Permissive OSI license permitting commercial use, modification, and distribution, provided attribution and license copy are included. No proprietary restrictions on model weights or inference.
Apache 2.0 explicitly permits commercial use. No gating, no sign-up required. Weights and code are freely available. Verify compliance with your legal team if you: (1) modify the model and redistribute, (2) use it in a closed-source product (attribute per Apache 2.0 terms), or (3) bundle it with other licensed software. No commercial support contract or SLA is implied; community support only.
DEV.co evaluation signals
Editorial assessment — not user reviews. Directional, with an explicit confidence level.
| Signal | Assessment |
|---|---|
| Maintenance | Active |
| Documentation | Adequate |
| License clarity | Clear |
| Deployment complexity | Moderate |
| DEV.co fit | Strong |
| Assessment confidence | High |
No security audit, threat model, or adversarial robustness testing mentioned in card. Cross-encoder models are generally lower-risk than generation models (no token autoreplay); however, model poisoning attacks and input-based prompt injection via custom instructions are plausible. Recommend: (1) validate instruction inputs, (2) monitor for unexpected ranking behavior, (3) review Qwen3 parent model security advisories. No quantified exploit surface disclosed.
Alternatives to consider
mxbai-embed-large (Mixedbread AI) + BGE-Reranker-v2-M3 (BAAI)
Popular open reranker alternatives with strong MTEB scores. mxbai is permissive, BGE offers multiple sizes (small to large). Established community; consider if you need mature serving infrastructure or specific language pairs.
LLaMA 3.1 / Mistral as cross-encoder (prompt-based ranking)
Smaller (8B–70B) general-purpose LLMs can perform ranking via zero-shot prompting. Trade-off: slower, less calibrated scores, but may integrate with existing LLM stacks. Use if you want a single model for multiple tasks.
Qwen3-Embedding-8B (paired with embedding-based ranking)
If you control the retrieval pipeline, dense retrieval + embedding similarity is faster at scale. Qwen3-Embedding-8B offers a complementary approach; combine both for a two-stage system if latency allows.
Ship Qwen3-Reranker-8B with senior software developers
Deploy in minutes with Sentence Transformers or raw transformers. Free, Apache 2.0 licensed, no commercial restrictions. Customize instructions for your task and start ranking. See our integration guide and compare alternatives.
Talk to DEV.coRelated open-source tools
Surfaced by semantic similarity across the DEV.co open-source index.
Related on DEV.co
Explore the category and the services that help you build with it.
Qwen3-Reranker-8B FAQ
Can I use this model for commercial products without paying fees?
How much GPU memory do I need to run this model?
Is this model better than embedding-based retrieval for ranking?
Can I fine-tune this model for my domain?
Work with a software development agency
From first prototype to production, DEV.co delivers software development services around tools like Qwen3-Reranker-8B. Our software development agency staffs experienced software developers and web developers for custom software development, web development, integrations, and ongoing support across open-source llms and beyond.
Integrate Qwen3-Reranker-8B into Your RAG or Search Pipeline
Deploy in minutes with Sentence Transformers or raw transformers. Free, Apache 2.0 licensed, no commercial restrictions. Customize instructions for your task and start ranking. See our integration guide and compare alternatives.