Highlight

Qwen3 Technical Report

Presents Qwen3, a family of dense and MoE LLMs (0.6-235B) unifying thinking and non-thinking modes with an adaptive thinking-budget mechanism.

Based on

Qwen3 Technical Report

By An Yang, Anfeng Li, Baosong Yang et al.arXiv
Read original article →

The Qwen3 technical report presents the latest generation of the Qwen large language model family, comprising both dense and Mixture-of-Expert (MoE) architectures with parameter scales ranging from 0.6 to 235 billion. Its central innovation is the integration of a 'thinking' mode for complex, multi-step reasoning and a 'non-thinking' mode for rapid, context-driven responses within a single unified framework, removing the need to switch between separate chat-optimized and dedicated reasoning models. A thinking-budget mechanism lets users adaptively allocate inference compute to balance latency against performance according to task complexity.

By transferring knowledge from the flagship models, the authors substantially reduce the compute needed to build smaller yet competitive models. Empirically, Qwen3 achieves state-of-the-art results across benchmarks in code generation, mathematical reasoning, and agent tasks, competitive with larger MoE and proprietary models, while expanding multilingual coverage from 29 to 119 languages and dialects. All Qwen3 models are released publicly under the Apache 2.0 license to support reproducibility and community research.

Abstract

Qwen3 is the latest Qwen family of LLMs, spanning dense and Mixture-of-Expert architectures from 0.6 to 235 billion parameters. Its key innovation unifies a 'thinking' mode for multi-step reasoning and a 'non-thinking' mode for fast responses in one framework, with a thinking-budget mechanism that adaptively allocates inference compute. Knowledge from flagship models cuts the cost of building smaller ones. Qwen3 reaches state-of-the-art results on code, math, and agent benchmarks, expands multilingual support from 29 to 119 languages, and is released under Apache 2.0.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

large language modelsQwen3mixture-of-expertsreasoningmultilingualthinking budget
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.

Qwen3 Technical Report | Aramai