Highlight

DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning

Shows LLM reasoning can be incentivized via pure reinforcement learning, without human-annotated demonstrations; introduces the DeepSeek-R1 model.

Based on

DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning

By DeepSeek-AI, Daya Guo, Dejian Yang et al.Nature
Read original article →

The paper takes on general reasoning, a long-standing goal in AI where large language models and chain-of-thought prompting had made progress but remained dependent on extensive human-annotated demonstrations and limited on harder problems. Its central claim is methodological: the reasoning abilities of LLMs can be incentivized through pure reinforcement learning, without any human-labeled reasoning trajectories. Under this RL framework the model develops advanced reasoning patterns on its own, including self-reflection, verification, and dynamic adaptation of its strategy.

The trained system, released as DeepSeek-R1, achieves superior performance on verifiable tasks such as mathematics, coding competitions, and STEM problems, surpassing counterparts trained with conventional supervised learning on human demonstrations. The authors further show that the emergent reasoning patterns from these large-scale models can systematically guide and strengthen the reasoning of smaller models. This matters because it demonstrates that strong reasoning can be elicited by reinforcement learning alone, without the human-annotated reasoning demonstrations that prior approaches relied on.

Abstract

General reasoning is a long-standing challenge in AI. LLMs with chain-of-thought prompting have advanced basic reasoning but rely heavily on human-annotated demonstrations and still fall short on harder problems. The authors show reasoning can instead be incentivized through pure reinforcement learning, removing the need for human-labeled trajectories, and eliciting emergent self-reflection, verification, and strategy adaptation. The resulting model, DeepSeek-R1, beats supervised-trained counterparts on verifiable math, coding, and STEM tasks, and can enhance smaller models.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

large language modelsreinforcement learningreasoningchain-of-thoughtemergent behaviorDeepSeek-R1
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.