导航|地址|刷新
GitHub - deepseek-ai/DeepSeek-Math: Deep…























Skip to content


Navigation Menu
Toggle navigation










Sign in
Appearance settings









Platform


AI CODE CREATION

GitHub CopilotWrite better code with AI



GitHub Copilot appDirect agents from issue to merge



MCP RegistryIntegrate external tools





DEVELOPER WORKFLOWS

ActionsAutomate any workflow



CodespacesInstant dev environments



IssuesPlan and track work



Code ReviewManage code changes



Code QualityEnforce quality at merge





APPLICATION SECURITY

GitHub Advanced SecurityFind and fix vulnerabilities



Code securitySecure your code as you build



Secret protectionStop leaks before they start





EXPLORE
Why GitHub

Documentation

Blog

Changelog

Marketplace



View all features





Solutions


BY COMPANY SIZE
Enterprises

Small and medium teams

Startups

Nonprofits




BY USE CASE
App Modernization

DevSecOps

DevOps

CI/CD

View all use cases




BY INDUSTRY
Healthcare

Financial services

Manufacturing

Government

View all industries



View all solutions





Resources


EXPLORE BY TOPIC
AI

Software Development

DevOps

Security

View all topics




EXPLORE BY TYPE
Customer stories

Events & webinars

Ebooks & reports

Business insights

GitHub Skills




SUPPORT & SERVICES
Documentation

Customer support

Community forum

Trust center

Partners



View all resources





Open Source


COMMUNITY

GitHub SponsorsFund open source developers





PROGRAMS
Security Lab

Maintainer Community

Accelerator

GitHub Stars

Archive Program




REPOSITORIES
Topics

Trending

Collections







Enterprise


ENTERPRISE SOLUTIONS

Enterprise platformAI-powered developer platform





AVAILABLE ADD-ONS

GitHub Advanced SecurityEnterprise-grade security features



Copilot for BusinessEnterprise-grade AI features



Premium SupportEnterprise-grade 24/7 support







Pricing





Search or jump to...



Search code, repositories, users, issues, pull requests...




Search








Clear








Search syntax tips














Provide feedback







We read every piece of feedback, and take your input very seriously.
Include my email address so I can be contacted

Cancel Submit feedback




Saved searches

Use saved searches to filter your results more quickly












Name

Query

To see all available qualifiers, see our documentation.







Cancel Create saved search


Sign in
Sign up
Appearance settings


Resetting focus




You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert








{{ message }}











Uh oh!


There was an error while loading. Please reload this page.









deepseek-ai /DeepSeek-MathPublic



Notifications You must be signed in to change notification settings

Fork 588


Star 3.4k






Code

Issues39

Pull requests5

Actions

Projects

Security and quality0

Insights

Additional navigation options



Code

Issues

Pull requests

Actions

Projects

Security and quality

Insights

































main





BranchesTags










Go to file

Code
Open more actions menu







Folders and files

Name	Name	Last commit message	Last commit date
Latest commit History 10 Commits 10 Commits
evaluation	evaluation
images	images
replicate	replicate
.gitignore	.gitignore
LICENSE-CODE	LICENSE-CODE
LICENSE-MODEL	LICENSE-MODEL
README.md	README.md
cog.yaml	cog.yaml
View all files

Repository files navigation



README

MIT license

License



More items








------









Model Download | Evaluation Results | Quick Start | License | Citation

Paper Link👁️


1. Introduction


DeepSeekMath is initialized with DeepSeek-Coder-v1.5 7B and continues pre-training on math-related tokens sourced from Common Crawl, together with natural language and code data for 500B tokens. DeepSeekMath 7B has achieved an impressive score of 51.7% on the competition-level MATH benchmark without relying on external toolkits and voting techniques, approaching the performance level of Gemini-Ultra and GPT-4. For research purposes, we release checkpoints of base, instruct, and RL models to the public.




2. Evaluation Results



DeepSeekMath-Base 7B


We conduct a comprehensive assessment of the mathematical capabilities of DeepSeekMath-Base 7B, focusing on its ability to produce self-contained mathematical solutions without relying on external tools, solve math problems using tools, and conduct formal theorem proving. Beyond mathematics, we also provide a more general profile of the base model, including its performance of natural language understanding, reasoning, and programming skills.

Mathematical problem solving with step-by-step reasoning



Mathematical problem solving with tool use



Natural Language Understanding, Reasoning, and Code



The evaluation results from the tables above can be summarized as follows:

Superior Mathematical Reasoning: On the competition-level MATH dataset, DeepSeekMath-Base 7B outperforms existing open-source base models by more than 10% in absolute terms through few-shot chain-of-thought prompting, and also surpasses Minerva 540B.

Strong Tool Use Ability: Continuing pre-training with DeepSeekCoder-Base-7B-v1.5 enables DeepSeekMath-Base 7B to more effectively solve and prove mathematical problems by writing programs.

Comparable Reasoning and Coding Performance: DeepSeekMath-Base 7B achieves performance in reasoning and coding that is comparable to that of DeepSeekCoder-Base-7B-v1.5.


DeepSeekMath-Instruct and -RL 7B


DeepSeekMath-Instruct 7B is a mathematically instructed tuning model derived from DeepSeekMath-Base 7B, while DeepSeekMath-RL 7B is trained on the foundation of DeepSeekMath-Instruct 7B, utilizing our proposed Group Relative Policy Optimization (GRPO) algorithm.

We evaluate mathematical performance both without and with tool use, on 4 quantitative reasoning benchmarks in English and Chinese. As shown in Table, DeepSeekMath-Instruct 7B demonstrates strong performance of step-by-step reasoning, and DeepSeekMath-RL 7B approaches an accuracy of 60% on MATH with tool use, surpassing all existing open-source models.




3. Data Collection


Step 1: Select OpenWebMath, a collection of high-quality mathematical web texts, as our initial seed corpus for training a FastText model.

Step 2: Use the FastText model to retrieve mathematical web pages from the deduplicated Common Crawl database.

Step 3: Identify potential math-related domains through statistical analysis.

Step 4: Manually annotate URLs within these identified domains that are associated with mathematical content.

Step 5: Add web pages linked to these annotated URLs, but not yet collected, to the seed corpus. Jump to step 1 until four iterations.



After four iterations of data collection, we end up with 35.5M mathematical web pages, totaling 120B tokens.


4. Model Downloads


We release the DeepSeekMath 7B, including base, instruct and RL models, to the public. To support a broader and more diverse range of research within both academic and commercial communities. Please note that the use of this model is subject to the terms outlined in License section. Commercial usage is permitted under these terms.


Huggingface

Model	Sequence Length	Download
DeepSeekMath-Base 7B	4096	🤗 HuggingFace
DeepSeekMath-Instruct 7B	4096	🤗 HuggingFace
DeepSeekMath-RL 7B	4096	🤗 HuggingFace

5. Quick Start


You can directly employ Huggingface's Transformers for model inference.

Text Completion

importtorchfromtransformersimportAutoTokenizer, AutoModelForCausalLM, GenerationConfigmodel_name="deepseek-ai/deepseek-math-7b-base"tokenizer=AutoTokenizer.from_pretrained(model_name) model=AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto") model.generation_config=GenerationConfig.from_pretrained(model_name) model.generation_config.pad_token_id=model.generation_config.eos_token_idtext="The integral of x^2 from 0 to 2 is"inputs=tokenizer(text, return_tensors="pt") outputs=model.generate(**inputs.to(model.device), max_new_tokens=100) result=tokenizer.decode(outputs[0], skip_special_tokens=True) print(result)

Chat Completion

importtorchfromtransformersimportAutoTokenizer, AutoModelForCausalLM, GenerationConfigmodel_name="deepseek-ai/deepseek-math-7b-instruct"tokenizer=AutoTokenizer.from_pretrained(model_name) model=AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto") model.generation_config=GenerationConfig.from_pretrained(model_name) model.generation_config.pad_token_id=model.generation_config.eos_token_idmessages= [ {"role": "user", "content": "what is the integral of x^2 from 0 to 2?\nPlease reason step by step, and put your final answer within \boxed{}."} ] input_tensor=tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt") outputs=model.generate(input_tensor.to(model.device), max_new_tokens=100) result=tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True) print(result)

Avoiding the use of the provided function apply_chat_template, you can also interact with our model following the sample template. Note that messages should be replaced by your input.

User: {messages[0]['content']} Assistant: {messages[1]['content']}<｜end▁of▁sentence｜>User: {messages[2]['content']} Assistant:

Note: By default (add_special_tokens=True), our tokenizer automatically adds a bos_token (<｜begin▁of▁sentence｜>) before the input text. Additionally, since the system prompt is not compatible with this version of our models, we DO NOT RECOMMEND including the system prompt in your input.

❗❗❗ Please use chain-of-thought prompt to test DeepSeekMath-Instruct and DeepSeekMath-RL:


English questions: {question}\nPlease reason step by step, and put your final answer within \boxed{}.



Chinese questions: {question}\n请通过逐步推理来解答问题，并把最终答案放置于\boxed{}中。



6. License


This code repository is licensed under the MIT License. The use of DeepSeekMath models is subject to the Model License. DeepSeekMath supports commercial use.

See the LICENSE-CODE and LICENSE-MODEL for more details.


7. Citation


@misc{deepseek-math, author = {Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Mingchuan Zhang, Y.K. Li, Y. Wu, Daya Guo}, title = {DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models}, journal = {CoRR}, volume = {abs/2402.03300}, year = {2024}, url = {https://arxiv.org/abs/2402.03300}, }


8. Contact


If you have any questions, please raise an issue or contact us at service@deepseek.com.















About

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Resources

Readme

MIT, License licenses found

Activity

Custom properties

Stars

3.4k stars

Watchers

41 watching

Forks

588 forks

Report repository



Releases







Packages





Used by





Contributors





Languages





























Footer


© 2026 GitHub, Inc.

Footer navigation

Terms

Privacy

Security

Status

Community

Docs

Contact

Manage cookies

Do not share my personal information


You can’t perform that action at this time.
















------
导航页 打开网址