DeepCoder-14B: An Open-Source Code Generation Model Rivaling o3-Mini With 14B Parameters

3 days ago 高效码农

Introduction: The Evolution of Code Generation Models and Open-Source Innovation As software complexity grows exponentially, intelligent code generation has become critical for developer productivity. However, the advancement of Large Language Models (LLMs) for code has lagged behind general NLP due to challenges like scarce high-quality datasets, insufficient test coverage, and output reliability issues. This landscape has shifted dramatically with the release of DeepCoder-14B-Preview—an open-source model with 14 billion parameters that achieves 60.6% Pass@1 accuracy on LiveCodeBench, matching the performance of commercial closed-source models like o3-mini. Technical Breakthrough: Architecture of DeepCoder-14B Distributed Reinforcement Learning Framework The model was fine-tuned from DeepSeek-R1-Distilled-Qwen-14B …