EpiCoder: Encompassing Diversity and Complexity in Code Generation
Effective instruction tuning is indispensable for optimizing code LLMs,
aligning model behavior with user expectations and enhancing model performance
in real-world applications. However, most existing methods focus on code
snippets, which are limited to specific functionalities and rigid structures,
restricting the complexity and diversity of the synthesized data. To address
these limitations, we introduce a novel feature tree-based synthesis framework
inspired by Abstract Syntax Trees (AST). Unlike AST, which captures syntactic
structure of code, our framework models semantic relationships between code
elements, enabling the generation of more nuanced and diverse data. The feature
tree is constructed from raw data and refined iteratively to increase the
quantity and diversity of the extracted features. This process enables the
identification of more complex patterns and relationships within the code. By
sampling subtrees with controlled depth and breadth, our framework allows
precise adjustments to the complexity of the generated code, supporting a wide
range of tasks from simple function-level operations to intricate multi-file
scenarios. We fine-tuned widely-used base models to create the EpiCoder series,
achieving state-of-the-art performance at both the function and file levels
across multiple benchmarks. Notably, empirical evidence indicates that our
approach shows significant potential in synthesizing highly complex
repository-level code data. Further analysis elucidates the merits of this
approach by rigorously assessing data complexity and diversity through software
engineering principles and LLM-as-a-judge method.
677f68d5b8f3572fc35d6046
Yaoxiang Wang
677f68d5b8f3572fc35d6047
Haoling Li
claimed_verified
2025-01-09T10:06:15.412Z
650be23ec4e52db6a4db63ef
/avatars/03af548029b38bee49ec295fefe74f9a.svg
Haoling Li
user
Ringo1110
677f68d5b8f3572fc35d6048
Xin Zhang
extracted_pending
2025-01-09T06:12:38.212Z
641a9a4b05290a135041a3ed
/avatars/95d66ac607973abe95bd3558c6c93739.svg
Pluto
user
CharonBony
677f68d5b8f3572fc35d6049
Jie Wu
677f68d5b8f3572fc35d604a
Xiao Liu
claimed_verified
2025-01-09T19:57:52.589Z
63fb6e281b4b1bd4e7ffc5be
https://cdn-avatars.huggingface.co/v1/production/uploads/1677422062937-noauth.jpeg
Xiao Liu
user
lx865712528
677f68d5b8f3572fc35d604b
Wenxiang Hu
admin_assigned
2025-01-09T20:31:18.292Z
6327cafc46ffcfc27cfa4c9a
/avatars/4daea27b432ff428c41d590669f7330c.svg
Wenxiang Hu
user
wenxcs
677f68d5b8f3572fc35d604c
Zhongxin Guo
677f68d5b8f3572fc35d604d
Yangyu Huang
admin_assigned
2025-01-09T20:31:33.079Z
64c66647725ffa04b2fd6c94
/avatars/620f63f27fa1e90423b0dc22aa8e5809.svg
yangyu huang
user
yangyu90
677f68d5b8f3572fc35d604e
Ying Xin
677f68d5b8f3572fc35d604f
Yujiu Yang
admin_assigned
2025-01-09T20:31:49.764Z
64ca1fe838837b12d5e529b7
/avatars/44a3ad9e59318784ac531993b5f69f6b.svg
Yujiu Yang
user
Thu-redrobot
677f68d5b8f3572fc35d6050
Jinsong Su
677f68d5b8f3572fc35d6051
Qi Chen
admin_assigned
2025-01-09T20:32:03.897Z
6358c7db856b319a29bdb26b
/avatars/c806e76b6342c1b788bd1dc337f086b8.svg
QiChen
user
QiChen00
677f68d5b8f3572fc35d6052
Scarlett Li
admin_assigned
2025-01-09T20:32:10.147Z
67366efb049bfa3a9084e8d1
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/Bny5bUc6qFQ_RWpEKpRAW.jpeg
Scarlett Li
user
lisijia0504
EpiCoder: Encompassing Diversity and Complexity in Code Generation
Effective instruction tuning is indispensable for optimizing code LLMs,
aligning model behavior with user expectations and enhancing model performance
in real-world applications. However, most existing methods focus on code
snippets, which are limited to specific functionalities and rigid structures,
restricting the complexity and diversity of the synthesized data. To address
these limitations, we introduce a novel feature tree-based synthesis framework
inspired by Abstract Syntax Trees (AST). Unlike AST, which captures syntactic
structure of code, our framework models semantic relationships between code
elements, enabling the generation of more nuanced and diverse data. The feature
tree is constructed from raw data and refined iteratively to increase the
quantity and diversity of the extracted features. This process enables the
identification of more complex patterns and relationships within the code. By
sampling subtrees with controlled depth and breadth, our framework allows
precise adjustments to the complexity of the generated code, supporting a wide
range of tasks from simple function-level operations to intricate multi-file
scenarios. We fine-tuned widely-used base models to create the EpiCoder series,
achieving state-of-the-art performance at both the function and file levels
across multiple benchmarks. Notably, empirical evidence indicates that our
approach shows significant potential in synthesizing highly complex
repository-level code data. Further analysis elucidates the merits of this
approach by rigorously assessing data complexity and diversity through software
engineering principles and LLM-as-a-judge method.
A feature tree-based synthesis framework inspired by AST enhances code LLMs by generating diverse and nuanced code, resulting in state-of-the-art performance across various benchmarks.
feature tree Abstract Syntax Trees (AST) semantic relationships subtree sampling EpiCoder LLM-as-a-judge