OOPSLA

2024

CYCLE: Learning to Self-Refine the Code Generation

2 code LMs' modes: - acceleration: know the expected functionalities and speed up the implementation - exploration: do not know what to do

Cycle attends to 3 information sources: - high-level description - the incorrect code - execution feedback

Yet naively include the previously generated erroneous code may prompt the LMs to copy from the incorrect input. To address this issue, Cycle employ a masking technique: Past Generation Mask.