At the 5th International Workshop on Automated Program Repair (APR 2024, co-located with ICSE 2024) in Lisbon, Portugal, we presented “Automated Program Repair with the GPT Family, including GPT-2, GPT-3 and CodeX” (Lajkó, Csuvik, Gyimóthy and Vidács).
The paper evaluates GPT-2, GPT-J-6B, GPT-3 and Codex on repairing JavaScript programs, looking at how many patches they produce and how good those patches are. All of them generated patches that fixed the defects, with Codex slightly ahead: on the first try it produced 108 patches identical to the developer's fix, and with multiple attempts up to 201 of the 1,559 buggy programs were repaired automatically (12.89%).
Read the paper: publisher page
