Model architectures for program repair at APR 2023

Model architectures for program repair at APR 2023

At the IEEE/ACM International Workshop on Automated Program Repair (APR 2023, co-located with ICSE 2023) in Melbourne, Australia, we presented “An Extensive Study on Model Architecture and Program Representation in the Domain of Learning-based Automated Program Repair” (Horváth, Csuvik, Gyimóthy and Vidács).

The study compares deep learning models (T5, CodeT5, RoBERTa and GPT-Neo) for repairing Java and JavaScript bugs, using three code representations: raw text, command sequences and abstract syntax trees. Training on command sequences outperformed most other configurations, reaching 30.64% accuracy on java-small, while combining AST and text information performed far worse, below one percent.

Link: ICSE 2023 speaker profile

Read the paper: publisher page

Planning an AI feature?

We build LLM-based products with verification, logging and human review designed in from the first sprint – and most engagements start with a free one-week proof of concept for one named process.

Book 20 minutes with ViktorSend a message