Method
GPT-6.1 Sol
GPT-6.1 Sol uses the same developer-guided zero-shot prompt adopted from Ouédraogo et al., covering structure, nesting, intent, length, action granularity, and reading flow. It uses low reasoning effort and no tools or agentic workflow. Scores average three independent runs; recorded explanations appear on sample pages.
Score scale: 0–20; mean of three runs.
Dataset results
| Dataset | Coverage | Spearman ρ |
|---|---|---|
| MBJP | 17/17 | 0.759 |
| Buse | 100/100 | 0.206 |
| Scalabrino | 200/200 | 0.489 |
| Dorn | 360/360 | 0.521 |
| Schnappinger | 304/304 | 0.646 |
| JetBrains | 119/119 | 0.604 |
| Java transformations | 1400/1400 | — |
| Python transformations | 1400/1400 | — |