SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
https://arxiv.org/abs/2310.06770
SWE-bench
Figure 1
https://www.swebench.com/img/teaser.png