This is an interesting detailed analysis of how different agent harnesses and models perform on various coding benchmarks. Github Copilot is looking comparable and even better in many of these metrics.
Peter Marcu
@PeterMarcuDirector of Engineering, Microsoft and GitHub
Redmond, WA
