A controlled study investigating the impact of AI coding assistants on developer productivity found that while developers subjectively felt 20% faster, objective measurements indicated a 19% decrease in speed. The research, conducted by institutions including the University of Cambridge and MIT, aimed to quantify the real-world performance gains of tools like GitHub Copilot and Amazon CodeWhisperer. The experiment faced challenges, with the lab reportedly killing its own experiment during the second attempt. AI
IMPACT Challenges the perceived productivity gains of AI coding assistants, suggesting a need for more rigorous evaluation of their real-world impact on developer workflows.
RANK_REASON The cluster reports on a controlled study evaluating the productivity impact of AI coding assistants, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Medium — AI coding tag →
- Amazon CodeWhisperer
- Carnegie Mellon University
- GitHub Copilot
- Meta
- Microsoft
- MIT
- Stanford University
- University of Cambridge
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
