AI CODING · STACK OVERFLOW 2025

Using AI is not the same as handing over the code

Survey: 29 May–23 June 2025 · reviewed 2026-10-23
ANTHROPIC ECONOMIC INDEX

What people actually do with Claude

The work behind the prompts

Share of classified usage by major occupation group · %

Loading chart

Selected groups · different platform populations

From answers to things people make

Classified output types · share of usage · %

Loading chart

Classifier estimates · categories can overlap

DEVELOPER CHOICE · 2025

Wanted by many
Chosen again by whom?

Want to useWant to keep using
Published percentages; denominators differ
Model familyWant to use %Want to keep using %
OpenAI GPT51.261.2
Claude Sonnet33.367.5
OpenAI Reasoning25.963.6
Gemini Flash2456.6
Gemini Reasoning22.765.2
OpenAI Image18.759.4
DeepSeek Reasoning17.151.5
Meta Llama12.548.3
DeepSeek General11.451.2
X Grok8.952
Mistral849.6
Perplexity Sonar6.354.7
Alibaba Qwen4.353.8
Microsoft Phi-4 models442.6
Cohere: Command A1.141.7
Reka (Flash 3 or other Reka models)0.961.4

Want to use: all respondents. Keep using: existing users. Self-selected 2025 survey · catalogue-covered families.

AI assistance is not the same as vibe coding

Loading chart

Different question populations · adoption includes plans

More distrust than trust

Loading chart

Selected answers · omitted responses are not zero

Almost right still needs work

Loading chart

Overlapping self-reports · not measured debugging time

MEASURED TASK PERFORMANCE
Randomized field experiment on familiar open-source repositories

Expected versus measured task-time change

% change in completion time
Loading chart

Historical tools and a narrow sample; the reported 95% confidence interval is +2% to +39% task time. METR's February 2026 update warns that later experiments suffer from selection and time-measurement problems; this is not an estimate of current tool performance. Follow-up estimates are affected by selection and measurement bias; no reliable current effect size established.

Statvero