Coding AI Tools Five-Dimension Score Matrix
55 Coding AI tools scored on quality, features, usability, performance and value, plus the overall AirecMark score. Row order: score.overall desc. Scores as of 2026-09-17.
55 tools listed
Scores as of 2026-09-17 • AirecMark archive dataCursor
Forked VS Code AI-native code editor
GitHub Copilot
Enterprise-grade inline + agent coding
Claude Code
Terminal-native autonomous coding agent
Zed
AI-native high-performance collaborative code editor
Aider
Open-source git-paired CLI pair programmer
OpenAI Codex
Cloud software-engineering agent bundled with ChatGPT plans
Generative AI assistant for development in AWS ecosystems
Trae
ByteDance free AI-native IDE with agent mode
Kilo
Open-source VS Code coding agent (Kilo Code) with 500+ models
Bito AI
AI code reviews plus a codebase knowledge graph (AI Architect)
Windsurf
Cascade Flow agentic IDE
Cline
Open-source agentic coding extension for VS Code with BYOK
AI agents and assistant across all JetBrains IDEs on an AI-credit model
Sourcery
AI code review and refactoring for GitHub, GitLab and IDEs
CodeRabbit
Agentic AI pull-request review with one-click fixes
Korbit AI
PR-level AI code review with insights and codebase chat
Tabby
Self-hosted, open-source code completion with a cloud option
Tabnine
Privacy-first AI coding assistant with org-tuned private models
Continue
Open-source IDE coding assistant (acquired by Cursor)
Greptile
Codebase-graph PR reviewer with autonomous test writing
Amp
Sourcegraph agentic coding with transparent API-cost billing
Codestral
Code completion and fill-in-the-middle model from Mistral AI
Warp
Agentic terminal with AI workflows and cloud agents
Replit Agent
Browser full-stack build & deploy
Zencoder
AI coding agent platform with multi-repo indexing and BYOK
Graphite
Stacked PRs with AI code review and merge queue
OpenHands
Open-source AI software engineering agent
Supermaven
Low-latency completions with a 1M-token context window
Refact.ai
Self-hostable open-source coding agent with completions
Augment Code
Cosmos platform: context-engine agents for large codebases
Qodo
Agentic PR review grounded in a codebase context engine
Snyk Code
AI-powered static application security testing
Moderne
Deterministic estate-wide code changes powered by OpenRewrite recipes
Poolside
Open-weight code models (Laguna) with self-serve API
Jules
Google async coding agent working directly on GitHub
Sourcegraph Cody
Enterprise code AI grounded in the Sourcegraph code graph
AI code quality assurance and static analysis
Qodana
JetBrains code quality platform for CI
Roomote
Cloud and self-hosted coding agent from the creators of Roo Code
Devin
Autonomous software engineer for end-to-end development tasks
Sweep
AI for JetBrains IDEs: completions plus coding agent
CodeBuddy
Tencent AI coding assistant and IDE
Ellipsis
AI code review on every pull request
Grit
GritQL declarative patterns for large-scale code migration
Tongyi Lingma
Alibaba AI coding assistant powered by Qwen
On-device long-term memory layer for your work context
CodeGeeX
Zhipu AI multilingual code generation plugin
Baidu Comate
Baidu AI coding assistant powered by ERNIE
Codeflash
AI performance optimization with automatic PRs
Mutable AI
AI codebase context completion and refactoring
Double
Batch code editing and migration assistant
Charlie
AI automated E2E testing agent
Blackbox AI
Enterprise inference platform routing 300+ models
Magic
Frontier long-context models for software engineering automation
Codegen
Multi-agent code platform (discontinued; folded into ClickUp)
Five-dimension score matrix
| # | Tool | Overall | Quality | Features | Usability | Performance | Value |
|---|---|---|---|---|---|---|---|
| #1 | Cursor | 89.2 | 93 | 92 | 90 | 88 | 82 |
| #2 | GitHub Copilot | 88.1 | 88 | 90 | 90 | 85 | 88 |
| #3 | Claude Code | 86.1 | 94 | 88 | 75 | 85 | 84 |
| #4 | Zed | 86.1 | 88 | 84 | 86 | 88 | 84 |
| #5 | Aider | 86 | 88 | 86 | 72 | 82 | 98 |
| #6 | OpenAI Codex | 84.6 | 90 | 88 | 86 | 84 | 74 |
| #7 | Amazon Q Developer | 84.3 | 88 | 86 | 82 | 84 | 80 |
| #8 | Trae | 84.2 | 80 | 82 | 84 | 80 | 96 |
| #9 | Kilo | 84 | 84 | 84 | 84 | 82 | 86 |
| #10 | Bito AI | 83.9 | 85 | 84 | 82 | 83 | 85 |
| #11 | Windsurf | 83.9 | 87 | 85 | 85 | 84 | 78 |
| #12 | Cline | 83.7 | 86 | 84 | 76 | 78 | 92 |
| #13 | JetBrains AI Assistant | 83.4 | 84 | 84 | 88 | 84 | 78 |
| #14 | Sourcery | 83.4 | 84 | 82 | 85 | 82 | 84 |
| #15 | CodeRabbit | 83.2 | 86 | 84 | 86 | 84 | 76 |
| #16 | Korbit AI | 82.8 | 84 | 81 | 84 | 81 | 84 |
| #17 | Tabby | 82.6 | 80 | 76 | 84 | 84 | 90 |
| #18 | Tabnine | 82.5 | 84 | 80 | 86 | 85 | 78 |
| #19 | Continue | 82.3 | 82 | 78 | 84 | 80 | 88 |
| #20 | Greptile | 82.2 | 86 | 82 | 82 | 84 | 76 |
| #21 | Amp | 82.1 | 86 | 80 | 84 | 82 | 78 |
| #22 | Codestral | 82 | 86 | 80 | 78 | 84 | 80 |
| #23 | Warp | 81.9 | 84 | 82 | 86 | 84 | 74 |
| #24 | Replit Agent | 81.8 | 82 | 84 | 86 | 78 | 80 |
| #25 | Zencoder | 81.7 | 85 | 86 | 80 | 82 | 74 |
| #26 | Graphite | 81.6 | 84 | 82 | 84 | 82 | 76 |
| #27 | OpenHands | 81.5 | 82 | 82 | 76 | 78 | 88 |
| #28 | Supermaven | 81.4 | 80 | 74 | 84 | 88 | 82 |
| #29 | Refact.ai | 81.2 | 82 | 78 | 82 | 80 | 84 |
| #30 | Augment Code | 80.7 | 86 | 84 | 80 | 82 | 70 |
| #31 | Qodo | 80.6 | 84 | 82 | 80 | 82 | 74 |
| #32 | Snyk Code | 80.6 | 84 | 82 | 80 | 82 | 74 |
| #33 | Moderne | 80.4 | 86 | 85 | 74 | 84 | 70 |
| #34 | Poolside | 80.4 | 84 | 78 | 76 | 80 | 82 |
| #35 | Jules | 79.7 | 82 | 78 | 80 | 80 | 78 |
| #36 | Sourcegraph Cody | 79.7 | 83 | 84 | 78 | 80 | 72 |
| #37 | Sonar AI Code Assurance | 79.5 | 84 | 82 | 78 | 80 | 72 |
| #38 | Qodana | 79.4 | 82 | 80 | 78 | 80 | 76 |
| #39 | Roomote | 79.3 | 82 | 78 | 80 | 80 | 76 |
| #40 | Devin | 78.5 | 82 | 86 | 80 | 76 | 68 |
| #41 | Sweep | 77.8 | 78 | 76 | 82 | 78 | 76 |
| #42 | CodeBuddy | 77.6 | 78 | 76 | 78 | 76 | 80 |
| #43 | Ellipsis | 77.6 | 80 | 76 | 80 | 78 | 74 |
| #44 | Grit | 77.6 | 78 | 74 | 70 | 76 | 88 |
| #45 | Tongyi Lingma | 77.6 | 78 | 76 | 78 | 76 | 80 |
| #46 | Pieces for Developers | 77.6 | 80 | 80 | 80 | 78 | 70 |
| #47 | CodeGeeX | 77.1 | 76 | 74 | 78 | 76 | 82 |
| #48 | Baidu Comate | 76.7 | 76 | 74 | 78 | 76 | 80 |
| #49 | Codeflash | 76.4 | 78 | 74 | 78 | 78 | 74 |
| #50 | Mutable AI | 76.1 | 78 | 76 | 76 | 76 | 74 |
| #51 | Double | 75.1 | 76 | 74 | 78 | 76 | 72 |
| #52 | Charlie | 73.2 | 76 | 74 | 76 | 74 | 66 |
| #53 | Blackbox AI | 72.4 | 74 | 72 | 74 | 72 | 70 |
| #54 | Magic | 71.6 | 78 | 74 | 70 | 74 | 60 |
| #55 | Codegen | 70.9 | 74 | 74 | 72 | 72 | 62 |