CGAI Synth Lab: The Keyboard Synth Benchmark

30 AI-generated keyboard synthesizers scored on a 100-point rubric with automated Playwright tests. Real Web Audio measurements of pitch accuracy, latency, and polyphony. From zero-shot prompts to production-ready instruments — witness the evolution of AI coding assistants from Oct 2025 to Jun 2026.

30 Synthesizers
8 AI Tools
12 Months
98K+ Lines of Code

Timeline

Chronological progression from March 2025 to February 2026

Tool Comparison

Compare the capabilities of different AI coding assistants

Feature Matrix

Compare features across all 27 implementations

Benchmark Leaderboard

All 30 synthesizers ranked by automated Playwright scoring rubric. See full methodology →

The Evolution Story

A journey through AI-assisted music software development

About This Benchmark

This collection documents an extraordinary experiment: what happens when you ask AI coding assistants to build keyboard synthesizers from scratch using zero-shot prompting? Over 11 months, from March 2025 to February 2026, we witnessed the rapid evolution of AI-generated music software—from 125-line proof-of-concepts to a 58,000-line social music platform.

Each project represents a fresh start with a simple prompt, yet the results range from basic beeping keys to professional-grade DAWs with MIDI support, real-time collaboration, and AI composition assistance. This benchmark reveals both the remarkable capabilities and the fascinating inconsistencies of AI code generation.

Key Milestones

March 2025

The Windsurf Era Begins

First synthesizer generated. Basic waveforms, envelope controls—proof that AI could produce functional Web Audio code from minimal instructions.

March 15, 2025

Multiple Paradigms Explored

A single day produced four different interface styles: Teenage Engineering OP-1, OP-XY grid, beginner-friendly EasyPlay, and multi-decade instrument. AI creativity in full display.

June 13-16, 2025

First Web MIDI Support

Kiro's Web Audio Sequencer (evolved to Ralph Keyboard Synthesizer) implements requestMIDIAccess—the first Web MIDI API integration in the benchmark.

June 9-10, 2025

Kiro's Rapid Iteration

Seven versions in two days. Each prompt built upon the last, demonstrating AI's ability to iteratively improve: adding filters, delay, reverb, polyphony, sequencer, and finally recording.

June 13, 2025

First React/TypeScript DAW

Kiro produces a 14,000-line professional DAW with multi-track sequencing—a dramatic jump from vanilla JavaScript implementations.

June 16, 2025

58,000 Lines: The Platform

The evolved Web Audio Sequencer becomes a complete social music platform with AI composition, multiplayer collaboration, and Guitar Hero-style visuals.

January 13, 2026

Ralph's Autonomous Build

Claude Opus 4.5 powers Ralph to autonomously build a complete synthesizer through 18 user stories—no human code intervention required.

February 11, 2026

Ralph for Kiro Build

Ralph methodology adapted for Kiro CLI produces a full-featured synth with 3 oscillators, arpeggiator, sequencer, MIDI, effects chain, and 16 factory presets—19 user stories in pure vanilla JS.

Tool Perspectives

Windsurf

The pioneer. Windsurf generated the most implementations (10), showcasing consistent ability to produce themed synthesizers with strong visual design. From basic Akai-style keyboards to the comprehensive DecadeTunes with learning mode, Windsurf demonstrated reliable Web Audio fundamentals.

Kiro

The escalator. Kiro's outputs ranged wildly—from 200-line basics to a 58,000-line platform. The rapid v1-v7 sequence showed impressive iterative capability, while the React/TypeScript DAW proved AI could generate production-grade architecture.

RooCode + Claude 4

The specialist. A single output, but significant: first Web MIDI integration and professional performance monitoring. Quality over quantity, demonstrating Claude's strength in technical features.

Ralph + Claude Opus 4.5

The culmination. Unlike other tools, Ralph represents fully autonomous development—planning, implementing, testing, and iterating without human coding intervention. The benchmark's endpoint proves AI agents can own entire software development lifecycle.

Quality Progression

Average quality scores show clear upward trend: early Windsurf projects scored 5-6/10, mid-timeline Claude 4 and Kiro implementations hit 7-8/10, and the latest Ralph and evolved Kiro projects achieve 9-10/10. This progression reflects both improving AI models and more sophisticated prompting strategies.

📈

125 → 58,613 LOC

Lines of code increased 468x from smallest to largest implementation

🎹

1 → 12 Features

Basic waveforms evolved to full DAW with AI, collaboration, and visual effects

⚡

2 → 10 Complexity

Complexity scores range from proof-of-concept to production platform

The Benchmark Conclusion

This collection proves AI coding assistants have crossed a significant threshold. They're no longer limited to snippets or boilerplate—they can architect, implement, and iterate on complex interactive applications.

kiro-synth is the latest entry: a full-featured synthesizer built by Ralph for Kiro with 3 oscillators, arpeggiator, step sequencer, MIDI support, effects chain, 16 factory presets, audio recording, and real-time visualization—all in 1,624 lines of pure vanilla JavaScript.

Explore the timeline above to see this evolution unfold, or dive into the gallery to try each synthesizer yourself.