FretBench
Results Blog GitHub

Blog

  • Corrected results: open-weight models sweep FretBench Mar 10, 2026

    A grading bug was silently dropping every sharp note. After fixing it, the leaderboard flipped — open-weight models now hold all eight top spots.

  • I asked 14 AI models to read guitar tabs. Most of them failed. Mar 9, 2026

    Guitar tablature is one of the simplest notation systems in music. So why do most frontier LLMs struggle with it?

Open source · MIT license