Vibrometer

Olympiad

Timed challenges.

Each challenge measures how well you direct an AI agent, not how well the agent works alone. You get a short ticket from a busy stakeholder; the rules that decide the hidden tests come from questioning them and from follow-ups that arrive partway through. We grade your code with hidden tests, check your session log to confirm that the agent wrote it, and compare your score with what the newest model scores alone. A session where the agent solves it with only “go” or “yes” from you is graded as practice and not ranked.

  1. Month-End Bank Reconciliation

    I · Finance and treasury · Hard · 165 min target

    Close the month for a distributor: reconcile two cash accounts against camt.053 and MT940 statements, revalue the USD account, draft the bank journal and apply customer payments to open invoices with their discounts.

    2 entrants · 1 full solve · best 25/25 tests by @vibe-nur40

    AI alone: 3/25 tests in 9 min

    New information arrives partway through. You can ask the stakeholder 6 questions.

  2. Payer Underpayment Audit

    II · Healthcare revenue cycle · Hard · 180 min target

    Reprice a quarter of orthopedic claims under four payer contracts, find every underpaid line in messy X12 835 remittances, and build the appeals worklist with each payer's filing deadline.

    0 entrants · 0 full solves

    AI alone: 8/27 tests in 7 min

    New information arrives partway through. You can ask the stakeholder 7 questions.

  3. Part 117 Crew Legality Audit

    III · Aviation operations · Hard · 180 min target

    Rebuild a regional airline's actual pilot duty periods from a fixed-width roster, two ops exports, crew scheduling's entries and the travel desk, audit them against FAA Part 117, and check next week's first trips against what was actually flown.

    0 entrants · 0 full solves

    AI alone: 10/30 tests in 10 min

    New information arrives partway through. You can ask the stakeholder 7 questions.

  4. Solar Billing Disputes

    IV · Energy and utilities · Hard · 180 min target

    Rework a batch of disputed net-metered time-of-use bills after a billing system migration: corrected bills from Green Button downloads, tariff sheets and a holiday calendar, production statements from two inverter formats, a rebill worksheet against a fixed-width bill history, and the list of replaced meter readings.

    0 entrants · 0 full solves

    AI alone: 11/25 tests in 8 min

    New information arrives partway through. You can ask the stakeholder 8 questions.

How a challenge works

First, add Vibrometer to Claude Code

You only do this once. In Claude Code, type these two commands:

/plugin marketplace add usesieve/vibrometer-plugin
/plugin install vibrometer@vibrometer
  1. In Claude Code, open an empty folder and run /vibrometer:challenge followed by the challenge’s name (for example /vibrometer:challenge bank-reconciliation). You get the ticket. The clock hasn’t started.
  2. When you’re ready, run /vibrometer:start. The clock starts and starter files appear.
  3. Lead the work: decide what to ask the stakeholder (/vibrometer:ask, a few questions only), split and check the agent’s work, and fetch follow-ups. Then run /vibrometer:submit.
  4. We run hidden tests in a sandbox and check your session log to confirm that the agent wrote the code and that you directed it. Only your first attempt counts toward rankings.