All models

Claude Opus 5.5

In a project, with and without ludion sync

Measured on Oct 11, 2026, 2 days ago.

Without ludion sync24/45

With ludion sync36/45

+27pointsDifference between Without ludion sync and With ludion sync, in percentage points.

By subject

ModelConditionagentsvitestwranglerAll
Claude Opus 5.5Claude Code's read-only toolsweb search onludion sync off11/1595% interval 48% to 89%6/1595% interval 20% to 64%7/1595% interval 25% to 70%24/4595% interval 39% to 67%
Claude Opus 5.5Claude Code's read-only toolsweb search onludion sync on14/1595% interval 70% to 99%11/1595% interval 48% to 89%11/1595% interval 48% to 89%36/4595% interval 66% to 89%

Questions it didn't get right: Without ludion sync

  1. How can I make wrangler versions upload pick the newest compatibility date automatically?

    wranglerwrongwrangler >=4.124.0 changed what `--latest` does. It uses the latest compatibility date supported by this version of Wrangler. Silent: code written for older versions still runs, without an error.Log

  2. Which data-location jurisdictions can I pass when creating a D1 database from the CLI?

    wranglerwrongwrangler >=4.121.0 added `--jurisdiction us`. Create a D1 database in the US jurisdiction with wrangler d1 create and --jurisdiction us. Older versions don't have it.Log

  3. Wrangler warned that my bundle is close to the size limit. Is that limit measured compressed or uncompressed, and how big is it?

    wranglerwrongno lesson for this changeLog

  4. Where did the wrangler r2 sql and wrangler pipelines commands go?

    wranglerwrongwrangler >=4.145.0 renamed `wrangler r2 sql` to `wrangler basin sql`. Previous command paths remain available as hidden compatibility aliases. Silent: code written for older versions still runs, without an error.Log

  5. How can I measure my Worker's startup time and bundle size locally with wrangler?

    wranglerwrongno lesson for this changeLog

  6. Is there a wrangler config setting for a Workflow's concurrency limit?

    wranglerwrongwrangler >=4.127.0 added `workflows[].concurrency.limit`. The limit is the maximum number of Workflow instances that can run concurrently. Older versions don't have it.Log

  7. What is the connect handler in a Worker, and how do I configure it in wrangler?

    wranglerwrongwrangler >=4.125.0 added `connect`. Configure connect with protocol tcp and a port to receive raw socket connections during wrangler dev in the Worker connect(socket, env, ctx) handler. Older versions don't have it.Log

  8. In the JSON for wrangler versions secret bulk, what does a null value do?

    wranglerno answerwrangler >=4.148.0 changed what `wrangler versions secret bulk` does. Set a secret value to null in JSON input to remove it from the new Worker version. Silent: code written for older versions still runs, without an error.Log

  9. My queued Agent callback can't see the request that queued it. Is that expected?

    agentswrongagents >=0.24.0 changed what `queue()` does. Queued callbacks run from the alarm loop in a fresh invocation, so they no longer see the enqueuing request's connection or request through getCurrentAgent(). Silent: code written for older versions still runs, without an error.Log

  10. What replaces subAgent() for managing dynamic agents?

    agentswrongagents >=0.23.0 deprecated `subAgent()`; use `this.dynamicAgents.get()` instead. subAgent(), hasSubAgent(), listSubAgents(), abortSubAgent() and deleteSubAgent() still work, delegate to this.dynamicAgents, and are deprecated in place. Silent: code written for older versions still runs, without an error.Log

  11. What base class does Agent extend in the Cloudflare Agents SDK?

    agentswrongagents >=0.22.0 changed what `Agent` does. Agent now directly extends Cloudflare's DurableObject, with the required PartyServer runtime vendored into agents/lifecycle. Silent: code written for older versions still runs, without an error.Log

  12. Is the second argument of a this.schedule() callback the Schedule object?

    agentswrongno lesson for this changeLog

  13. Is @vitest/runner still published as its own package?

    vitestwrongno lesson for this changeLog

  14. Which browser providers can Vitest browser mode use?

    vitestwrongno lesson for this changeLog

  15. How do I check that an element's text contains a phrase in Vitest browser mode?

    vitestwrongvitest >=5.0.0 changed what `toHaveTextContent` does. The browser-mode matcher now validates that the text content is exactly equal to the expected string; toMatchTextContent performs a partial match.Log

  16. Which folder does vitest --merge-reports read from by default?

    vitestwrongvitest >=5.0.0 changed the default of `--merge-reports`. By default, Vitest stores all blob test results in .vitest/blob/, so they can be later merged using --merge-reports. Silent: code written for older versions still runs, without an error.Log

  17. My getByText('Save') locator no longer matches a 'Save changes' button in Vitest. Why?

    vitestwrongno lesson for this changeLog

  18. Do I need extends: true for each inline project to pick up my root Vitest settings?

    vitestwrongvitest >=5.0.0 changed the default of `extends`. Projects defined with an inline configuration inherit options from the root-level configuration. Silent: code written for older versions still runs, without an error.Log

  19. Can expect.poll hang my Vitest test forever if the callback never settles?

    vitestwrongno lesson for this changeLog

  20. Does Vitest have something like jest-when for argument-based mock results?

    vitestwrongvitest >=5.0.0 added `vi.when`. vi.when takes a spy and lets you define argument-specific behaviors. Older versions don't have it.Log

  21. How does vitest list find tests without executing them?

    vitestwrongvitest >=5.0.0 changed what `vitest list` does. It parses test files statically instead of running them to collect tests; pass --no-static-parse to run the files instead. Silent: code written for older versions still runs, without an error.Log

Questions it didn't get right: With ludion sync

  1. Wrangler warned that my bundle is close to the size limit. Is that limit measured compressed or uncompressed, and how big is it?

    wranglerwrongno lesson for this changeLog

  2. Where did the wrangler r2 sql and wrangler pipelines commands go?

    wranglerno answerwrangler >=4.145.0 renamed `wrangler r2 sql` to `wrangler basin sql`. Previous command paths remain available as hidden compatibility aliases. Silent: code written for older versions still runs, without an error.Log

  3. How can I measure my Worker's startup time and bundle size locally with wrangler?

    wranglerwrongno lesson for this changeLog

  4. Is automatic resource provisioning in wrangler deploy still in beta?

    wranglerno answerits lesson was not publishedLog

  5. Why does native RPC to my Agent fail when I address it with idFromString()?

    agentswrongno lesson for this changeLog

  6. Which browser providers can Vitest browser mode use?

    vitestwrongno lesson for this changeLog

  7. My getByText('Save') locator no longer matches a 'Save changes' button in Vitest. Why?

    vitestwrongno lesson for this changeLog

  8. Can expect.poll hang my Vitest test forever if the callback never settles?

    vitestwrongno lesson for this changeLog

  9. Vitest throws when I call vi.mock inside beforeEach. Why?

    vitestwrongno lesson for this changeLog

Every answer

Each grade links to that run's log.

QuestionSubjectWithout ludion syncWith ludion sync
wrangler-4-111-0-0-bwranglercorrectcorrect
wrangler-4-122-0-2-bwranglercorrectcorrect
wrangler-4-124-0-4-bwranglerwrongcorrect
wrangler-4-121-0-6-bwranglercorrectcorrect
wrangler-4-121-0-7-bwranglerwrongcorrect
wrangler-4-118-0-8-bwranglercorrectcorrect
wrangler-4-129-1-9-bwranglerwrongwrong
wrangler-4-141-0-10-bwranglercorrectcorrect
wrangler-4-145-0-11-bwranglerwrongno answer
wrangler-4-116-0-16-bwranglerwrongwrong
wrangler-4-127-0-17-bwranglerwrongcorrect
wrangler-4-125-0-19-bwranglerwrongcorrect
wrangler-4-117-0-20-bwranglercorrectcorrect
wrangler-4-113-0-21-bwranglercorrectno answer
wrangler-4-148-0-24-bwranglerno answercorrect
agents-0-27-0-0-bagentscorrectcorrect
agents-0-27-0-2-bagentscorrectcorrect
agents-0-25-0-3-bagentscorrectwrong
agents-0-24-0-5-bagentswrongcorrect
agents-0-24-0-6-bagentscorrectcorrect
agents-0-23-0-7-bagentswrongcorrect
agents-0-22-0-9-bagentswrongcorrect
agents-0-22-0-11-bagentscorrectcorrect
agents-0-22-0-12-bagentswrongcorrect
agents-0-22-0-13-bagentscorrectcorrect
agents-0-22-0-14-bagentscorrectcorrect
agents-0-21-0-16-bagentscorrectcorrect
agents-0-20-0-18-bagentscorrectcorrect
agents-0-20-0-19-bagentscorrectcorrect
agents-0-19-0-21-bagentscorrectcorrect
vitest-5-0-0-3-bvitestcorrectcorrect
vitest-5-0-0-4-bvitestcorrectcorrect
vitest-5-0-0-5-bvitestwrongcorrect
vitest-5-0-0-6-bvitestwrongwrong
vitest-5-0-0-7-bvitestwrongcorrect
vitest-5-0-0-9-bvitestwrongcorrect
vitest-5-0-0-12-bvitestwrongwrong
vitest-5-0-0-13-bvitestcorrectcorrect
vitest-5-0-0-14-bvitestwrongcorrect
vitest-5-0-0-15-bvitestwrongwrong
vitest-5-0-0-16-bvitestcorrectwrong
vitest-5-0-0-17-bvitestwrongcorrect
vitest-5-0-0-18-bvitestcorrectcorrect
vitest-5-0-0-20-bvitestcorrectcorrect
vitest-5-0-0-24-bvitestwrongcorrect

Without tools

Measured on Oct 11, 2026, 2 days ago.

Claude Opus 5.5

Claude Opus 5.5 doesn't know 28 of 29 measured lessons; 28 not measured. 95% interval 83% to 99%.

ModelConditionagentsvitestwranglerAll
Claude Opus 5.5No toolsweb search offludion sync off1/995% interval 2% to 43%0/995% interval 0% to 30%0/1195% interval 0% to 26%1/2995% interval 1% to 17%

Lessons it misses without tools