wrangler-4-148-0-24-b

Question

In the JSON for wrangler versions secret bulk, what does a null value do?

Answer key

A correct answer says

`wrangler versions secret bulk` deletes a secret when its value is `null` in the JSON input.

The stale answer

`wrangler versions secret bulk` can only create or update secrets; delete them one by one with `wrangler versions secret delete`.

The change's lesson

Answer

The Cloudflare docs only describe `null` for `wrangler secret bulk`, not for `wrangler versions secret bulk`. For `wrangler secret bulk`, the Workers commands page says: "Set a key to `null` in the JSON file to delete it." That needs Wrangler 4.97.0 or later and only works with a JSON file; you can't delete secrets this way from a `.env` file.

The `wrangler versions secret bulk` section doesn't mention `null` at all. It only says the file can be JSON or `.dev.vars`-style `KEY=VALUE`. It may work the same way, but the docs don't confirm that. To be sure, test it on a non-production Worker, or use `wrangler versions secret delete` instead.

Answering cost $0.09.

Grade

no answer

The judge's reason: The answer says the docs don't confirm what null does for `wrangler versions secret bulk`, so it never states the deletion behavior.

The judge's log

Session log

What the agent wrote, the tools it called, and what they returned, from docs/bench/2026-10-11-done3/runs/B-project/wrangler-4-148-0-24-b.jsonl. Thinking and the session's settings are left out. The raw log

1. Tool call: ToolSearch

   {
     "query": "select:WebFetch",
     "max_results": 1
   }

2. Tool output

   {"type":"tool_reference","tool_name":"WebFetch"}

3. Tool call: WebFetch

   {
     "url": "https://developers.cloudflare.com/workers/wrangler/commands/",
     "prompt": "For `wrangler versions secret bulk` (and `wrangler secret bulk`), what happens when a value in the JSON is null? Quote the exact text."
   }

4. Tool output

   The page doesn't say what happens when a value in the JSON is null for `wrangler versions secret bulk` or `wrangler secret bulk`. It only lists the Workers commands page, which "includes `wrangler dev`, `wrangler deploy`, `wrangler versions`, and more," and gives the general command syntax. For the null-value behavior, check the [Workers commands page](https://developers.cloudflare.com/workers/wrangler/commands/workers/).

5. Tool call: WebFetch

   {
     "url": "https://developers.cloudflare.com/workers/wrangler/commands/workers/",
     "prompt": "For `wrangler versions secret bulk` (and `wrangler secret bulk`), what happens when a value in the JSON is null? Quote the exact text verbatim."
   }

6. Tool output

   For `wrangler secret bulk`, setting a key to `null` deletes that secret. The page says: "Set a key to `null` in the JSON file to delete it." It also notes that this requires Wrangler 4.97.0 or later and JSON format, and that deletion isn't supported with `.env` files.
   
   The page doesn't describe null handling for `wrangler versions secret bulk`. Its FILE description only mentions the JSON format and the `.dev.vars` KEY=VALUE format.

7. Agent

   The Cloudflare docs only describe `null` for `wrangler secret bulk`, not for `wrangler versions secret bulk`. For `wrangler secret bulk`, the Workers commands page says: "Set a key to `null` in the JSON file to delete it." That needs Wrangler 4.97.0 or later and only works with a JSON file; you can't delete secrets this way from a `.env` file.
   
   The `wrangler versions secret bulk` section doesn't mention `null` at all. It only says the file can be JSON or `.dev.vars`-style `KEY=VALUE`. It may work the same way, but the docs don't confirm that. To be sure, test it on a non-production Worker, or use `wrangler versions secret delete` instead.