evolve check

Check a local task folder, a folder of tasks, or a published dataset. Evolve runs the checker remotely.

Local tasks
Published tasks

evolve check ./tasks --watch

evolve check -d deepswe@1.1 \
  -i anko-default-function-arguments --watch

Use exactly one source: a local path or --dataset. Local tasks are uploaded for this check; they do not need to be published as a dataset first. If a folder is named like a command, include ./: use evolve check ./list, for example.

evolve check runs an agent and incurs usage. For metadata validation before publishing, use evolve dataset check.

Choose tasks

Option	Meaning
`-d`, `--dataset <name[@version]>`	Use tasks from a published dataset instead of a local path.
`-i`, `--include-task-name <glob>`	Include matching tasks. Repeatable.
`-x`, `--exclude-task-name <glob>`	Exclude matching tasks. Repeatable.
`-l`, `--n-tasks <n>`	Maximum tasks after filtering, selected in sorted order. Integer of at least `1`.
`-n`, `--n-concurrent <n>`	Concurrent task checks, an integer from `1` to `150`, also limited by your organization. If omitted, use its ceiling.

Configure the checker

Read the actual platform defaults before customizing them.

evolve check --show-defaults

Option	Meaning
`--name <name>`	Nonempty check label, at most 120 characters. Defaults to the acceptance timestamp.
`-a`, `--agent <name>`	Agent the checker runs on. `--show-defaults` prints the platform default.
`-m`, `--model <name>`	Checker model, from that agent’s models. Default: the agent’s default model.
`--effort <value>`	Reasoning effort for the selected model. See the model reference.
`-r`, `--rubric <path>`	TOML, YAML, or JSON rubric.
`-p`, `--prompt <path>`	Replacement prompt text file.
`-e`, `--env <provider>`	Checker sandbox provider.
`--show-defaults`	Print the agent, model, effort, provider, prompt, and rubric, then exit. `-a` picks the agent.
`--watch`	Wait until every task check settles.
`-q`, `--quiet`	With watch, suppress intermediate progress.

--show-defaults accepts only -a and the global options. It cannot be combined with a path, dataset, or other checker options. For rubric format and interpretation, see Check.

Read the report

The command prints a parent check ID. Use it as $CHECK_ID below. Without --watch, the check continues in the background.

evolve check list
evolve check show "$CHECK_ID"

With --json, starting a check returns one check object. With --watch --json, it prints check.accepted, check.progress, and check.final records. --quiet omits the progress records. A watched check returns exit code 1 if any task-check execution fails.

Check
├── Task check: task A
├── Task check: task B
└── Task check: task C

Each task check
├── Criterion results
└── Trace

The default rubric’s execution criteria say whether a task check ran the task; unknown on them is not proof that the solution or verifier ran. A clean inspection without execution is not proof that the solution and verifier work.

List options

check list accepts the shared list options, plus:

Option	Meaning
`--scope <my\|shared\|org>`	Records to list. Default `my`.
`--status <statuses>`	Comma-separated parent check statuses: `queued`, `running`, `completed`.
`-d`, `--dataset <name[@version]>`	Filter checks by dataset. A bare name includes all versions.

check show returns exit code 1 if any task-check execution failed. A criterion marked fail is a quality finding, not that execution error.

Inspect one task check

Find the task-check ID in evolve check show "$CHECK_ID" --json. Use that ID as $TASK_CHECK_ID.

evolve check trace "$TASK_CHECK_ID"
evolve check trace "$TASK_CHECK_ID" --since 200

--since <n> skips the first N transcript events. The command reads the available transcript and exits; it does not follow live output. JSON output is one event per line. For files, logs, and live processes, use the filesystem commands.

The parent check ID selects the whole report. Trace, files, logs, and processes need an individual task-check ID.

Download

Whole check
One task check
One artifact

evolve check download "$CHECK_ID" -o checks/

Saves check-<id>/ with the report and task-check folders.

evolve check download "$TASK_CHECK_ID" -o checks/

Saves that task check’s folder.

evolve check download "$TASK_CHECK_ID" --stream task-check
evolve check download "$TASK_CHECK_ID" --stream trace-stdout

Option	Meaning
`-o`, `--output-dir <dir>`	Parent folder. Default `checks/`.
`--overwrite`	Allow replacing an existing folder.
`--stream <artifact>`	Print `task-check`, `trace-parsed`, `trace-stdout`, `trace-stderr`, or `agent-home`. Requires a task-check ID.
`--since <n>`	Skip N transcript events with `--stream trace-parsed`.

Stream mode cannot be combined with output directory or overwrite. --since is accepted only with --stream trace-parsed.

Download JSON output

Mode	Output with `--json`
Save to disk	One object with `path` and the number of `files`.
`--stream task-check`	An object containing `task_check`.
`--stream trace-parsed`	One event per line.
`--stream trace-stdout` or `trace-stderr`	An object containing `log`; null when no log was stored.
`--stream agent-home`	An object containing `files`; null when no files were stored.

Delete a check

evolve check delete "$CHECK_ID"

The command asks before permanent deletion. For noninteractive use, pass -y or --yes.

Deleting a check removes its report, task checks, traces, and files. Only the creator can delete it. Queued or running task checks must finish first. If check_not_terminal remains after they finish, Evolve is still saving final output; retry when that finishes.

The creator can share the parent check by link or email.

evolve check share "$CHECK_ID" --link
evolve check share "$CHECK_ID" --email colleague@example.com
evolve check shares "$CHECK_ID"
evolve check unshare "$CHECK_ID" --link

share and unshare accept --link, repeatable --email <address>, or both; at least one is required. Email sharing sends a link to the recipient. Sharing rules and global options apply.

Start work

Inspect results

Manage resources

Choose tasks

Configure the checker

Read the report

List options

Inspect one task check

Download

Delete a check

Choose tasks

Configure the checker

Read the report

List options

Inspect one task check

Download

Delete a check

Share a report