# eval: Count execution errors as failures \(\#30712\) · gitcafe/zed

[View on GitCafe](https://git.cafe/gitcafe/zed/commit/6420df39757171e1e18f147472315f4ff0233064)

Repository: [gitcafe/zed](https://git.cafe/gitcafe/zed)

Visibility: public

Requested revision: 6420df39757171e1e18f147472315f4ff0233064

Requested commit: 6420df39757171e1e18f147472315f4ff0233064

Commit: 6420df39757171e1e18f147472315f4ff0233064

Tree: 106218f8358bb2de2ee4f17db33a2a3cce864793

Author: Oleksiy Syvokon

Committer: GitHub

## Message

```
eval: Count execution errors as failures (#30712)

- Evals returning an error (e.g., LLM API format mismatch) were silently
skipped in the aggregated results. Now we count them as a failure (0%
success score).

- Setting the `VERBOSE` environment variable to something non-empty
disables string truncation

Release Notes:

- N/A
```

## Parents

- [83498ebf2b867170f5a7cc6cd474cd48ba828daf](https://git.cafe/gitcafe/zed/commit/83498ebf2b867170f5a7cc6cd474cd48ba828daf?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zed/tree/6420df39757171e1e18f147472315f4ff0233064?format=markdown)