# eval: Fine-grained assertions \(\#29246\) · gitcafe/zed

[View on GitCafe](https://git.cafe/gitcafe/zed/commit/ce1a674ebad2a4ecc48dea029f73660483c74a64)

Repository: [gitcafe/zed](https://git.cafe/gitcafe/zed)

Visibility: public

Requested revision: ce1a674ebad2a4ecc48dea029f73660483c74a64

Requested commit: ce1a674ebad2a4ecc48dea029f73660483c74a64

Commit: ce1a674ebad2a4ecc48dea029f73660483c74a64

Tree: 8b9ce6f72d620a6e9366d4f0a36c873103d4c46a

Author: Agus Zubiaga

Committer: GitHub

## Message

```
eval: Fine-grained assertions  (#29246)

- Support programmatic examples
([example](https://github.com/zed-industries/zed/blob/17feb260a0919e102ae4e220669c467885bf4b57/crates/eval/src/examples/file_search.rs))
- Combine data-driven example declarations into a single `.toml` file
([example](https://github.com/zed-industries/zed/blob/17feb260a0919e102ae4e220669c467885bf4b57/crates/eval/src/examples/find_and_replace_diff_card.toml))
- Run judge on individual assertions (previously called "criteria")
- Report judge and programmatic assertions in one combined table

Note: We still need to work on concept naming 

<img width=400
src="https://github.com/user-attachments/assets/fc719c93-467f-412b-8d47-68821bd8a5f5">

Release Notes:

- N/A

---------

Co-authored-by: Richard Feldman <oss@rtfeldman.com>
Co-authored-by: Max Brunsfeld <maxbrunsfeld@gmail.com>
Co-authored-by: Thomas Mickley-Doyle <tmickleydoyle@gmail.com>
```

## Parents

- [0d3fe474db29a225e7f78bb172b7d70cc929ff5a](https://git.cafe/gitcafe/zed/commit/0d3fe474db29a225e7f78bb172b7d70cc929ff5a?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zed/tree/ce1a674ebad2a4ecc48dea029f73660483c74a64?format=markdown)