# evals: Configurable judge model \(\#31282\) · gitcafe/zed

[View on GitCafe](https://git.cafe/gitcafe/zed/commit/68a46c362723cc56cb86c88fad697bb20a739a14)

Repository: [gitcafe/zed](https://git.cafe/gitcafe/zed)

Visibility: public

Requested revision: 68a46c362723cc56cb86c88fad697bb20a739a14

Requested commit: 68a46c362723cc56cb86c88fad697bb20a739a14

Commit: 68a46c362723cc56cb86c88fad697bb20a739a14

Tree: 7c84690c0f33c84c80ba9cca0ee4fe05133fa3f9

Author: Oleksiy Syvokon

Committer: GitHub

## Message

```
evals: Configurable judge model (#31282)

This is needed for apples-to-apples comparison of different agent
models.

Another change is that now `cargo -p eval` accepts model names as
`provider_id/model_id` instead of separate `--provider` and `--model`
params.


Release Notes:

- N/A
```

## Parents

- [3a1053bf0c1aafc6259fccd8202f8f88dad17a35](https://git.cafe/gitcafe/zed/commit/3a1053bf0c1aafc6259fccd8202f8f88dad17a35?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zed/tree/68a46c362723cc56cb86c88fad697bb20a739a14?format=markdown)