# zeta2: Improve error reporting and eval purity \(\#42470\) · gitcafe/zed

[View on GitCafe](https://git.cafe/gitcafe/zed/commit/6c0069ca983128bb879c186297fdc721920ef522)

Repository: [gitcafe/zed](https://git.cafe/gitcafe/zed)

Visibility: public

Requested revision: 6c0069ca983128bb879c186297fdc721920ef522

Requested commit: 6c0069ca983128bb879c186297fdc721920ef522

Commit: 6c0069ca983128bb879c186297fdc721920ef522

Tree: 6dc7ee91b8798d96256e2b14d6e5979c8a601819

Author: Ben Kunkle

Committer: GitHub

## Message

```
zeta2: Improve error reporting and eval purity (#42470)

Closes #ISSUE

Improves error reporting for various failure modes of zeta2, including
failing to parse the `<old_text>`/`<new_text>` pattern, and the contents
of `<old_text>` failing to match.

Additionally, makes it so that evals are checked out into a worktree
with the _repo_ name instead of the _example_ name, in order to make
sure that the eval name has no influence on the models prediction. The
repo name worktrees are still namespaced by the example name like
`{example_name}/{repo_name}` to ensure evals pointing to the same repo
do not conflict.

Release Notes:

- N/A *or* Added/Fixed/Improved ...

---------

Co-authored-by: Agus <agus@zed.dev>
```

## Parents

- [c8930e07a3677d8abe01576b1650da99f15fe6a5](https://git.cafe/gitcafe/zed/commit/c8930e07a3677d8abe01576b1650da99f15fe6a5?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zed/tree/6c0069ca983128bb879c186297fdc721920ef522?format=markdown)