# ep_cli: Chunk teacher prediction requests to Anthropic batch API \(\#47318\) · gitcafe/zed

[View on GitCafe](https://git.cafe/gitcafe/zed/commit/54114d24f1a3d2aa8f47acc10dc5b189ae367689)

Repository: [gitcafe/zed](https://git.cafe/gitcafe/zed)

Visibility: public

Requested revision: 54114d24f1a3d2aa8f47acc10dc5b189ae367689

Requested commit: 54114d24f1a3d2aa8f47acc10dc5b189ae367689

Commit: 54114d24f1a3d2aa8f47acc10dc5b189ae367689

Tree: 0b074a70f0f1899258adbbb0e88acdd6f2f34bba

Author: Ben Kunkle

Committer: GitHub

## Message

```
ep_cli: Chunk teacher prediction requests to Anthropic batch API (#47318)

Closes #ISSUE

We're hitting request size limits on the new larger dataset, so we need
to do pre-batching. A 16k chunk size was chosen arbitrarily but seems to
be a good tradeoff between number of chunks / within request size limit

Release Notes:

- N/A *or* Added/Fixed/Improved ...
```

## Parents

- [63543349c03543c1e6616c55634e155a44d0f5cf](https://git.cafe/gitcafe/zed/commit/63543349c03543c1e6616c55634e155a44d0f5cf?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zed/tree/54114d24f1a3d2aa8f47acc10dc5b189ae367689?format=markdown)