eval: Add jitter to retry attempts (#32542)

Adds some jitter to avoid the issue that all requests will retry at
roughly the same time in eval where we have a lot of concurrent
requests.

Release Notes:

- N/A
2ecc24eb26Ben Brandt committed on 6/11/2025, 12:56:23 PM· committed by GitHubparent6c4728f
1 file changedLine totals unavailable