# fix self hosted tokenizer handling of EOF · gitcafe/zig

[View on GitCafe](https://git.cafe/gitcafe/zig/commit/dfbb8254ca97154b5314bde03655417c1dca86ae)

Repository: [gitcafe/zig](https://git.cafe/gitcafe/zig)

Visibility: public

Requested revision: dfbb8254ca97154b5314bde03655417c1dca86ae

Requested commit: dfbb8254ca97154b5314bde03655417c1dca86ae

Commit: dfbb8254ca97154b5314bde03655417c1dca86ae

Tree: 0360cdd64d2289a6321133e4e07e4eb09a26177d

Author: Andrew Kelley

Committer: Andrew Kelley

## Message

```
fix self hosted tokenizer handling of EOF

```

## Parents

- [b4e44c4e80fd4f477a46251fdaf485a742ffe6f7](https://git.cafe/gitcafe/zig/commit/b4e44c4e80fd4f477a46251fdaf485a742ffe6f7?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zig/tree/dfbb8254ca97154b5314bde03655417c1dca86ae?format=markdown)