# tokenizer: clean up invalid token error · gitcafe/zig

[View on GitCafe](https://git.cafe/gitcafe/zig/commit/c5c23db6278332044c0606d78419000b68185e0c)

Repository: [gitcafe/zig](https://git.cafe/gitcafe/zig)

Visibility: public

Requested revision: c5c23db6278332044c0606d78419000b68185e0c

Requested commit: c5c23db6278332044c0606d78419000b68185e0c

Commit: c5c23db6278332044c0606d78419000b68185e0c

Tree: e0534dd3eaf43d5dd776eb1120ca364810546283

Author: Andrew Kelley

Committer: Andrew Kelley

## Message

```
tokenizer: clean up invalid token error

It now displays the byte with proper printability handling. This makes
the relevant compile error test case no longer a regression in quality
from stage1 to stage2.

```

## Parents

- [7a2e0d98109d39f06400dfbc03c12695557100c6](https://git.cafe/gitcafe/zig/commit/7a2e0d98109d39f06400dfbc03c12695557100c6?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zig/tree/c5c23db6278332044c0606d78419000b68185e0c?format=markdown)