# Merge pull request \#12427 from r00ster91/nicelexer · gitcafe/zig

[View on GitCafe](https://git.cafe/gitcafe/zig/commit/9d85335de9f89213ed0c3f6a1ba4be1e02d186a1)

Repository: [gitcafe/zig](https://git.cafe/gitcafe/zig)

Visibility: public

Requested revision: 9d85335de9f89213ed0c3f6a1ba4be1e02d186a1

Requested commit: 9d85335de9f89213ed0c3f6a1ba4be1e02d186a1

Commit: 9d85335de9f89213ed0c3f6a1ba4be1e02d186a1

Tree: 9d51e53da3b95d9d5943357e521d5cd2d9a4986b

Author: Andrew Kelley

Committer: GitHub

## Message

```
Merge pull request #12427 from r00ster91/nicelexer

tokenizer: cleanups
```

## Parents

- [6e794938b810384323ce332cf0cf3e41ecc6c4a9](https://git.cafe/gitcafe/zig/commit/6e794938b810384323ce332cf0cf3e41ecc6c4a9?format=markdown)

- [83909651ea99eb45c67ead40b5fcb5773d1998d5](https://git.cafe/gitcafe/zig/commit/83909651ea99eb45c67ead40b5fcb5773d1998d5?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zig/tree/9d85335de9f89213ed0c3f6a1ba4be1e02d186a1?format=markdown)