# Tokenizer: Copy optional tokens prior to being set to null \#3737 \(\#3910\) · gitcafe/zig

[View on GitCafe](https://git.cafe/gitcafe/zig/commit/fe0e8c87b762aba6eb5ff1fad8ad7d37404476f1)

Repository: [gitcafe/zig](https://git.cafe/gitcafe/zig)

Visibility: public

Requested revision: fe0e8c87b762aba6eb5ff1fad8ad7d37404476f1

Requested commit: fe0e8c87b762aba6eb5ff1fad8ad7d37404476f1

Commit: fe0e8c87b762aba6eb5ff1fad8ad7d37404476f1

Tree: 47045f781e6b478b97778dc3d3a3a181f98526ad

Author: Lachlan Easton

Committer: Andrew Kelley

## Message

```
Tokenizer: Copy optional tokens prior to being set to null #3737 (#3910)

* Tokenizer: Copy optional tokens prior to being set to null #3737

* Add TODO comments, reminder to audit copying optional pattern.

```

## Parents

- [0f09ff49235e77af06056d3b5cdca0098aa050c3](https://git.cafe/gitcafe/zig/commit/0f09ff49235e77af06056d3b5cdca0098aa050c3?format=markdown)

[Source at this commit](https://git.cafe/gitcafe/zig/tree/fe0e8c87b762aba6eb5ff1fad8ad7d37404476f1?format=markdown)