Don't assert min buffer size on iterator init. That was changing public
interface. This way we don't break that interface.