Non-determinism
Non-determinism means the same question can get a different answer twice.
It is not a bug and you cannot turn it off. Generating text involves picking between options, and the pick is not always the same.
It is why a prompt that worked yesterday can fail today, and why anything important gets checked rather than trusted.
Was this page helpful?