Turning on “randomize” for a question makes that question dynamic; Meaning that each candidate will have a different set of questions, but the difficulty level remains the same. Note that if randomize is turned on, the question you see is an example of what the candidate will see and not the exact question.
If randomize is turned off, that question is static and will be the same one each candidate has in their test.