Yes, and it's bad when humans do it too. Mitigating it when possible is good systems design. Expecting relative determinism is something people have come to expect of computers. It's not some condemnation of Llms, it's just thing you have to keep in mind when using the tool.
The computer, in this case, was instructed to take on a human role.
My point is that if you ask a computer to critique a highly subjective medium, then as a user, this is what I'd expect if I knew that system wasn't allowed to save it's previous responses (for some reason... Maybe bad system design?)
The entire point of taking on a role as a professor isn't to give a final grade. It's to teach what the student could do to make their work better. And the LLM did an excellent job at that.
Maybe that's bad system design, but the model this system is taking on is one in academia.
