Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Usually I find this kind of variation is due to context management.

Accuracy can decreases at large context sizes. OpenAI's compaction handles this better than anyone else, but it's still an issue.

If you are seeing this kind of thing start a new chat and re-run the same query. You'll usually see an improvement.



I don't think so. I am aware that large contexts impacts performance. In long chats an old topic will someone be brought up in new responses, and the direction of the mode is not as focused.

Regardless I tend to use new chats often.


This is called context rot


I thought context rot was only for long distance queries.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: